{"id":141088,"date":"2024-07-22T16:52:40","date_gmt":"2024-07-22T21:52:40","guid":{"rendered":"https:\/\/www.thelocalvoice.net\/oxford\/?p=141088"},"modified":"2024-07-22T16:52:42","modified_gmt":"2024-07-22T21:52:42","slug":"researchers-study-how-deepfake-detection-tools-influence-journalists","status":"publish","type":"post","link":"https:\/\/www.thelocalvoice.net\/oxford\/researchers-study-how-deepfake-detection-tools-influence-journalists\/","title":{"rendered":"Researchers Study How Deepfake Detection Tools Influence Journalists"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Role-playing approach offers valuable insight to quell misinformation spread<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">by Marvis Herring<\/h3>\n\n\n\n<p>The scenario-based role playing inspired by the popular <strong>Dungeons &amp; Dragons<\/strong> game has given <strong>University of Mississippi<\/strong> researchers a novel approach to study how journalists use <strong>artificial intelligence<\/strong> tools to verify audiovisual media.<\/p>\n\n\n\n<p>The goal is to help journalists identify deepfakes: manipulated video, audio or images that can make it appear that a person said or did something that they did not. As more deepfakes emerge, misrepresenting&nbsp;<a href=\"https:\/\/www.wired.com\/story\/opinion-the-world-needs-deepfake-experts-to-stem-this-chaos\/\" rel=\"noreferrer noopener\" target=\"_blank\">political leaders<\/a>, celebrities and even high school students, detecting them is becoming more crucial.<\/p>\n\n\n\n<p>One&nbsp;<a href=\"https:\/\/www.prnewswire.com\/news-releases\/sumsub-research-shows-303-surge-in-deepfakes-ahead-of-2024-us-elections-302158861.html\" rel=\"noreferrer noopener\" target=\"_blank\">study<\/a>&nbsp;found a 303% increase in deepfakes detected in the U.S. between 2023 and 2024.<\/p>\n\n\n\n<p>&#8220;If journalists are sending out information that&#8217;s incorrect, they&#8217;re really amplifying misinformation or disinformation at a much larger scale,&#8221; said <strong>Andrea Hickerson<\/strong>, dean of the\u00a0<a href=\"https:\/\/jnm.olemiss.edu\/\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>School of Journalism and New Media<\/strong><\/a>\u00a0and one of the lead researchers.<\/p>\n\n\n\n<p>Hickerson worked with <strong>Saniat &#8220;John&#8221; Javid Sohrawardi<\/strong>, <strong>Matthew Wright<\/strong> and <strong>Y. Kelly Wu<\/strong>, of the <strong>Global Cybersecurity Institute at Rochester Institute of Technology<\/strong>, to complete the &#8220;Dungeons &amp; Deepfakes&#8221; study.\u00a0The Association for Computing Machinery published the research as a part of the\u00a0<a href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3613904.3641973#d1e326\" target=\"_blank\" rel=\"noreferrer noopener\">2024 <strong>CHI Conference on Human Factors in Computing Systems<\/strong><\/a>.<\/p>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/SKB_4298-AA-scaled.jpg?ssl=1\"><img data-recalc-dims=\"1\" fetchpriority=\"high\" decoding=\"async\" width=\"640\" height=\"960\" data-id=\"141091\" src=\"https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/SKB_4298-AA-683x1024.jpg?resize=640%2C960&#038;ssl=1\" alt=\"\" class=\"wp-image-141091\" srcset=\"https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/SKB_4298-AA-scaled.jpg?resize=683%2C1024&amp;ssl=1 683w, https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/SKB_4298-AA-scaled.jpg?resize=200%2C300&amp;ssl=1 200w, https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/SKB_4298-AA-scaled.jpg?resize=768%2C1152&amp;ssl=1 768w, https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/SKB_4298-AA-scaled.jpg?resize=1024%2C1536&amp;ssl=1 1024w, https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/SKB_4298-AA-scaled.jpg?resize=1365%2C2048&amp;ssl=1 1365w, https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/SKB_4298-AA-scaled.jpg?w=1707&amp;ssl=1 1707w, https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/SKB_4298-AA-scaled.jpg?w=1280 1280w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><figcaption class=\"wp-element-caption\">Andrea Hickerson. Photo by Kevin Bain\/Ole Miss Digital Imaging Services<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/Saniat-_John_-Sohrawardi-headshot.jpg?ssl=1\"><img data-recalc-dims=\"1\" decoding=\"async\" width=\"640\" height=\"640\" data-id=\"141090\" src=\"https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/Saniat-_John_-Sohrawardi-headshot-1024x1024.jpg?resize=640%2C640&#038;ssl=1\" alt=\"\" class=\"wp-image-141090\" srcset=\"https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/Saniat-_John_-Sohrawardi-headshot.jpg?resize=1024%2C1024&amp;ssl=1 1024w, https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/Saniat-_John_-Sohrawardi-headshot.jpg?resize=300%2C300&amp;ssl=1 300w, https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/Saniat-_John_-Sohrawardi-headshot.jpg?resize=150%2C150&amp;ssl=1 150w, https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/Saniat-_John_-Sohrawardi-headshot.jpg?resize=768%2C768&amp;ssl=1 768w, https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/Saniat-_John_-Sohrawardi-headshot.jpg?resize=1536%2C1536&amp;ssl=1 1536w, https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/Saniat-_John_-Sohrawardi-headshot.jpg?w=2048&amp;ssl=1 2048w, https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/Saniat-_John_-Sohrawardi-headshot.jpg?w=1280 1280w, https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/Saniat-_John_-Sohrawardi-headshot.jpg?w=1920 1920w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><figcaption class=\"wp-element-caption\">Saniat Javid Sohrawardi. Submitted photo<\/figcaption><\/figure>\n<\/figure>\n\n\n\n<p>Emerging deepfake detection software, designed to identify\u00a0<a href=\"https:\/\/apnews.com\/ap-fact-check\/image-claiming-to-show-trump-dancing-with-underage-girl-is-fake-00000188e8ebdc10ad9bf8eb72850000\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>synthetic media<\/strong><\/a>, sometimes produces inaccurate results, potentially leading journalists to inadvertently publish false information or dismiss valid media.<\/p>\n\n\n\n<p>The researchers created breaking news scenarios where 24 U.S. journalists chose how to verify the authenticity of videos, and they had access to\u00a0<a href=\"https:\/\/defake.app\/\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>DeFake<\/strong><\/a>, an exclusive deepfake detection tool created for journalists by the researchers.<\/p>\n\n\n\n<p>The scenario-based role-play structure of this study revealed when journalists use the tool, how they use traditional verification methods and how the tool affects their decisions to publish or not.<\/p>\n\n\n\n<p>Journalists rely on traditional verification methods, such as contacting established sources, first, and may use deepfake detection tools after running into barriers, including time limitations, according to the findings.<\/p>\n\n\n\n<p>&#8220;Contextual verification is still possible,&#8221; Sohrawardi said.<\/p>\n\n\n\n<p>&#8220;These tools are there to help speed up the process and help provide information, but even if these tools did not exist, contextually, it should be definitely possible to verify any piece of information; it will just take longer.&#8221;<\/p>\n\n\n\n<p>The study results indicated:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Journalists were more thorough in verifying videos with high social or political impact<\/li>\n\n\n\n<li>A few journalists relied too much on the detection tool, especially when results matched their initial impressions<\/li>\n\n\n\n<li>The Dungeons &amp; Dragons methodology was engaging for journalists and could be helpful for deepfake detection training.<\/li>\n<\/ul>\n\n\n\n<p>The researchers caution the release of <strong>deepfake detection<\/strong> technology until journalists get a better understanding of its limitations.<\/p>\n\n\n\n<p>Developers must prioritize transparency, informing users about factors that can impact the accuracy of their tools, such as poor lighting or overly compressed video, Sohrawardi said. &#8220;This helps manage expectations and ensures users understand the limitations of the technology.<\/p>\n\n\n\n<p>&#8220;Give enough information about what&#8217;s the best-case scenario for using this tool and what&#8217;s the worst-case scenario for using this tool. These AI-based tools are trained in specific environments, and they might fail in some environments.&#8221;<\/p>\n\n\n\n<p><strong>The Knight Foundation<\/strong> began providing funding for the DeFake app in 2019, searching for deepfake detections solutions for journalists. The Knight Foundation and <strong>National Science Foundation<\/strong> provided funding for this study.<\/p>\n\n\n\n<p>&#8220;We see journalists as a key intermediary between real and fake information out there,&#8221; Hickerson said. &#8220;The risks for journalists are much higher as a profession because it&#8217;s their credibility, and (mistakes) undermine the whole institution of journalism.<\/p>\n\n\n\n<p>&#8220;Also, they&#8217;ve got a big audience. So, if they&#8217;re sending out information that&#8217;s incorrect, they&#8217;re really amplifying misinformation or disinformation at a much larger scale. The research shows that you can&#8217;t &#8216;put the genie back in the bottle&#8217; after misinformation is out there.&#8221;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2014\/06\/TheLocalVoiceLigature-25web.jpg\"><img data-recalc-dims=\"1\" decoding=\"async\" width=\"25\" height=\"16\" src=\"https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2014\/06\/TheLocalVoiceLigature-25web.jpg?resize=25%2C16\" alt=\"\" class=\"wp-image-14544\"\/><\/a><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Role-playing approach offers valuable insight to quell misinformation spread by Marvis Herring The scenario-based role playing inspired by<\/p>\n","protected":false},"author":123462,"featured_media":141089,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[25263],"tags":[21472,25235,29545,29537,29548,29547,29540,29544,17750,29538,29542,5,17181,7067,4,29539,29541,15923,29546,29549,655,29543],"class_list":["post-141088","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-university-news","tag-andrea-hickerson","tag-artificial-intelligence","tag-chi-conference-on-human-factors-in-computing-systems","tag-deepfake","tag-deepfake-detection","tag-defake","tag-dungeons-and-dragons","tag-global-cybersecurity-institute-at-rochester-institute-of-technology","tag-journalism","tag-journalist","tag-matthew-wright","tag-mississippi","tag-national-science-foundation","tag-ole-miss","tag-oxford","tag-role-playing","tag-saniat-john-javid-sohrawardi","tag-school-of-journalism-and-new-media","tag-synthetic-media","tag-the-knight-foundation","tag-university-of-mississippi","tag-y-kelly-wu"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/www.thelocalvoice.net\/oxford\/wp-content\/uploads\/2024\/07\/proof2.jpg?fit=1232%2C690&ssl=1","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.thelocalvoice.net\/oxford\/wp-json\/wp\/v2\/posts\/141088","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.thelocalvoice.net\/oxford\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.thelocalvoice.net\/oxford\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.thelocalvoice.net\/oxford\/wp-json\/wp\/v2\/users\/123462"}],"replies":[{"embeddable":true,"href":"https:\/\/www.thelocalvoice.net\/oxford\/wp-json\/wp\/v2\/comments?post=141088"}],"version-history":[{"count":1,"href":"https:\/\/www.thelocalvoice.net\/oxford\/wp-json\/wp\/v2\/posts\/141088\/revisions"}],"predecessor-version":[{"id":141092,"href":"https:\/\/www.thelocalvoice.net\/oxford\/wp-json\/wp\/v2\/posts\/141088\/revisions\/141092"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.thelocalvoice.net\/oxford\/wp-json\/wp\/v2\/media\/141089"}],"wp:attachment":[{"href":"https:\/\/www.thelocalvoice.net\/oxford\/wp-json\/wp\/v2\/media?parent=141088"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.thelocalvoice.net\/oxford\/wp-json\/wp\/v2\/categories?post=141088"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.thelocalvoice.net\/oxford\/wp-json\/wp\/v2\/tags?post=141088"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}