{"id":1190,"date":"2021-05-17T10:00:47","date_gmt":"2021-05-17T09:00:47","guid":{"rendered":"http:\/\/blogs.cardiff.ac.uk\/openfordebate\/?p=1190"},"modified":"2021-05-14T15:16:09","modified_gmt":"2021-05-14T14:16:09","slug":"deepfakes-fake-barns-and-problems-of-safe-belief","status":"publish","type":"post","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/deepfakes-fake-barns-and-problems-of-safe-belief\/","title":{"rendered":"Deepfakes, Fake Barns, and Problems of Safe Belief"},"content":{"rendered":"

Every year, Queen Elizabeth II speaks to the UK in her annual Christmas Address. In her 2020 Address, the Queen not only spoke highly of NHS nurses, doctors, and other frontline workers during the Covid-19 pandemic, but she also expressed her desire to appear on the TV programme Strictly Come Dancing<\/em>. Anyone who has watched a Christmas Address before would have quickly noticed that this confession was out of character for the Queen. In fact, her admission was not just out of character; it was entirely fake – Channel 4 had commissioned an \u2018alternative\u2019 Christmas Address that took the form of a so-called deepfake<\/em>.<\/p>\n

A portmanteau of \u2018deep learning\u2019 and \u2018fake\u2019, deepfakes are a relatively recent innovation but their presence is growing across the internet. Moreover, developers are using increasingly sophisticated technologies to create deepfakes to the extent that the acclaimed computer scientist and deepfake pioneer, Professor Hao Li, has recently warned that we\u2019re \u2018going to get to a point where there is no way that we can actually detect them [deepfakes] anymore\u2019.[1]<\/a> In an age of growing disinformation, \u2018fake news\u2019, and populism, deepfakes clearly add to the mounting problems we face when it comes to trusting online sources.<\/p>\n

Several epistemologists have recently articulated a number of concerns about the role deepfakes could have on public discourse, undermining trust in videos, and reducing information-sharing.[2]<\/a> However, I think deepfakes go one step further; deepfakes also pose a challenge to our very claims to gain knowledge from online videos. They do this by undermining what epistemologists call the Safety Principle<\/em>. Roughly, this principle holds that a person knows something if their true belief could not too easily have turned out false, and it is often cashed out in terms of \u2018modal\u2019 or close possible worlds. To illustrate this, consider an (in)famous example first introduced by Alvin Goldman.<\/p>\n

Barnaby is travelling by train through a particular part of the countryside, where several barns stand. During the journey, Barnaby spots one of these barns and admires its design. Unbeknownst to him, the barns in the field are mostly fake barn fa\u00e7ades – the local council decided to erect numerous fake barns to attract tourists. As it turns out, though, the barn Barnaby is looking at is a real <\/em>barn and not a fake. Does Barnaby know that he is looking at a real barn? Most epistemologists say that he does not.[3]<\/a> One reason for this dissent is because his true belief that the barn is real could too easily have been false. Given how easily Barnaby could have been looking at a fake barn, it seems that in close possible worlds where Barnaby forms the same belief, it would turn out false. Hence, his belief is only true by luck. Since knowledge is taken to be incompatible with luck, Barnaby\u2019s belief is unsafe and therefore fails to count as an instance of knowledge. Of course, fake barn cases are purely fictional but what if that were to change? To see how deepfakes put us in a similarly precarious position, let\u2019s examine the technology behind them.<\/p>\n

Fundamentally, deepfakes are a sophisticated form of facial manipulation akin to more familiar technologies such as attribute manipulation<\/em> (also known as face retouching or editing) and expression swap<\/em> (often referred to as face enactment). Often, deepfakes are grouped alongside forms of identity swap<\/em> technology; indeed, this sort of technology is at work across popular face-swap apps and social media platforms such as Snapchat and Instagram, but also in in the special effects we watch in films and television. Nevertheless, what makes deepfakes stand out from these technologies is their reliance on powerful machine-learning technology, and the \u2018deep\u2019 in their name points towards the advanced \u2018neural networks\u2019 that generate the videos.<\/p>\n

Most deepfakes are produced by so-called \u2018Generative Adversarial Networks (GANs), which consist of two AI algorithms called the \u2018generator\u2019 and the \u2018discriminator\u2019. After being fed the same dataset of audio, video footage, and images, the adversarial component kicks in and the two algorithms \u2018compete\u2019 against each other \u2013 the generator creates new samples that are good enough to trick the discriminator, while the discriminator works to determine whether these new videos or samples are real. The result is an authentic-looking video capable of mimicking the voice, mannerisms, facial expressions, and speech inflections of one person before superimposing them onto another.<\/p>\n

Although initially unsettling, one might argue that deepfakes seem distinct from fake barns because we can rely on our ears to pick up audio discrepancies or recognise unfamiliar voices coming from familiar faces. After all, the deepfake of Queen Elizabeth II was voiced by a professional actress. Unfortunately, this response is quite literally dwindling before our eyes. In 2017, Adobe and Princeton University created \u2018VoCo\u2019 technology, which allows video creators to alter the content of an audio recording by typing words into a transcript. By analysing voice samples of a target speaker, VoCo algorithms are able to synthesise what the speaker\u2019s voice would sound like were they to say the things written into the transcript. In the hands of deepfake purveyors, this creates two more problems for us.<\/p>\n

First, VoCo technology now means that deepfakes no longer need to rely on actors to provide compelling voices. If a deepfake generates the exact voice of the target speaker, our initial response is to take this at face value as we might with regularly testimony and accept what we hear. So long as there no defeating reasons to dismiss the testimony, VoCo technology brings our ears closer to redundancy in the search for deepfakes. Second, creators can now dispense with audio clips that might have initially given a deepfake away because they no longer need to correctly map different mouth movements onto the target. In turn, this removes any ability we might have previously had in picking up facial discrepancies in deepfakes.<\/p>\n

Where does this leave us? A worrying conclusion we can draw from this is that deepfakes will eventually become indistinguishable from other online videos we watch. When or if this happens, our ability to discern true videos from false ones will become much harder, much like Barnaby\u2019s ability to tell real barns from fake barns. There\u2019s an important upshot to this to this. In addition to accumulating more false beliefs from videos than we currently do, sophisticated deepfakes could also place us in a situation like Barnaby\u2019s: just as the fake barn fa\u00e7ades jeopardise the safety of his true belief, the spread of deepfakes means that, despite forming a true belief about an event or person via an online video, all too easily could we have formed the same belief across close possible worlds, and it be a deepfake. Put simply, deepfakes are increasingly rendering our true beliefs from videos unsafe, and this leaves us with the prospect that we might soon lose any claims to knowledge about what we watch online.<\/p>\n

So, the next time you\u2019re surfing the internet and stumble across a video you take to be true, think: do I know<\/em> what I\u2019m watching is true?<\/p>\n

 <\/p>\n

[1]<\/a> K. Stankiewicz, \u2018\u2018Perfectly Real\u2019 Deepfakes Will Arrive In 6 Months to a Year, Technology Pioneer Hao Li Says\u2019, CNBC, 2019.<\/p>\n

[2]<\/a> See, for example, R. Rini \u2018Deepfakes and the Epistemic Backdrop\u2019, Philosophers\u2019 Imprint<\/em>, 20:24, 2020, and D. Fallis \u2018The Epistemic Threat of Deepfakes\u2019, Philosophy and Technology<\/em>, 2020.<\/p>\n

[3]<\/a> Despite what epistemologists say, a number of studies show that non-specialists are more inclined to grant people like Barnaby with knowledge about the barn. See, for example, D. Cola\u00e7o et al. \u2018Epistemic Intuitions In Fake-Barn Thought Experiments\u2019, Episteme<\/em>, 11:2, 2014. For the original fake barn case, see A. Goldman, \u2018Discrimination and perceptual knowledge’, Journal of Philosophy, 73, 1976, pp. 771-791.<\/p>\n

<\/div>\n
\n
\n
Picture from Unsplash by Z yu\/Yuzhang<\/div>\n<\/div>\n<\/div>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"Every year, Queen Elizabeth II speaks to the UK in her annual Christmas Address. In her 2020 Address, the Queen not only spoke highly of NHS nurses, doctors, and other […]","protected":false},"author":1319,"featured_media":1192,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"Taylor Matthews 'Deepfakes, Fake Barns, and Problems of Safe Belief'. Deepfakes make beliefs unsafe - on Open for Debate","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[19],"tags":[292,36,65],"custom_author":[291],"class_list":["post-1190","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-open-for-debate","tag-deepfakes","tag-epistemology","tag-fake-news","custom_author-matthews-taylor"],"jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p8KPlM-jc","jetpack-related-posts":[{"id":1594,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/deepfakes-and-the-history-of-faked-photography\/","url_meta":{"origin":1190,"position":0},"title":"Deepfakes and the History of Faked Photography","author":"Alessandra Tanesini","date":"January 9, 2023","format":false,"excerpt":"Looking back at the panicked discussion of deepfakes in 2018, actually existing deepfake technology has been something of a disappointment. The r\/deepfakeSFW subreddit is full of hobbyists face swapping cult films. The most common genre of deepfake is the face-swapped pornographic video. These videos clearly portray a message about the\u2026","rel":"","context":"In "Open for Debate"","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2023\/01\/Image_appert_ernest_charles_photomontage_montrant_une_representation_de_la_prison_des_chantiers_a_versaill_1602819_cropped.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2023\/01\/Image_appert_ernest_charles_photomontage_montrant_une_representation_de_la_prison_des_chantiers_a_versaill_1602819_cropped.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2023\/01\/Image_appert_ernest_charles_photomontage_montrant_une_representation_de_la_prison_des_chantiers_a_versaill_1602819_cropped.jpg?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2023\/01\/Image_appert_ernest_charles_photomontage_montrant_une_representation_de_la_prison_des_chantiers_a_versaill_1602819_cropped.jpg?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2023\/01\/Image_appert_ernest_charles_photomontage_montrant_une_representation_de_la_prison_des_chantiers_a_versaill_1602819_cropped.jpg?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2023\/01\/Image_appert_ernest_charles_photomontage_montrant_une_representation_de_la_prison_des_chantiers_a_versaill_1602819_cropped.jpg?resize=1400%2C800&ssl=1 4x"},"classes":[]},{"id":456,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/ruminating-on-fake-news-online-education-and-intellectual-humility\/","url_meta":{"origin":1190,"position":1},"title":"Ruminating on Fake News, Online Education, and Intellectual Humility","author":"Alessandra Tanesini","date":"June 18, 2018","format":false,"excerpt":"From 2015 until last month (May, 2018), I was involved with a project at the University of Edinburgh, which aimed to produce a massive open online course (or MOOC) on intellectual humility. One of the central goals of the project was to give various academics who are producing extremely valuable\u2026","rel":"","context":"In "Open for Debate"","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/06\/park_white_black_water_rain_tom_oregon_canon-296566.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/06\/park_white_black_water_rain_tom_oregon_canon-296566.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/06\/park_white_black_water_rain_tom_oregon_canon-296566.jpg?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/06\/park_white_black_water_rain_tom_oregon_canon-296566.jpg?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/06\/park_white_black_water_rain_tom_oregon_canon-296566.jpg?resize=1050%2C600&ssl=1 3x"},"classes":[]},{"id":357,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/can-exposure-to-fake-news-damage-our-intellectual-character\/","url_meta":{"origin":1190,"position":2},"title":"Can Exposure to \u201cFake News\u201d Damage Our Intellectual Character?","author":"Alessandra Tanesini","date":"January 15, 2018","format":false,"excerpt":"There is no denying the current widespread interest in the phenomenon of \u201cfake news\u201d. Reflection on the quality of recent political debates has fuelled concerns about the use of inaccurate and misleading stories and statistics. In response, politicians have begun proposing legislation to combat the spread of misleading information, while\u2026","rel":"","context":"In "Open for Debate"","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/01\/hoax-2097365_1280.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/01\/hoax-2097365_1280.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/01\/hoax-2097365_1280.jpg?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/01\/hoax-2097365_1280.jpg?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/01\/hoax-2097365_1280.jpg?resize=1050%2C600&ssl=1 3x"},"classes":[]},{"id":531,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/bullshit-you-can-believe-in\/","url_meta":{"origin":1190,"position":3},"title":"Bullshit You Can Believe In","author":"Alessandra Tanesini","date":"November 5, 2018","format":false,"excerpt":"One of the most salient features of our culture is that there is so much bullshit. So begins Harry Frankfurt\u2019s rightly celebrated essay On Bullshit, raising the important questions of precisely what bullshit is and why there is so much of it around. That sentence is particularly poignant now, three\u2026","rel":"","context":"In "Open for Debate"","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/11\/140521-F-LR006-054.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/11\/140521-F-LR006-054.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/11\/140521-F-LR006-054.jpg?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2018\/11\/140521-F-LR006-054.jpg?resize=700%2C400&ssl=1 2x"},"classes":[]},{"id":207,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/the-vices-of-truthlessness\/","url_meta":{"origin":1190,"position":4},"title":"The Vices of Truthlessness","author":"Charlie Crerar","date":"August 28, 2017","format":false,"excerpt":"From \u2018post-truth\u2019, to \u2018fake news\u2019, to \u2018alternative facts\u2019, truthlessness is everywhere at the moment. These phenomena present us with a huge array of questions. How do we separate fact from fiction? How can we tell which sources of information are credible? Is there even such a thing as objective truth?\u2026","rel":"","context":"In "In the News"","block_context":{"text":"In the News","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/in-the-news\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2017\/08\/truth-2069846_960_720.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2017\/08\/truth-2069846_960_720.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2017\/08\/truth-2069846_960_720.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2017\/08\/truth-2069846_960_720.png?resize=700%2C400&ssl=1 2x"},"classes":[]},{"id":1971,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/rethinking-manipulation-the-indifference-view-of-manipulation\/","url_meta":{"origin":1190,"position":5},"title":"Rethinking Manipulation: The Indifference View of Manipulation","author":"Alessandra Tanesini","date":"April 15, 2024","format":false,"excerpt":"In the series' Unpacking Manipulation in the Digital Age,' the previous five posts covered the rise of problematic forms of digital influence (Posts 1, 2, and 3), the need to demarcate different types of ethically problematic influence (post 4), and the lacuna in understanding manipulation (post 5), in particular. In\u2026","rel":"","context":"In "Open for Debate"","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/fake-news-3801637_1280.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/fake-news-3801637_1280.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/fake-news-3801637_1280.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/fake-news-3801637_1280.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/fake-news-3801637_1280.png?resize=1050%2C600&ssl=1 3x"},"classes":[]}],"meta_box":[],"jetpack_featured_media_url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2021\/05\/Blog-photo-scaled.jpg","_links":{"self":[{"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/posts\/1190","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/users\/1319"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/comments?post=1190"}],"version-history":[{"count":2,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/posts\/1190\/revisions"}],"predecessor-version":[{"id":1193,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/posts\/1190\/revisions\/1193"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/media\/1192"}],"wp:attachment":[{"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/media?parent=1190"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/categories?post=1190"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/tags?post=1190"},{"taxonomy":"custom_author","embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/custom_author?post=1190"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}