{"id":1922,"date":"2024-03-18T10:05:41","date_gmt":"2024-03-18T10:05:41","guid":{"rendered":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/?p=1922"},"modified":"2024-03-15T15:03:52","modified_gmt":"2024-03-15T15:03:52","slug":"the-dark-side-of-digital-influence","status":"publish","type":"post","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/the-dark-side-of-digital-influence\/","title":{"rendered":"The Dark Side of Digital Influence"},"content":{"rendered":"<p>In the previous <a href=\"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/unpacking-manipulation-for-the-digital-age\/\" target=\"_blank\" rel=\"noopener\">post<\/a>, I outlined three reasons for paying closer attention to social influence in the digital landscape: the proliferation of social influence, the informational empowerment of social influence, and the fact that AI increasingly mediates social influence.<!--more--><\/p>\n<p>In this post, I will argue that this not only perpetuates the threat posed by existing bad actors but also significantly raises worries about problematic influence generated unwittingly and without bad intentions by individuals, groups, and technical systems. The dark side of digital influence is its corrupting effect, even on well-meaning actors.<\/p>\n<h2>Emergent Issues of Digital Social Influence<\/h2>\n<p>The three factors that individually account for the growing influence of manipulative influence (discussed in the previous post, Link) are increasingly combined, which leads to new concerns due to addition and emergence (Pham et al. 2022).<\/p>\n<p>For example, efforts are underway to combine generative AI that takes into account user data to provide more effective Influence (AI-mediated and informationally empowered influence), to use generative AI in combination with an optimisation algorithm akin to a recommender system to offer more impactful Influence (AI-mediated predictive influence), and, of course, to make these powerful tools available to more users (the proliferation of AI-mediated, informationally empowered influence).<\/p>\n<p>The combination of factors \u2013 widespread access, informational empowerment, and AI mediation \u2013 gives bad actors more power, allowing them to influence more people more efficiently.<\/p>\n<p>However, the concern extends beyond nefarious intentions. I find it extremely important to emphasise that AI-mediated automation of social influence implies a new perspective on understanding and evaluating social influence. Fraudsters and criminals who use AI for their nefarious and manipulative schemes are problematic but, in a sense, nothing new. What is new is that the value of social influence is increasingly premised on the values embedded in the automatic curation of our digital influence landscape (Klenk 2021).<\/p>\n<p>The peculiar problem with the combination of proliferation, informational empowerment, and AI mediation of social influence (in curation or generation) is that it raises worries about well-meaning influencers going astray and entering manipulative territory unwittingly and unintentionally (Klenk 2024). If that is right, then we are only beginning to fully grasp the scope of the digital manipulation problem and the related regulatory challenge.<\/p>\n<p>So, we need to ask about the values embedded in the automatic generation and mediation of content, quite independently of human intentions. We need to look more closely at those actors who take to digital influence without nefarious goals but whose influence may yet take ominous forms by virtue of AI mediation (Klenk 2024).<\/p>\n<h2>Redefining Social Influence<\/h2>\n<p>The critical point is that social influence is increasingly becoming a <em>design choice. <\/em>Or, more precisely, <em>what type<\/em> of social influence we encounter is increasingly due to design choices we make at the technical and regulatory levels.<\/p>\n<p>As social influence increasingly becomes a design choice, it becomes crucial to draw boundaries and consider what types of influence we should value as a society. In &#8216;The Age of AI,&#8217; the late Kissinger and colleagues vividly point out the scope of the challenge (Kissinger et al. 2022). How we evaluate, regulate, and shape social influence will have an almost unfathomable impact on our lives: the types of web designs that billions of people encounter online, the choices they are offered, and which ones they are denied, how they are offered these choices, the information they receive, and the principles by which generative AI turns their prompts into means of influence. This is not only a problem for the rich world. As the Economist recently put it, (generative) AI holds a &#8220;tantalising promise for the developing world.&#8221; Technical ecosystems are already in place to support the roll-out of generative AI applications to billions of people (The Economist 2024).<\/p>\n<p>Social influence is thus affecting us all. In the digital age, many social influences are no longer due to our close family members, friends, and colleagues but mediated and orchestrated in and through a digital landscape. In one telling, if we count the time that people spend on social media, where &#8216;intelligent software agents&#8217; like YouTube&#8217;s recommender system influence what they see, those &#8216;intelligent software agents&#8217; are already influencing us for more than two hours daily; that is more influence than we enjoy from our spouses, kids, and close friends (Klenk 2019).<\/p>\n<p>The fact that social influence becomes a design choice draws attention to the fact that we can take matters into our own hands and work toward <em>good <\/em>influence, which is a cause for celebration. It also motivates me in my academic work: to outline the contours of <em>good influence<\/em> from a philosophical perspective and eventually to derive appropriate design guidelines for technology and regulation.<\/p>\n<p>However, if we don&#8217;t pay close attention, soon enough, the design of social influence will be a cause for great concern. As decades of research in the philosophy of technology illustrate, societal ills and bad effects of technology rarely stem from ill-intention, but rather from neglect and ignorance about the implications of one&#8217;s design.<\/p>\n<p>The crucial question is what type of social influence we should strive for and develop in our digital life-world. It&#8217;s imperative to consider the types of social influence we should want in our society and define the requirements of good influence.<\/p>\n<h2>Conclusion and Outlook<\/h2>\n<p>In this post, I hope to have illustrated the need for acute attention we must now pay to unintended forms of problematic influence engendered by the digital influence landscape.<\/p>\n<p>In the next blog post, I will explore why manipulation as a form of social influence is particularly important in our evolving digital landscape. Stay tuned for insights on navigating the complex world of digital influence.<\/p>\n<h2>References<\/h2>\n<p>The Economist (2024, January 25). AI holds tantalising promise for the emerging world. https:\/\/www.economist.com\/leaders\/2024\/01\/25\/the-tantalising-promise-of-ai-for-the-emerging-world. Accessed 12 February 2024.<\/p>\n<p>Kissinger, H., Schmidt, E., &amp;\u00a0Huttenlocher, D. P. (2022). <em>The age od AI and our human future<\/em>. London: John Murray.<\/p>\n<p>Klenk, M. (2019). Are we being manipulated by artificially intelligent software agents? &#8211; 3 Quarks Daily. https:\/\/3quarksdaily.com\/3quarksdaily\/2019\/09\/are-we-being-manipulated-by-artificially-intelligent-software-agents.html. Accessed 25 January 2024.<\/p>\n<p>Klenk, M. (2021). How Do Technological Artefacts Embody Moral Values? <em>Philosophy &amp; Technology, 34<\/em>, 525\u2013544. doi:10.1007\/s13347-020-00401-y.<\/p>\n<p>Klenk, M. (2024). Ethics of generative AI and manipulation: a design-oriented research agenda. <em>Ethics and Information Technology, 26<\/em>, 1\u201315. doi:10.1007\/s10676-024-09745-x.<\/p>\n<p>Pham, A., Rubel, A., &amp;\u00a0Castro, C. (2022). Social Media, Emergent Manipulation, and Political Legitimacy. In M. Klenk &amp; F. Jongepier (Eds.), <em>The Philosophy of Online Manipulation<\/em>. New York, NY: Routledge.<\/p>\n<p><a href=\"https:\/\/pixabay.com\/illustrations\/man-heart-sketch-drawing-6533390\/\" target=\"_blank\" rel=\"noopener\">Image<\/a> by <a href=\"https:\/\/pixabay.com\/users\/vika_glitter-6314823\/?utm_source=link-attribution&amp;utm_medium=referral&amp;utm_campaign=image&amp;utm_content=6533390\" target=\"_blank\" rel=\"noopener\">Victoria <\/a>from\u00a0 <a href=\"https:\/\/pixabay.com\/\/?utm_source=link-attribution&amp;utm_medium=referral&amp;utm_campaign=image&amp;utm_content=6533390\" target=\"_blank\" rel=\"noopener\">Pixabay\u00a0<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"In the previous post, I outlined three reasons for paying closer attention to social influence in the digital landscape: the proliferation of social influence, the informational empowerment of social influence, [&hellip;]","protected":false},"author":1319,"featured_media":1928,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"Klenk 'The Dark Side of Digital Influence' on Open for Debate . Second post in the series","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[19],"tags":[379,430,44],"custom_author":[443],"class_list":["post-1922","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-open-for-debate","tag-ai","tag-manipulation","tag-social-media","custom_author-klenk-michael"],"jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p8KPlM-v0","jetpack-related-posts":[{"id":1920,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/unpacking-manipulation-for-the-digital-age\/","url_meta":{"origin":1922,"position":0},"title":"Unpacking Manipulation for the Digital Age","author":"Alessandra Tanesini","date":"March 18, 2024","format":false,"excerpt":"Public debate is shaped partly by human social influence, and we routinely distinguish different types of social influence, such as persuasion, coercion, and manipulation. While persuasion and coercion are reasonably well understood, philosophers have only recently begun to study the nature and ethics of manipulation. More attention to manipulation is\u2026","rel":"","context":"In &quot;Open for Debate&quot;","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/03\/man-220975_1280.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/03\/man-220975_1280.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/03\/man-220975_1280.jpg?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/03\/man-220975_1280.jpg?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/03\/man-220975_1280.jpg?resize=1050%2C600&ssl=1 3x"},"classes":[]},{"id":1950,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/types-of-social-influence-and-manipulation-without-intention\/","url_meta":{"origin":1922,"position":1},"title":"Types of Social Influence and Manipulation Without Intention","author":"Alessandra Tanesini","date":"April 1, 2024","format":false,"excerpt":"In the previous two posts of this series on online manipulation, I outlined three developments that warrant closer attention to digital influence (here), and argued that a peculiar result is the threat of unwitting problematic forms of influence due to the corrupting effect of the digital influence landscape (here). In\u2026","rel":"","context":"In &quot;Open for Debate&quot;","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/cranium-2099119_1280.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/cranium-2099119_1280.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/cranium-2099119_1280.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/cranium-2099119_1280.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/cranium-2099119_1280.png?resize=1050%2C600&ssl=1 3x"},"classes":[]},{"id":1944,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/the-rise-of-digital-manipulation\/","url_meta":{"origin":1922,"position":2},"title":"The Rise of Digital Manipulation","author":"Alessandra Tanesini","date":"March 30, 2024","format":false,"excerpt":"In the previous post of this series on 'Unpacking Manipulation in the Digital Age,' I argued that problematic forms of influence can be unintentional but not accidental and that the digital influence landscape encourages such forms of influence. In this post, I will illustrate this claim by giving examples of\u2026","rel":"","context":"In &quot;Open for Debate&quot;","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/03\/background-1587534_1280.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/03\/background-1587534_1280.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/03\/background-1587534_1280.jpg?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/03\/background-1587534_1280.jpg?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/03\/background-1587534_1280.jpg?resize=1050%2C600&ssl=1 3x"},"classes":[]},{"id":1971,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/rethinking-manipulation-the-indifference-view-of-manipulation\/","url_meta":{"origin":1922,"position":3},"title":"Rethinking Manipulation:  The Indifference View of Manipulation","author":"Alessandra Tanesini","date":"April 15, 2024","format":false,"excerpt":"In the series' Unpacking Manipulation in the Digital Age,' the previous five posts covered the rise of problematic forms of digital influence (Posts 1, 2, and 3), the need to demarcate different types of ethically problematic influence (post 4), and the lacuna in understanding manipulation (post 5), in particular. In\u2026","rel":"","context":"In &quot;Open for Debate&quot;","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/fake-news-3801637_1280.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/fake-news-3801637_1280.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/fake-news-3801637_1280.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/fake-news-3801637_1280.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/fake-news-3801637_1280.png?resize=1050%2C600&ssl=1 3x"},"classes":[]},{"id":1967,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/unravelling-the-complexity-of-manipulation-theories\/","url_meta":{"origin":1922,"position":4},"title":"Unravelling the Complexity of Manipulation Theories","author":"Alessandra Tanesini","date":"April 15, 2024","format":false,"excerpt":"In the previous four posts of this series on 'Unpacking Manipulation in the Digital Age'(Post 1; Post 2; Post 3; Post 4), I argued that more attention to different types of social influence is needed and that digital influence often seems to fall into the grey area between persuasion and\u2026","rel":"","context":"In &quot;Open for Debate&quot;","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/Klenk-post-5-hacking-2903156_1280.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/Klenk-post-5-hacking-2903156_1280.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/Klenk-post-5-hacking-2903156_1280.jpg?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/Klenk-post-5-hacking-2903156_1280.jpg?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/04\/Klenk-post-5-hacking-2903156_1280.jpg?resize=1050%2C600&ssl=1 3x"},"classes":[]},{"id":852,"url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/political-debate-in-the-digital-age\/","url_meta":{"origin":1922,"position":5},"title":"Political Debate in the Digital Age","author":"Alessandra Tanesini","date":"February 10, 2020","format":false,"excerpt":"In an ideal democratic world, all citizens are invited to debate political necessities and possibilities to the best of their knowledge and to forge their country\u2019s future in this way. In an ideal democratic world, political debate is, in other words, both inclusive and evidence-led. In a dystopian world, by\u2026","rel":"","context":"In &quot;Open for Debate&quot;","block_context":{"text":"Open for Debate","link":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/category\/open-for-debate\/"},"img":{"alt_text":"Social media links","src":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2020\/02\/nordwood-themes-cNXqmO0Z24U-unsplash-scaled.jpg?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2020\/02\/nordwood-themes-cNXqmO0Z24U-unsplash-scaled.jpg?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2020\/02\/nordwood-themes-cNXqmO0Z24U-unsplash-scaled.jpg?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2020\/02\/nordwood-themes-cNXqmO0Z24U-unsplash-scaled.jpg?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2020\/02\/nordwood-themes-cNXqmO0Z24U-unsplash-scaled.jpg?resize=1050%2C600&ssl=1 3x, https:\/\/i0.wp.com\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2020\/02\/nordwood-themes-cNXqmO0Z24U-unsplash-scaled.jpg?resize=1400%2C800&ssl=1 4x"},"classes":[]}],"meta_box":[],"jetpack_featured_media_url":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-content\/uploads\/sites\/533\/2024\/03\/man-6533390_1280.png","_links":{"self":[{"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/posts\/1922","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/users\/1319"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/comments?post=1922"}],"version-history":[{"count":8,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/posts\/1922\/revisions"}],"predecessor-version":[{"id":1935,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/posts\/1922\/revisions\/1935"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/media\/1928"}],"wp:attachment":[{"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/media?parent=1922"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/categories?post=1922"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/tags?post=1922"},{"taxonomy":"custom_author","embeddable":true,"href":"https:\/\/blogs.cardiff.ac.uk\/openfordebate\/wp-json\/wp\/v2\/custom_author?post=1922"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}