Skip to content
Longterm Wiki
Back

Internet Policy Review

web

Published in Internet Policy Review, this piece is relevant to AI safety discussions around manipulation, deceptive alignment, and the ethics of persuasive AI systems; useful for policy and governance research on autonomous systems and human autonomy.

Metadata

Importance: 45/100journal articleanalysis

Summary

This article from Internet Policy Review examines the intersection of technology design, user autonomy, and digital manipulation, analyzing how algorithmic systems and persuasive technologies can undermine informed decision-making. It likely proposes frameworks for distinguishing legitimate persuasion from manipulation in digital contexts, with implications for AI system design and governance.

Key Points

  • Explores the tension between technology-driven persuasion and preservation of individual user autonomy in digital environments.
  • Distinguishes between legitimate influence and manipulative design patterns in algorithmic and AI-driven systems.
  • Analyzes policy implications for regulating persuasive technologies and protecting users from covert manipulation.
  • Relevant to AI alignment concerns around value manipulation and the ethics of AI systems that influence human behavior.
  • Contributes to governance frameworks addressing transparency and accountability in automated decision-making systems.

Cited by 1 page

PageTypeQuality
AI Preference ManipulationRisk55.0

Cached Content Preview

HTTP 200Fetched Apr 9, 202674 KB
Technology, autonomy, and manipulation | Internet Policy Review 
 
 
 

 
 
 
 
 Skip to main content
 
 
 
 

 
 

 
 
 

 

 
 
 
 
 

 
 
 
 Volume 8, Issue 2 
 
 
 
 Technology, autonomy, and manipulation 

 
 
 Daniel Susser , College of Information Sciences and Technology , Pennsylvania State University , United States 
 Beate Roessler , University of Amsterdam , Netherlands 
 Helen Nissenbaum , Information Science , Cornell Tech , New York City , United States 

 PUBLISHED ON: 30 Jun 2019 
 DOI: 10.14763/2019.2.1410 

 
 
 
 
 Abstract

 Since 2016, when the Facebook/Cambridge Analytica scandal began to emerge, public concern has grown around the threat of “online manipulation”. While these worries are familiar to privacy researchers, this paper aims to make them more salient to policymakers—first, by defining “online manipulation”, thus enabling identification of manipulative practices; and second, by drawing attention to the specific harms online manipulation threatens. We argue that online manipulation is the use of information technology to covertly influence another person’s decision-making, by targeting and exploiting their decision-making vulnerabilities. Engaging in such practices can harm individuals by diminishing their economic interests, but its deeper, more insidious harm is its challenge to individual autonomy. We explore this autonomy harm, emphasising its implications for both individuals and society, and we briefly outline some strategies for combating online manipulation and strengthening autonomy in an increasingly digital world.
 
 

 
 Citation
 & publishing
 information 
 
 Received: 
 March 25, 2019 

 Reviewed: 
 May 29, 2019 

 Published: 
 June 30, 2019

 Licence: 
 Creative Commons Attribution 3.0 Germany 

 Competing interests: 
 The authors have declared that no competing interests exist that have influenced the text.

 Keywords: 
 Online manipulation , Behavioural advertising , Privacy 

 Citation: 
 Susser, D., Roessler, B., & Nissenbaum, H. (2019). Technology, autonomy, and manipulation. Internet Policy Review , 8 (2). https://doi.org/10.14763/2019.2.1410
 
 
 
 
 This paper is part of Transnational materialities , a special issue of Internet Policy Review guest-edited by José van Dijck and Bernhard Rieder.

 
 Public concern is growing around an issue previously discussed predominantly amongst privacy and surveillance scholars—namely, the ability of data collectors to use information about individuals to manipulate them (e.g., Abramowitz, 2017; Doubek, 2017; Vayena, 2018). Knowing (or inferring) a person’s preferences, interests, and habits, their friends and acquaintances, education and employment, bodily health and financial standing, puts the knower in a position to exercise considerable influence over the known (Richards, 2013). 1 It enables them to better understand what motivates their targets, what their weaknesses and vulnerabilities are, when they are most susceptible to influence and how most effe

... (truncated, 74 KB total)
Resource ID: f020a9bd097dca11 | Stable ID: sid_Rhfi4n5zyf