Manipulation, Algorithm Design, and the Multiple Dimensions of Autonomy

Much discussion of the ethics of algorithms has focused on harms to autonomy—especially harms stemming from manipulation. Nonetheless, although manipulation can often be harmful, we suggest that in certain contexts it may not impair autonomy. To fully assess the impact of algorithm design on autonomy, we argue for a need to move beyond a focus on manipulation towards a multidimensional account of autonomy itself. Drawing on the autonomy literature and recent data ethics, we propose a novel account which takes autonomy to supervene on three distinct but related elements: agency, authenticity and individual control over decision-making. By distinguishing autonomy from control, the account can explain the variable effects of manipulation on user autonomy within algorithm-driven systems. In particular, it can explain why improving user control may improve autonomy in some contexts, while in other contexts—such as in some kinds of newsfeeds—certain algorithm designs that instead reduce user control may nevertheless improve autonomy. As a result, the account can accommodate the sometimes convoluted interplay between control, autonomy, manipulation, and commercial versus prosocial design goals.