Are we paying enough attention? At least since the nineteenth century, critics have alleged a widespread and profound failure of attentiveness—to others, to ourselves, to the world around us, to what is truly worthy of focus. Why is there such great anxiety over attention? What is at stake in understanding attention and the challenges it faces? This book investigates attention from a range of disciplinary perspectives, including philosophy, history, anthropology, art history, and comparative literature. Each chapter begins with a concrete (...) scene whose protagonists are trying—and often failing—to attend. Authors examine key moments in the history of the study of attention; pose attention as a philosophical problem; explore the links between attention, culture, and technology; and consider the significance of attention for conceptualizations of human subjectivity. Readers encounter nineteenth-century experiments in boredom, ornithologists conveying sound through field notations, wearable attention-enhancing prosthetics, students using online learning platforms, and inquiries into attention as a cognitive state and moral virtue. Amid mounting concern about digital mediation of experience, the rise of “surveillance capitalism,” and the commodification of attention, Scenes of Attention deepens the thinking that is needed to protect the freedom of attention and the forms of life that make it possible. (shrink)

In this paper, I introduce a “promises and perils” framework for understanding the “soft” impacts of emerging technology, and argue for a eudaimonic conception of well-being. This eudaimonic conception of well-being, however, presupposes that we have something like stable character traits. I therefore defend this view from the “situationist challenge” and show that instead of viewing this challenge as a threat to well-being, we can incorporate it into how we think about living well with technology. Human beings are susceptible to (...) situational influences and are often unaware of the ways that their social and technological environment influence not only their ability to do well, but even their ability to know whether they are doing well. Any theory that attempts to describe what it means for us to be doing well, then, needs to take these contextual features into account and bake them into a theory of human flourishing. By paying careful attention to these contextual factors, we can design systems that promote human flourishing. (shrink)

Generative AI enables automated, effective manipulation at scale. Despite the growing general ethical discussion around generative AI, the specific manipulation risks remain inadequately investigated. This article outlines essential inquiries encompassing conceptual, empirical, and design dimensions of manipulation, pivotal for comprehending and curbing manipulation risks. By highlighting these questions, the article underscores the necessity of an appropriate conceptualisation of manipulation to ensure the responsible development of Generative AI technologies.

Artificial intelligence (AI) and robotics are digital technologies that will have significant impact on the development of humanity in the near future. They have raised fundamental questions about what we should do with these systems, what the systems themselves should do, what risks they involve, and how we can control these. - After the Introduction to the field (§1), the main themes (§2) of this article are: Ethical issues that arise with AI systems as objects, i.e., tools made and used (...) by humans. This includes issues of privacy (§2.1) and manipulation (§2.2), opacity (§2.3) and bias (§2.4), human-robot interaction (§2.5), employment (§2.6), and the effects of autonomy (§2.7). Then AI systems as subjects, i.e., ethics for the AI systems themselves in machine ethics (§2.8) and artificial moral agency (§2.9). Finally, the problem of a possible future AI superintelligence leading to a “singularity” (§2.10). We close with a remark on the vision of AI (§3). - For each section within these themes, we provide a general explanation of the ethical issues, outline existing positions and arguments, then analyse how these play out with current technologies and finally, what policy consequences may be drawn. (shrink)

Are we being manipulated online? If so, is being manipulated by online technologies and algorithmic systems notably different from human forms of manipulation? And what is under threat exactly when people are manipulated online? This volume provides philosophical and conceptual depth to debates in digital ethics about online manipulation. The contributions explore the ramifications of our increasingly consequential interactions with online technologies such as online recommender systems, social media, user-friendly design, micro-targeting, default-settings, gamification, and real-time profiling. The authors in this (...) volume address four broad and interconnected themes: • What is the conceptual nature of online manipulation? And how, methodologically, should the concept be defined? • Does online manipulation threaten autonomy, freedom, and meaning in life, and if so, how? • What are the epistemic, affective, and political harms and risks associated with online manipulation? • What are legal and regulatory perspectives on online manipulation? The Philosophy of Online Manipulation brings these various considerations together to offer philosophically robust answers to critical questions concerning our online interactions with one another and with autonomous systems. It will be of interest to researchers and advanced students working in moral philosophy, digital ethics, philosophy of technology, and the ethics of manipulation. (shrink)

Social media platforms take on increasingly big roles in political advertising. Microtargeting techniques facilitate the display of tailored advertisements to specific subsegments of society. Scholars worry that such techniques might cause political information to be displayed to only very small subgroups of citizens. Or that targeted communication about policy could make the mandate of elected representatives more challenging to interpret. Policy information in general and pledges, in particular, have received much scientific scrutiny. Scholars have focused largely on party manifestos, but (...) policy information and pledges communicated via online advertisements offer a new arena with new dynamics. This study uses Facebook’s ad library to describe how Dutch political campaigns advertise policy information and pledges in the run-up to the 2019 European Elections. The results show that much policy information is displayed to small subsegments of society. These findings provide evidence for concerns about pledge obfuscation, voter manipulation and mandate interpretation. (shrink)

This paper introduces the design principle of legibility as means to examine the epistemic and ethical conditions of sensing technologies. Emerging sensing technologies create new possibilities regarding what to measure, as well as how to analyze, interpret, and communicate said measurements. In doing so, they create ethical challenges for designers to navigate, specifically how the interpretation and communication of complex data affect moral values such as autonomy. Contemporary sensing technologies require layers of mediation and exposition to render what they sense (...) as intelligible and constructive to the end user, which is a value-laden design act. Legibility is positioned as both an evaluative lens and a design criterion, making it complimentary to existing frameworks such as value sensitive design. To concretize the notion of legibility, and understand how it could be utilized in both evaluative and anticipatory contexts, the case study of a vest embedded with sensors and an accompanying app for patients with chronic obstructive pulmonary disease is analyzed. (shrink)

So‐called nudge policies utilize insights from behavioral science to achieve policy outcomes. Nudge policies try to improve people's decisions by changing the ways options are presented to them, rather than changing the options themselves or incentivizing or coercing people. Nudging has been met with great enthusiasm but also fierce criticism. This paper provides an overview of the debate on the ethics of nudging to date. After outlining arguments in favor of nudging, we first discuss different objections that all revolve around (...) the worry that nudging vitiates personal autonomy. We split up this worry into different dimensions of autonomy, such as freedom of choice, volitional autonomy, rational agency, and freedom as nondomination. We next discuss worries that nudging is manipulative, violates human dignity, and prevents more important structural reform. Throughout, we will present responses that proponents of nudging can muster. On the whole, we conclude that the objections fail to establish that the nudge program as a whole should be rejected. At the same time, they give us important guidance when moving towards an ethical assessment of nudges on a case‐by‐case basis. Towards the end, we provide some possible ways forward in debates around the ethics of nudging. (shrink)

Mobile health applications that promise the user to help her with some aspect of her health are very popular: for-profit apps such as MyFitnessPal, Fitbit, or Headspace have tens of millions of users each. For-profit health apps are designed and run as optimization systems. One would expect that these health apps aim to optimize the health of the user, but in reality they aim to optimize user engagement and, in effect, conversion. This is problematic, I argue, because digital health environments (...) that aim to optimize user engagement risk being manipulative. To develop this argument, I first provide a brief analysis of the underlying business models and the resulting designs of the digital environments provided by popular for-profit health apps. In a second step, I present a concept of manipulation that can help analyze digital environments such as health apps. In the last part of the article, I use my concept of manipulation to analyze the manipulative potential of for-profit health apps. Although for-profit health can certainly empower their users, the conditions for empowerment also largely overlap with the conditions for manipulation. As a result, we should be cautious when embracing the empowerment discourse surrounding health apps. An additional aim of this article is to contribute to the rapidly growing literature on digital choice architectures and the ethics of influencing behavior through such choice architectures. I take health apps to be a paradigmatic example of digital choice architectures that give rise to ethical questions, so my analysis of the manipulative potential of health apps can also inform the larger literature on digital choice architectures. (shrink)

How social media impacts the autonomy of its users is a topic of increasing focus. However, much of the literature that explores these impacts fails to engage in depth with the philosophical literature on autonomy. This has resulted in a failure to consider the full range of impacts that social media might have on autonomy. A deeper consideration of these impacts is thus needed, given the importance of both autonomy as a moral concept and social media as a feature of (...) contemporary life. By drawing on this philosophical literature, we argue that autonomy is broadly a matter of developing autonomy competencies, having authentic ends and control over key aspects of your own life, and not being manipulated, coerced, and controlled by others. We show how the autonomy of users of social media can be disrespected and harmed through the control that social media can have over its users’ data, attention, and behaviour. We conclude by discussing various recommendations to better regulate social media. (shrink)

In the past few years, the ethical ramifications of AI technologies have been at the center of intense debates. Considerable attention has been devoted to understanding how a morally responsible practice of data science can be promoted and which values have to shape it. In this context, ethics and moral responsibility have been mainly conceptualized as compliance to widely shared principles. However, several scholars have highlighted the limitations of such a principled approach. Drawing from microethics and the virtue theory tradition, (...) in this paper, we formulate a different approach to ethics in data science which is based on a different conception of “being ethical” and, ultimately, of what it means to promote a morally responsible data science. First, we develop the idea that, rather than only compliance, ethical decision-making consists in using certain moral abilities, which are cultivated by practicing and exercising them in the data science process. An aspect of virtue development that we discuss here is moral attention, which is the ability of data scientists to identify the ethical relevance of their own technical decisions in data science activities. Next, by elaborating on the capability approach, we define a technical act as ethically relevant when it impacts one or more of the basic human capabilities of data subjects. Therefore, rather than “applying ethics”, data scientists should cultivate ethics as a form of reflection on how technical choices and ethical impacts shape one another. Finally, we show how this microethical framework concretely works, by dissecting the ethical dimension of the technical procedures involved in data understanding and preparation of electronic health records. (shrink)

Many digital technologies, designed and controlled by intensive data-driven corporate platforms, have become ubiquitous for many of our daily activities. This has raised political and ethical concerns over how they might be threatening our personal autonomy. However, not much philosophical attention has been paid to the specific role that their hyper-designed (sensorimotor) interfaces play in this regard. In this paper, we aim to offer a novel framework that can ground personal autonomy on sensorimotor interaction and, from there, directly address how (...) technological design affects personal autonomy. To do this, we will draw from enactive sensorimotor approaches to cognition, focusing on the central notion of habits, understood as sensorimotor schemes that, in networked relations, give rise to sensorimotor agency. Starting from sensorimotor agency as a basis for more complex forms of personal autonomy, our approach gives us grounds to analyse our relationship with technology (in general) and to distinguish between autonomy-enhancing and autonomy-diminishing technologies. We argue that, by favouring/obstructing the enactment of certain (networks of) habits over others, technologies can directly act upon our personal autonomy, locally and globally. With this in mind, we then discuss how current digital technologies are often being designed to be autonomy-diminishing (as is the case of “dark patterns” in design), and sketch some ideas on how to build more autonomy-enhancing digital technologies. (shrink)

This paper delves into the nuances of ‘fashion’ in recommender systems and social media analytics, which shape and define an individual’s perception and self-relationality. Its aim is twofold: first, it supports a different perspective on privacy that focuses on the individual’s process of identity construction considering the social and personal aspects of ‘fashion’. Second, it underlines the limitations of computational models in capturing the diverse meaning of ‘fashion’, whereby the algorithmic prediction of user preferences is based on individual conscious and (...) unconscious associations with fashion identity. I test both of these claims in the context of current concerns over the impact of algorithmic personalisation systems on individual autonomy and privacy: creating ‘filter bubbles’, nudging the user beyond their conscious awareness, as well as the inherent bias in algorithmic decision-making. We need an understanding of privacy that sustains the inherent reduction of fashion identity to literal attributes and protects individual autonomy in shaping algorithmic approximations of the self. (shrink)

Many popular artificial intelligence (AI) ethics frameworks center the principle of autonomy as necessary in order to mitigate the harms that might result from the use of AI within society. These harms often disproportionately affect the most marginalized within society. In this paper, we argue that the principle of autonomy, as currently formalized in AI ethics, is itself flawed, as it expresses only a mainstream mainly liberal notion of autonomy as rational self-determination, derived from Western traditional philosophy. In particular, we (...) claim that the adherence to such principle, as currently formalized, does not only fail to address many ways in which people’s autonomy can be violated, but also to grasp a broader range of AI-empowered harms profoundly tied to the legacy of colonization, and which particularly affect the already marginalized and most vulnerable on a global scale. To counter such a phenomenon, we advocate for the need of a relational turn in AI ethics, starting from a relational rethinking of the AI ethics principle of autonomy that we propose by drawing on theories on relational autonomy developed both in moral philosophy and Ubuntu ethics. (shrink)

Mechanism design is a form of optimization developed in economic theory. It casts economists as institutional engineers, choosing an outcome and then arranging a set of market rules and conditions to achieve it. The toolkit from mechanism design is widely used in economics, policymaking, and now in building and managing online environments. Mechanism design has become one of the most pervasive yet inconspicuous influences on the digital mediation of social life. Its optimizing schemes structure online advertising markets and other multi-sided (...) platform businesses. Whatever normative rationales mechanism design might draw on in its economic origins, as its influence has grown and its applications have become more computational, we suggest those justifications for using mechanism design to orchestrate and optimize human interaction are losing traction. In this article, we ask what ideological work mechanism design is doing in economics, computer science, and its applications to the governance of digital platforms. Observing mechanism design in action in algorithmic environments, we argue it has become a tool for producing information domination, distributing social costs in ways that benefit designers, and controlling and coordinating participants in multi-sided platforms. (shrink)

It has become increasingly difficult for individuals to exercise meaningful control over the personal data they disclose to companies or to understand and track the ways in which that data is exchanged and used. These developments have led to an emerging consensus that existing privacy and data protection laws offer individuals insufficient protections against harms stemming from current data practices. However, an effective and ethically justified way forward remains elusive. To inform policy in this area, we propose the Ethical Data (...) Practices framework. The framework outlines six principles relevant to the collection and use of personal data—minimizing harm, fairly distributing benefits and burdens, respecting autonomy, transparency, accountability, and inclusion—and translates these principles into action-guiding practical imperatives for companies that process personal data. In addition to informing policy, the practical imperatives can be voluntarily adopted by companies to promote ethical data practices. (shrink)

Following the recent practice turn in privacy research, informational privacy is increasingly analyzed with regard to the “appropriate flow of information” within a given practice, which preserves the “contextual integrity” of that practice (Nissenbaum, 2010, p. 149; 2015). Such a practice-theoretical take on privacy emphasizes the normative structure of practices as well as its structural injustices and power asymmetries, rather than focusing on the intentions and moral considerations of individual or institutional actors. Since privacy norms are seen to be institutionalized (...) via the role obligations of the practice's participants, this approach can analyze structural and systematic privacy infringements in terms of “defective role performances and defective social relations” (Roessler & Mokrosinska, 2013, p. 780). -/- Unfortunately, it is still often somewhat unclear what this exactly means within the context of informational privacy, why these performances and relations are defective and for whom. This raises the common objection of a so-called “practice positivism” (Applbaum, 1999, p. 51), that is, the difficulty of practice–theoretical accounts to take a practice-independent standpoint, from which to normatively evaluate the existing practice norms themselves. For example, Nissenbaum herself initially argues for a “presumption in favor of the status quo” with respect to the appropriateness and flow of privacy norms within a practice (Nissenbaum, 2004, p. 127). Such a “practice conservatism” (Nissenbaum, 2010, p. 169) comes dangerously close to committing a naturalistic fallacy, if not undergirded by practice-external criteria (which is ultimately what she does). -/- Merely resorting to existing practice norms to assess what defective role performances amount to, only shifts the question from how to recognize an appropriate flow of information to the question of how to recognize those defective role performances and social relations. Against this backdrop, the central aim of this article is to shed light on this question without resorting to practice-independent first principles or far-reaching universalistic anthropological assumptions. For this, I will analyze the notion of “defective role performances and social relations” in terms of social pathologies.1 Doing so has two advantages: First of all, it can draw on already existing concepts and distinctions, which help to categorize the different levels of analysis that exist in informational privacy research and situate the notion of “defective role performances” within them (Section 1). Second, those concepts and distinctions can serve as a basis for establishing a typology of phenomena with regard to deficient practices of informational privacy (Section 4). (shrink)

My aim in this article is to set out some counter-intuitive claims about the challenges posed by artificial intelligence (AI) applications to the protection and enjoyment of human rights and to be your guide through my unorthodox ideas. While there are familiar human rights issues raised by AI and its applications, these are perhaps the easiest of the challenges because they are already recognized by the human rights regime as problems. Instead, the more pernicious challenges are those that have yet (...) to be identified or articulated, because they arise from new affordances rather than directly through AI modeled as a technology. I suggest that we need to actively explore the potential problem space on this basis. I suggest that we need to adopt models and metaphors that systematically exclude the possibility of applying the human rights regime to AI applications. This orientation will present us with the difficult, intractable problems that most urgently require responses. There are convincing ways of understanding AI that lock out the very possibility for human rights responses and this should be grounds for serious concern. I suggest that responses need to exploit both sets of insights I present in this paper: first that proactive and systematic searches of the potential problem space need to be continuously conducted to find the problems that require responses; and second that the monopoly that the human rights regime holds with regards to addressing harm and suffering needs to be broken so that we can deploy a greater range of barriers against failures to recognize and remedy AI-induced wrongs. (shrink)

Dark patterns have received significant attention in literature as interface design practices which undermine users’ autonomy by coercing, misleading or manipulating their decision making and behavior. Individual autonomy has been argued to be one of the normative lenses for the evaluation of dark patterns. However, theoretical perspectives on autonomy have not been sufficiently adapted in literature to identify the ethical concerns raised by dark patterns. The aim of this paper is to conceptualize user autonomy within the context of dark patterns. (...) In this paper, we systematically review 151 dark patterns from 16 taxonomies to understand how dark patterns threaten users’ autonomy. We demonstrate through this analysis that implications for autonomy arise along four dimensions, because autonomy itself can be understood as subsuming several distinguishable concepts. These are agency, freedom of choice, control and independence. We argue that an assessment of whether a design pattern qualifies as ‘dark’ should account for the sense in which autonomy is threatened, as individuals’ rights and expectations of autonomy vary in various contexts and depend upon the interpretation of autonomy. This paper aims to contribute to the development of the normative lens of individual autonomy for the evaluation of dark patterns, as well as for persuasive design more broadly. (shrink)

A series of recent papers raises worries about the manipulative potential of algorithmic transparency (to wit, making visible the factors that influence an algorithm’s output). But while the concern is apt and relevant, it is based on a fraught understanding of manipulation. Therefore, this paper draws attention to the ‘indifference view’ of manipulation, which explains better than the ‘vulnerability view’ why algorithmic transparency has manipulative potential. The paper also raises pertinent research questions for future studies of manipulation in the context (...) of algorithmic transparency. (shrink)

Persuasive technologies for health‐related behaviour change give rise to ethical concerns. As of yet, no study has explicitly attended to ethical concerns arising with the design and use of these technologies for vulnerable people. This is striking because these technologies are designed to help people change their attitudes or behaviours, which is particularly valuable for vulnerable people. Vulnerability is a complex concept that is both an ontological condition of our humanity and highly context‐specific. Using the Mackenzie, Rogers and Dodds’ taxonomy (...) of vulnerability, this paper identifies (a) the wrongs or harms to which a person is vulnerable, (b) the source of this vulnerability, and (c) the safeguards needed in response. Two ethical concerns with the design of persuasive technology for vulnerable people are discussed: the concerns of taking into account users' interests and their autonomy. (shrink)

In this paper, I approach the power of digital platforms by using the republican concept of domination. More specifically, I argue that the traditional, agent-relative interpretation of domination, in the case of digital domination, is best supplemented by a more radical version, on which republicans ought to give priority to structural elements. I show how radical republicanism draws attention to (1) the economic rationales and the socio-technical infrastructures that underlie and support digital platforms and to (2) the forms of influence (...) that are directed at cognitive dimensions, such as habituation and routinisation, which are particularly relevant for the power of digital platforms. These insights also imply that republicans have reason to favour a more structural response to digital platforms over more direct and individualised forms of control that fit with a ‘standard’ republican approach, such as securing exit options and requiring user consent. (shrink)

To integrate social robots in real-life contexts, it is crucial that they are accepted by the users. Acceptance is not only related to the functionality of the robot but also strongly depends on how the user experiences the interaction. Established design principles from usability and user experience research can be applied to the realm of human–robot interaction, to design robot behavior for the comfort and well-being of the user. Focusing the design on these aspects alone, however, comes with certain ethical (...) challenges, especially regarding the user’s privacy and autonomy. Based on an example scenario of human–robot interaction in elder care, this paper discusses how established design principles can be used in social robotic design. It then juxtaposes these with ethical considerations such as privacy and user autonomy. Combining user experience and ethical perspectives, we propose adjustments to the original design principles and canvass our own design recommendations for a positive and ethically acceptable social human–robot interaction design. In doing so, we show that positive user experience and ethical design may be sometimes at odds, but can be reconciled in many cases, if designers are willing to adjust and amend time-tested design principles. (shrink)

Social robots are robots that can interact socially with humans. As social robots and the artificial intelligence that powers them becomes more advanced, they will likely take on more social and work roles. This has many important ethical implications. In this paper, we focus on one of the most central of these, the impacts that social robots can have on human autonomy. We argue that, due to their physical presence and social capacities, there is a strong potential for social robots (...) to enhance human autonomy as well as several ways they can inhibit and disrespect it. We argue that social robots could improve human autonomy by helping us to achieve more valuable ends, make more authentic choices, and improve our autonomy competencies. We also argue that social robots have the potential to harm human autonomy by instead leading us to achieve fewer valuable ends ourselves, make less authentic choices, decrease our autonomy competencies, make our autonomy more vulnerable, and disrespect our autonomy. Whether the impacts of social robots on human autonomy are positive or negative overall will depend on the design, regulation, and use we make of social robots in the future. (shrink)

Recommender Systems (RecSys) have been around since the early days of the Internet, helping users navigate the vast ocean of information and the increasingly available options that have been available for us ever since. The range of tasks for which one could use a RecSys is expanding as the technical capabilities grow, with the disruption of Machine Learning representing a tipping point in this domain, as in many others. However, the increase of the technical capabilities of AI-powered RecSys did not (...) come with a thorough consideration of their ethical implications and, despite being a well-established technical domain, the potential impacts of RecSys on their users are still under-assessed. This paper aims at filling this gap in regards to one of the main impacts of RecSys: personal autonomy. We first describe how technology can affect human values and a suitable methodology to identify these effects and mitigate potential harms: Value Sensitive Design (VSD). We use VSD to carry out a conceptual investigation of personal autonomy in the context of a generic RecSys and draw on a nuanced account of procedural autonomy to focus on two components: competence and authenticity. We provide the results of our inquiry as a value hierarchy and apply it to the design of a speculative RecSys as an example. (shrink)

Feasting on a plethora of social media platforms, news aggregators, and online marketplaces, recommender systems (RSs) are spreading pervasively throughout our daily online activities. Over the years, a host of ethical issues have been associated with the diffusion of RSs and the tracking and monitoring of users’ data. Here, we focus on the impact RSs may have on personal autonomy as the most elusive among the often-cited sources of grievance and public outcry. On the grounds of a philosophically nuanced notion (...) of autonomy, we illustrate three specific reasons why RSs may limit or compromise it: the threat of manipulation and deception associated with RSs; the RSs’ power to reshape users’ personal identity; the impact of RSs on knowledge and critical thinking. In our view, however, notwithstanding these legitimate concerns, RSs may effectively help users to navigate an otherwise overwhelming landscape. Our perspective, therefore, is not to be intended as a bulwark to protect the _status quo_ but as an invitation to carefully weigh these aspects in the design of ethically oriented RSs. (shrink)

The increasing workplace use of artificially intelligent (AI) technologies has implications for the experience of meaningful human work. Meaningful work refers to the perception that one’s work has worth, significance, or a higher purpose. The development and organisational deployment of AI is accelerating, but the ways in which this will support or diminish opportunities for meaningful work and the ethical implications of these changes remain under-explored. This conceptual paper is positioned at the intersection of the meaningful work and ethical AI (...) literatures and offers a detailed assessment of the ways in which the deployment of AI can enhance or diminish employees’ experiences of meaningful work. We first outline the nature of meaningful work and draw on philosophical and business ethics accounts to establish its ethical importance. We then explore the impacts of three paths of AI deployment (replacing some tasks, ‘tending the machine’, and amplifying human skills) across five dimensions constituting a holistic account of meaningful work, and finally assess the ethical implications. In doing so we help to contextualise the meaningful work literature for the era of AI, extend the ethical AI literature into the workplace, and conclude with a range of practical implications and future research directions. (shrink)