We offer an ethical assessment of the market for data used to generate what are sometimes called “consumer scores” (i.e., numerical expressions that are used to describe or predict people’s dispositions and behavior), and we argue that the assessment has ethical implications on how the market for consumer scoring data should be regulated. To conduct the assessment, we employ two heuristics for evaluating markets. One is the “harm” criterion, which relates to whether the market produces serious harms, either for participants (...) in the market, for third parties, or for society as a whole. The other is the “agency” criterion, which relates to whether participants understand the nature and significance of the exchanges they are making, if they can be guaranteed fair representation, or if there is differential need for the market’s good. We argue that consumer scoring data should be subject to the same sort of regulation as the older FICO credit scores. Although the movement in the 1990s that was aimed at regulating the FICO scores was not aimed at restraining a market per se, we argue that the reforms were underwritten by concerns about the same sorts of problems as those outlined by our heuristics. Therefore, consumer data should be subject to the same sort of regulation. (shrink)

A growing amount of media is paid for by its consumers through their very consumption of it. Typically, this new media is web-based and paid for by advertising. It includes the services offered by Facebook, Instagram, Snapchat, and YouTube. We offer an ethical assessment of the attention economy, the market where attention is exchanged for new media. We argue that the assessment has ethical implications for how the attention economy should be regulated. To conduct the assessment, we employ two heuristics (...) for evaluating markets. One is the “harm” criterion, which relates to whether the market tends to engender extremely harmful outcomes for individuals or society as a whole. The other is the “agency” criterion, which relates not to the outcomes of the market, but rather, to whether it somehow reflects or has its source in weakened agency. We argue that the attention economy animates concerns with respect to both criteria and that new media should be subject to the same sort of regulation as other harmful, addictive products. (shrink)

A number of findings in the field of machine learning have given rise to questions about what it means for automated scoring- or decisionmaking systems to be fair. One center of gravity in this discussion is whether such systems ought to satisfy classification parity (which requires parity in accuracy across groups, defined by protected attributes) or calibration (which requires similar predictions to have similar meanings across groups, defined by protected attributes). Central to this discussion are impossibility results, owed to Kleinberg (...) et al. (2016), Chouldechova (2017), and Corbett-Davies et al. (2017), which show that classification parity and calibration are often incompatible. This paper aims to argue that classification parity, calibration, and a newer, interesting measure called counterfactual fairness are unsatisfactory measures of fairness, offer a general diagnosis of the failure of these measures, and sketch an alternative approach to understanding fairness in machine learning. (shrink)

Prediction-based decisions, which are often made by utilizing the tools of machine learning, influence nearly all facets of modern life. Ethical concerns about this widespread practice have given rise to the field of fair machine learning and a number of fairness measures, mathematically precise definitions of fairness that purport to determine whether a given prediction-based decision system is fair. Following Reuben Binns (2017), we take ‘fairness’ in this context to be a placeholder for a variety of normative egalitarian considerations. We (...) explore a few fairness measures to suss out their egalitarian roots and evaluate them, both as formalizations of egalitarian ideas and as assertions of what fairness demands of predictive systems. We pay special attention to a recent and popular fairness measure, counterfactual fairness, which holds that a prediction about an individual is fair if it is the same in the actual world and any counterfactual world where the individual belongs to a different demographic group (cf. Kusner et al. (2018)). (shrink)

Data-driven, decision-making technologies used in the justice system to inform decisions about bail, parole, and prison sentencing are biased against historically marginalized groups (Angwin, Larson, Mattu, & Kirchner 2016). But these technologies’ judgments—which reproduce patterns of wrongful discrimination embedded in the historical datasets that they are trained on—are well-evidenced. This presents a puzzle: how can we account for the wrong these judgments engender without also indicting morally permissible statistical inferences about persons? I motivate this puzzle and attempt an answer.

Holm (2022) argues that a class of algorithmic fairness measures, that he refers to as the ‘performance parity criteria’, can be understood as applications of John Broome’s Fairness Principle. We argue that the performance parity criteria cannot be read this way. This is because in the relevant context, the Fairness Principle requires the equalization of actual individuals’ individual-level chances of obtaining some good (such as an accurate prediction from a predictive system), but the performance parity criteria do not guarantee any (...) such thing: the measures merely ensure that certain population-level ratios hold. (shrink)

Impermissivists hold that an agent with a given body of evidence has at most one rationally permitted attitude that she should adopt towards any particular proposition. Permissivists deny this, often motivating permissivism by describing scenarios that pump our intuitions that the agent could reasonably take one of several attitudes toward some proposition. We criticize the following impermissivist response: while it seems like any of that range of attitudes is permissible, what is actually required is the single broad attitude that encompasses (...) all of these single attitudes. While this might seem like an easy way to win over permissivists, we argue that this impermissivist response leads to an indefensible epistemology; permissive intuitions are not so easily co-opted. (shrink)

The harms associated with wireless mobile devices (e.g. smartphones) are well documented. They have been linked to anxiety, depression, diminished attention span, sleep disturbance, and decreased relationship satisfaction. Perhaps what is most worrying from a moral perspective, however, is the effect these devices can have on our autonomy. In this article, we argue that there is an obligation to foster and safeguard autonomy in ourselves, and we suggest that wireless mobile devices pose a serious threat to our capacity to fulfill (...) this obligation. We defend the existence of an imperfect duty to be a ‘digital minimalist’. That is, we have a moral obligation to be intentional about how and to what extent we use these devices. The empirical findings already justify prudential reasons in favor of digital minimalism, but the moral duty is distinct from and independent of prudential considerations. (shrink)

New media (highly interactive digital technology for creating, sharing, and consuming information) affords users a great deal of control over their informational diets. As a result, many users of new media unwittingly encapsulate themselves in epistemic bubbles (epistemic structures, such as highly personalized news feeds, that leave relevant sources of information out (Nguyen forthcoming)). Epistemically paternalistic alterations to new media technologies could be made to pop at least some epistemic bubbles. We examine one such alteration that Facebook has made in (...) an effort to fight fake news and conclude that it is morally permissible. We further argue that many epistemically paternalistic policies can (and should) be a perennial part of the internet information environment. (shrink)

This paper examines the practice of using predictive systems to lengthen the prison sentences of convicted persons when the systems forecast a higher likelihood of re-offense or re-arrest. There has been much critical discussion of technologies used for sentencing, including questions of bias and opacity. However, there hasn’t been a discussion of whether this use of predictive systems makes sense in the first place. We argue that it does not by showing that there is no plausible theory of punishment that (...) supports it. (shrink)

Psychometrics firms such as Cambridge Analytica (CA) and troll factories such as the Internet Research Agency (IRA) have had a significant effect on democratic politics, through narrow targeting of political advertising (CA) and concerted disinformation campaigns on social media (IRA) (U.S. Department of Justice 2019; Select Committee on Intelligence, United States Senate 2019; DiResta et al. 2019). It is natural to think that such activities manipulate individuals and, hence, are wrong. Yet, as some recent cases illustrate, the moral concerns with (...) these activities cannot be reduced simply to the effects they have on individuals. Rather, we will argue, the wrongness of these activities relates to the threats they present to the legitimacy of political orders. This occurs primarily through a mechanism we call “emergent manipulation,” rather than through the sort of manipulation that involves specific individuals. (shrink)

The attention economy — the market where consumers’ attention is exchanged for goods and services — poses a variety of threats to individuals’ autonomy, which, at minimum, involves the ability to set and pursue ends for oneself. It has been argued that the threat wireless mobile devices pose to autonomy gives rise to a duty to oneself to be a digital minimalist, one whose interactions with digital technologies are intentional such that they do not conflict with their ends. In this (...) paper, we argue that there is a corresponding duty to others to be an attention ecologist, one who promotes digital minimalism in others. Although the moral reasons for being an attention ecologist are similar to those that motivate the duty to oneself, the arguments diverge in important ways. We explore the application of this duty in various domains where we have special obligations to promote autonomy in virtue of the different roles we play in the lives of others, such as parents and teachers. We also discuss the consequences of our arguments for employers, software developers, and policy makers. (shrink)

Algorithms influence every facet of modern life: criminal justice, education, housing, entertainment, elections, social media, news feeds, work… the list goes on. Delegating important decisions to machines, however, gives rise to deep moral concerns about responsibility, transparency, freedom, fairness, and democracy. Algorithms and Autonomy connects these concerns to the core human value of autonomy in the contexts of algorithmic teacher evaluation, risk assessment in criminal sentencing, predictive policing, background checks, news feeds, ride-sharing platforms, social media, and election interference. Using these (...) case studies, the authors provide a better understanding of machine fairness and algorithmic transparency. They explain why interventions in algorithmic systems are necessary to ensure that algorithms are not used to control citizens' participation in politics and undercut democracy. This title is also available as Open Access on Cambridge Core. (shrink)

In this chapter, we turn our attention to the effects of the attention economy on our ability to act autonomously as a group. We begin by clarifying which sorts of groups we are concerned with, which are structured groups (groups sufficiently organized that it makes sense to attribute agency to the group itself). Drawing on recent work by Purves and Davis (2022), we describe the essential roles of trust (i.e., depending on groups to fulfill their commitments) and trustworthiness (i.e., the (...) property of a group that makes trusting them fitting) in autonomous group action, with particular emphasis on democratic institutions (which we view as group agents) and democratic legitimacy (which depends on trust and trustworthiness). We then explain how engagement maximization promotes polarization, which is detrimental to trust and trustworthiness and, in turn, democratic legitimacy and democratic institutions. We close by considering what groups might do to protect themselves from the threat posed to them by the attention economy. (shrink)

When agents insert technological systems into their decision-making processes, they can obscure moral responsibility for the results. This can give rise to a distinct moral wrong, which we call “agency laundering.” At root, agency laundering involves obfuscating one’s moral responsibility by enlisting a technology or process to take some action and letting it forestall others from demanding an account for bad outcomes that result. We argue that the concept of agency laundering helps in understanding important moral problems in a number (...) of recent cases involving automated, or algorithmic, decision-systems. We apply our conception of agency laundering to a series of examples, including Facebook’s automated advertising suggestions, Uber’s driver interfaces, algorithmic evaluation of K-12 teachers, and risk assessment in criminal sentencing. We distinguish agency laundering from several other critiques of information technology, including the so-called “responsibility gap,” “bias laundering,” and masking. (shrink)

In this open access book, Timothy Aylsworth and Clinton Castro draw on the deep well of Kantian ethics to argue that we have moral duties, both to ourselves and to others, to protect our autonomy from the threat posed by the problematic use of technology. The problematic use of technologies like smartphones threatens our autonomy in a variety of ways, and critics have only begun to appreciate the vast scope of this problem. In the last decade, we have (...) seen a flurry of books making “self-help” arguments about how we could live happier, more fulfilling lives if we were less addicted to our phones. But none of these authors see this issue as one involving a moral duty to protect our autonomy. (shrink)

Algorithmic systems and predictive analytics play an increasingly important role in various aspects of modern life. Scholarship on the moral ramifications of such systems is in its early stages, and much of it focuses on bias and harm. This paper argues that in understanding the moral salience of algorithmic systems it is essential to understand the relation between algorithms, autonomy, and agency. We draw on several recent cases in criminal sentencing and K–12 teacher evaluation to outline four key ways in (...) which issues of agency, autonomy, and respect for persons can conflict with algorithmic decision-making. Three of these involve failures to treat individual agents with the respect they deserve. The fourth involves distancing oneself from a morally suspect action by attributing one’s decision to take that action to an algorithm, thereby laundering one’s agency. (shrink)

ABSTRACT: So far in this book, we have examined algorithmic decision systems from three autonomy-based perspectives: in terms of what we owe autonomous agents (chapters 3 and 4), in terms of the conditions required for people to act autonomously (chapters 5 and 6), and in terms of the responsibilities of agents (chapter 7). -/- In this chapter we turn to the ways in which autonomy underwrites democratic governance. Political authority, which is to say the ability of a government to exercise (...) power, may be justifiable or not. Whether it is justified and how it can come to be justified is a question of political legitimacy. Political legitimacy is another way in which autonomy and responsibility are linked. This relationship is the basis of the current chapter, and it is important in understanding the moral salience of algorithmic systems. We will draw the connection as follows. We begin, in section 8.1, by describing two uses of technology: crime predicting technology used to drive policing practices and social media technology used to influence elections (including by Cambridge Analytica and by the Internet Research Agency). In section 8.2 we consider several views of legitimacy and argue for a hybrid version of normative legitimacy based on one recently offered by Fabienne Peter. In section 8.3 we will explain that the connection between political legitimacy and autonomy is that legitimacy is grounded in legitimating processes, which are in turn based on autonomy. Algorithmic systems—among them PredPol and the Cambridge Analytica-Facebook-Internet Research Agency amalgam—can hinder that legitimation process and conflict with democratic legitimacy, as we argue in section 8.4. We will conclude by returning to several cases that serve as through-lines to the book: Loomis, Wagner, and Houston Schools. -/- The link below is to an open-access copy of the chapter. (shrink)

One of the main goals of Bayesian epistemology is to justify the rational norms credence functions ought to obey. Accuracy arguments attempt to justify these norms from the assumption that the source of value for credences relevant to their epistemic status is their accuracy. This assumption and some standard decision-theoretic principles are used to argue for norms like Probabilism, the thesis that an agent’s credence function is rational only if it obeys the probability axioms. We introduce an example that shows (...) that the accuracy arguments for Probabilism given by Joyce and Pettigrew fail, and that Probabilism in fact turns out to be false given Pettigrew’s way of conceiving of the goal of having accurate credences. Finally, we use our discussion of Pettigrew’s framework to draw an important general lesson about normative theorizing that relies on the positing of ideal agents. (shrink)

The Repugnant Conclusion served an important purpose in catalyzing and inspiring the pioneering stage of population ethics research. We believe, however, that the Repugnant Conclusion now receives too much focus. Avoiding the Repugnant Conclusion should no longer be the central goal driving population ethics research, despite its importance to the fundamental accomplishments of the existing literature.

This paper has two aims. The first is to explain a type of wrong that arises when agents obscure responsibility for their actions. Call it “agency laundering.” The second is to use the concept of agency laundering to understand the underlying moral issues in a number of recent cases involving algorithmic decision systems. From the Proceedings of the 14th International Conference, iConference 2019, Washington D.C., March 31-April 3, 2019.

ABSTRACT: One important criticism of algorithmic systems is that they lack transparency. Such systems can be opaque because they are complex, protected by patent or trade secret, or deliberately obscure. In the EU, there is a debate about whether the General Data Protection Regulation (GDPR) contains a “right to explanation,” and if so what such a right entails. Our task in this chapter is to address this informational component of algorithmic systems. We argue that information access is integral for respecting (...) autonomy, and transparency policies should be tailored to advance autonomy. -/- To make this argument we distinguish two facets of agency (i.e., capacity to act). The first is practical agency, or the ability to act effectively according to one’s values. The second is what we call cognitive agency, which is the ability to exercise what Pamela Hieronymi calls “evaluative control” (i.e., the ability to control our affective states, such as beliefs, desires, and attitudes). We argue that respecting autonomy requires providing persons sufficient information to exercise evaluative control and properly interpret the world and one’s place in it. We draw this distinction out by considering algorithmic systems used in background checks, and we apply the view to key cases involving risk assessment in criminal justice decisions and K-12 teacher evaluation. -/- The link below is to an open access version of the chapter. (shrink)

We argue that an essential element of understanding the moral salience of algorithmic systems requires an analysis of the relation between algorithms and agency. We outline six key ways in which issues of agency, autonomy, and respect for persons can conflict with algorithmic decision-making.

I present an argument for an interpretation ofKant's views on the nature of the ‘content [Inhalt]’ of ‘cognition [Erkenntnis]’. In contrast to one of the longest standing interpretations ofKant's views on cognitive content, which ascribes toKant a straightforwardly psychologistic understanding of content, and in contrast as well to the more recently influential reading ofKant put forward byMcDowell and others, according to whichKant embraces a version ofRussellianism, I argue thatKant's views on this topic are of a much moreFregean bent than has (...) traditionally been admitted or appreciated. I conclude by providing a sketch of how a better grasp ofKant's views on cognitive content in general can help bring into sharper relief what is, and what is not, at stake in the recent debates over whether Kant accepts a particular kind of cognitive content—namely, non‐conceptual content. (shrink)

A literary and historical analysis of the structure and meaning of recurrent symbols, images, and actions employed in Plato’s dialogues. In this book, Clinton DeBevoise Corcoran examines the use of place in Plato’s dialogues. Corcoran argues that spatial representations, such as walls, caves, and roads, as well as the creation of eternal patterns and chaotic images in the particular spaces, times, characterizations, and actions of the dialogues, provide clues to Plato’s philosophic project. Throughout the dialogues, the Good serves as (...) an overarching ordering principle for the construction of place and the proper limit of spaces, whether they be here in the world, deep in the underworld, or in the nonspatial ideal realm of the Forms. The Good, since it escapes the limits of space and time, equips Plato with a powerful mythopoetic tool to create settings, frames, and arguments that superimpose different dimensions of reality, allowing worlds to overlap that would otherwise be incommensurable. The Good also serves as a powerful ethical tool for evaluating the order of different spaces. Corcoran explores how Plato uses wrestling and war as metaphors for the mixing of the nonspatial, eternal forms in the world and history, and how he uses spatial images throughout the dialogues to critique Athens’s tragic overreach in the Peloponnesian War. Far from merely an incidental backdrop in the dialogues, place etches the tragic intersection of the mortal and the immortal, good and evil, and Athens’s past, present, and future. (shrink)

To advance the task of designing robots capable of performing collective tasks with humans, studies in human–robot interaction often turn to psychology, philosophy of mind and neuroscience for inspiration. In the same vein, this chapter explores how the notion of recognition and commitment can help confront some of the current problems in addressing robot-human interaction in joint tasks. First, we argue that joint actions require mutual recognition, which cannot be established without the attribution and maintenance of commitments. Second, we argue (...) that commitments require affective states such as social motivations or shared emotions. Finally, we conclude by assessing three possible proposals for how social robotics could implement an architecture of commitments by taking such an affective components into consideration. (shrink)

Lejos de nuestros modelos, la palabra desorden suele designar la riada anónima del exterior. Querría señalar la fuerza ciega de una corriente humana y terrenal, impetuosamente aleatoria, de la que debemos protegernos. Pero éste no es un libro de ética al estilo usual. No opera con la contraposición del bien al mal, no busca un conjunto de prescripciones para una vida mejor ni una idea del deber que guíe la acción. No intenta que los hombres aprendan a conducirse en términos (...) supuestamente morales, sino que cada uno asuma su indescifrable signo natal y le dé una forma de vida. El vínculo entre ética y alegría, entre moral y fuerza, ha sido peligrosamente olvidado. La disciplina no es reclamada por las señas externas de la organización, sino por el desarrollo interior de la potencia. Este libro intenta actualizar la vieja certeza, oriental y occidental, de que las contingencias externas acaecen siempre con un orden oculto, remotamente inteligible. Según tal experiencia, el pensamiento no es en primer lugar un acto reflexivo que pueda o no realizarse, sino la turbulencia secreta de cualquier presencia material, por apacible que parezca. Lo mismo es ser y pensar, se afirma ya antes de Platón. Se trata de una experiencia vertiginosa y a la vez común, admitida en la más llana –aunque no siempre expresable– sabiduría popular. Si aquí se tiene la pretensión de defenderla, de modo suficientemente comprensible, es por la intención de mostrarla en la más cotidiana y banal actualidad. (shrink)

In managers' dynamic, real-world environments, they often feel it is necessary to exercise some creative discretion over employee ratings. Most managers do not describe their ratings of subordinates in performance appraisals as completely honest or accurate. The inaccuracy is often in the form of inflated ratings. They justify the inaccuracy by sighting, among other things, the need to avoid confrontation with subordinates, damaging working relationships, and creating permanent written documents which may later harm a subordinate's career. Many of these motives (...) are not only well intentioned, but are designed to enhance individual, unit, and organizational performance (some of the ultimate objectives of performance appraisal systems.) This paper examines the ethics of this sort of deliberate manipulation of performance appraisal systems. It suggests that at the organizational level, performance appraisal is usually seen as an end in itself, and a formalist ethical critique is applied. At the managerial level, performance appraisal is usually seen as a means to an end, and a utilitarian critique is applied. Since both perspectives are essential, we conclude that a Janus-Headed analysis is needed. We suggest some duties and obligations for both the organization and the manager engaged in performance appraisal. (shrink)

This paper presents an ontological perspective that enables evaluating the effectiveness of business models from an integrative worldview. Different groups’ fragmented and reductionist views on this topic create a dichotomy that makes it difficult to compare and analyze them in practice. Such groups use different values for some components, which may result in neglecting others and their interrelationship. This study discusses a functional characteristic of business models that academia still needs to address. It explores new frontiers in the field, such (...) as business models for networks, sustainability, and their practical evaluation. To achieve an integrative ontology and avoid focusing on specific constructs or systems at the expense of others, we draw upon the theory of worldviews from Wilhelm Dilthey, reformational philosophy, and Herman Dooyeweerd’s theory of modal aspects. Society should move beyond dualistic thinking and embrace practical and applicable solutions. To help companies develop effective models, we introduce a new business model framework based on an integrative worldview that enables comparisons and evaluations of companies in practice. Creating competitive advantages and value appropriations synergizes with essential aspects of reformational philosophy. Analyzing and interrelating such elements are fundamental to understanding the real applied value of business models. (shrink)

I argue for a new delimitation of what Kant means by ‘cognition [Erkenntnis]’, on the basis of the intermediate, transitional place that Kant gives to cognition in the ‘progression [Stufenleiter]’ of our representations and our consciousness of them. I show how cognition differs from mental acts lying earlier on this progression—such as sensing, intuiting, and perceiving—and also how cognition differs from acts lying later on this progression—such as explaining, having insight, and comprehending. I also argue that cognition should not be (...) confused with ‘knowledge [Wissen]’, insofar as knowledge represents the culmination of a separate orthogonal progression of acts of ‘holding-true’. Along the way, I show how having in focus the specific progression from representation, to consciousness, to cognition allows us to better appreciate the architectonic significance of the progression of Kant’s analysis in the first Critique, and also helps to illuminate the unity of Kant’s account of cognition itself across its variety of forms. (shrink)

Critique of Latin American Reason is one of the most important philosophical texts to have come out of South America in recent decades. First published in 1996, it offers a sweeping critique of the foundational schools of thought in Latin American philosophy and critical theory. Santiago Castro-Gómez argues that “Latin America” is not so much a geographical entity, a culture, or a place, but rather an object of knowledge produced by a family of discourses in the humanities that are (...) inseparably linked to colonial power relationships. Using the archaeological and genealogical methods of Michel Foucault, he analyzes the political, literary, and philosophical discourses and modes of power that have contributed to the making of “Latin America.” Castro-Gómez examines the views of a wide range of Latin American thinkers on modernity, postmodernity, identity, colonial history, and literature, also considering how these questions have intersected with popular culture. His critique spans Central and South America, and it also implicates broader and protracted global processes. This book presents this groundbreaking work of contemporary critical theory in English translation for the first time. It features a foreword by Linda Martín Alcoff, a new preface by the author, and an introduction by Eduardo Mendieta situating Castro-Gómez’s thought in the context of critical theory in Latin America and the Global South. Two appendixes feature an interview with Castro-Gómez that sheds light on the book’s composition and short provocations responding to each chapter from a multidisciplinary forum of contemporary scholars who resituate the work within a range of perspectives including feminist, Francophone African, and decolonial Black political thought. (shrink)

In Eros and Revolution, Javier Sethness Castro presents a comprehensive intellectual and political biography of the critical theorist Herbert Marcuse (1898-1979), investigating the Hegelian-Marxist, Romantic, existentialist, social-psychological, and anti-authoritarian dimensions of his thought, as well as his contemporary relevance.