Algorithms have become a widespread trope for making sense of social life. Science, finance, journalism, warfare, and policing—there is hardly anything these days that has not been specified as “algorithmic.” Yet, although the trope has brought together a variety of audiences, it is not quite clear what kind of work it does. Often portrayed as powerful yet inscrutable entities, algorithms maintain an air of mystery that makes them both interesting and difficult to understand. This article takes on this problem and (...) examines the role of algorithms not as techno-scientific objects to be known, but as a figure that is used for making sense of observations. Following in the footsteps of Harold Garfinkel’s tutorial cases, I shall illustrate the implications of this view through an experiment with algorithmic navigation. Challenging participants to go on a walk, guided not by maps or GPS but by an algorithm developed on the spot, I highlight a number of dynamics typical of reasoning with running code, including the ongoing respecification of rules and observations, the stickiness of the procedure, and the selective invocation of the algorithm as an intelligible object. The materials thus provide an opportunity to rethink key issues at the intersection of the social sciences and the computational, including popular concerns with transparency, accountability, and ethics. (shrink)

We are sceptical of concerns over the opacity of algorithmic decision tools. While transparency and explainability are certainly important desiderata in algorithmic governance, we worry that automated decision-making is being held to an unrealistically high standard, possibly owing to an unrealistically high estimate of the degree of transparency attainable from human decision-makers. In this paper, we review evidence demonstrating that much human decision-making is fraught with transparency problems, show in what respects AI fares little worse or better and argue that (...) at least some regulatory proposals for explainable AI could end up setting the bar higher than is necessary or indeed helpful. The demands of practical reason require the justification of action to be pitched at the level of practical reason. Decision tools that support or supplant practical reasoning should not be expected to aim higher than this. We cast this desideratum in terms of Daniel Dennett’s theory of the “intentional stance” and argue that since the justification of action for human purposes takes the form of intentional stance explanation, the justification of algorithmic decisions should take the same form. In practice, this means that the sorts of explanations for algorithmic decisions that are analogous to intentional stance explanations should be preferred over ones that aim at the architectural innards of a decision tool. (shrink)

This article provides a history of private sector tracking technologies, examining how the advent of commercial surveillance centered around a logic of data capitalism. Data capitalism is a system in which the commoditization of our data enables an asymmetric redistribution of power that is weighted toward the actors who have access and the capability to make sense of information. It is enacted through capitalism and justified by the association of networked technologies with the political and social benefits of online community, (...) drawing upon narratives that foreground the social and political benefits of networked technologies. I examine its origins in the wake of the dotcom bubble, when technology makers sought to develop a new business model to support online commerce. By leveraging user data for advertising purposes, they contributed to an information environment in which every action leaves behind traces collected by companies for commercial purposes. Through analysis of primary source materials produced by technology makers, journalists, and business analysts, I examine the emergence of data capitalism between the mid-1990s and mid-2000s and its central role in the contemporary information economy. (shrink)

Discusses contemporary notions of the self, and examines their origins, development, and effects.

Algorithms are powerful because we invest in them the power to do things. With such promise, they can transform the ordinary, say snapshots along a robotic vacuum cleaner’s route, into something much more, such as a clean home. Echoing David Graeber’s revision of fetishism, we argue that this easy slip from technical capabilities to broader claims betrays not the “magic” of algorithms but rather the dynamics of their exchange. Fetishes are not indicators of false thinking, but social contracts in material (...) form. They mediate emerging distributions of power often too nascent, too slippery or too disconcerting to directly acknowledge. Drawing primarily on 2016 ethnographic research with computer vision professionals, we show how faith in what algorithms can do shapes the social encounters and exchanges of their production. By analyzing algorithms through the lens of fetishism, we can see the social and economic investment in some people’s labor over others. We also see everyday opportunities for social creativity and change. We conclude that what is problematic about algorithms is not their fetishization but instead their stabilization into full-fledged gods and demons – the more deserving objects of critique. (shrink)

This article responds to recent debates in critical algorithm studies about the significance of the term “algorithm.” Where some have suggested that critical scholars should align their use of the term with its common definition in professional computer science, I argue that we should instead approach algorithms as “multiples”—unstable objects that are enacted through the varied practices that people use to engage with them, including the practices of “outsider” researchers. This approach builds on the work of Laura Devendorf, Elizabeth Goodman, (...) and Annemarie Mol. Different ways of enacting algorithms foreground certain issues while occluding others: computer scientists enact algorithms as conceptual objects indifferent to implementation details, while calls for accountability enact algorithms as closed boxes to be opened. I propose that critical researchers might seek to enact algorithms ethnographically, seeing them as heterogeneous and diffuse sociotechnical systems, rather than rigidly constrained and procedural formulas. To do so, I suggest thinking of algorithms not “in” culture, as the event occasioning this essay was titled, but “as” culture: part of broad patterns of meaning and practice that can be engaged with empirically. I offer a set of practical tactics for the ethnographic enactment of algorithmic systems, which do not depend on pinning down a singular “algorithm” or achieving “access,” but which rather work from the partial and mobile position of an outsider. (shrink)

The paper focuses on concerns and legal challenges brought on by the use of algorithms. A particular class of algorithms that augment or replace analysis and decision-making by humans, i.e. data analytics and machine learning, is under scrutiny. Taking into account Balkin’s work on “the laws of an algorithmic society”, attention is drawn to obligations of transparency, matters of due process, and accountability. This US-centric analysis on drawbacks and loopholes of current legal systems is complemented with the analysis of norms (...) and principles of the EU data protection law, or “GDPR”. The aim is twofold. On the one hand, the intent is to shed light on some crucial differences between the US and EU law on the regulation of algorithmic operators, both public and private. Whereas, in the USA, scholars debate whether and to what extent new duties and responsibilities of algorithmic operators, e.g. information fiduciaries, have to amend the current framework of self-regulation and light government—as shown by the White House’s Office of Science and Technology Policy report from November 2016—in EU law much of the new duties and responsibilities of algorithmic operators have been passed upon them as data controllers. Whether such approaches will successfully tackle the normative challenges of the algorithmic society is, on the other hand, an open issue that will likely represent the main topic of debate over the next years. Disagreement may concern: the terms framing the legal question in e.g. statistical purposes of the data processing; how such terms are related to each other in legal reasoning ; and legal hard cases that will increasingly have to do with the principles that are at stake also but not only in data protection. By entrusting such legal hard cases to algorithms, or some sort of smart artificial agent, humans still bear full responsibility for the judgment of what is socially, ethically, and legally “plain” and “hard” in social affairs. The balance between delegation of decisions to algorithms and non-delegation will be the leitmotiv of the algorithmic society. Since the devil is in the detail, the current paper is devoted to some of them. (shrink)

Many accounts of informed consent in medical ethics claim that it is valuable because it supports individual autonomy. Unfortunately there are many distinct conceptions of individual autonomy, and their ethical importance varies. A better reason for taking informed consent seriously is that it provides assurance that patients and others are neither deceived nor coerced. Present debates about the relative importance of generic and specific consent do not address this issue squarely. Consent is a propositional attitude, so intransitive: complete, wholly specific (...) consent is an illusion. Since the point of consent procedures is to limit deception and coercion, they should be designed to give patients and others control over the amount of information they receive and opportunity to rescind consent already given. (shrink)

Recently, philosophers and social scientists have turned their attention to the epistemological shifts provoked in established sciences by their incorporation of big data techniques. There has been less focus on the forms of epistemology proper to the investigation of algorithms themselves, understood as scientific objects in their own right. This article, based upon 12 months of ethnographic fieldwork with Russian data scientists, addresses this lack through an investigation of the specific forms of epistemic attention paid to algorithms by data scientists. (...) On the one hand, algorithms are unlike other mathematical objects in that they are not subject to disputation through deductive proof. On the other hand, unlike concrete things in the world such as particles or organisms, algorithms cannot be installed as the objects of experimental systems directly. They can only be evaluated in their functioning as components of extended computational assemblages; on their own, they are inert. As a consequence, the epistemological coding proper to this evaluation does not turn on truth and falsehood but rather on the efficiency of a given algorithmic assemblage. This article suggests that understanding the forms of algorithmic rationality employed in such inquiry is crucial for charting the place of data science within the contemporary academy and knowledge economy more generally. (shrink)

The combination of increased availability of large amounts of fine-grained human behavioral data and advances in machine learning is presiding over a growing reliance on algorithms to address complex societal problems. Algorithmic decision-making processes might lead to more objective and thus potentially fairer decisions than those made by humans who may be influenced by greed, prejudice, fatigue, or hunger. However, algorithmic decision-making has been criticized for its potential to enhance discrimination, information and power asymmetry, and opacity. In this paper, we (...) provide an overview of available technical solutions to enhance fairness, accountability, and transparency in algorithmic decision-making. We also highlight the criticality and urgency to engage multi-disciplinary teams of researchers, practitioners, policy-makers, and citizens to co-develop, deploy, and evaluate in the real-world algorithmic decision-making processes designed to maximize fairness and transparency. In doing so, we describe the Open Algortihms project as a step towards realizing the vision of a world where data and algorithms are used as lenses and levers in support of democracy and development. (shrink)

Transparency is an increasingly prominent area of research that offers valuable insights for organizational studies. However, conceptualizations of transparency are rarely subject to critical scrutiny and thus their relevance remains unclear. In most accounts, transparency is associated with the sharing of information and the perceived quality of the information shared. This narrow focus on information and quality, however, overlooks the dynamics of organizational transparency. To provide a more structured conceptualization of organizational transparency, this article unpacks the assumptions that shape the (...) extant literature, with a focus on three dimensions: conceptualizations, conditions, and consequences. The contribution of the study is twofold: On a conceptual level, we provide a framework that articulates two paradigmatic positions underpinning discussions of transparency, verifiability approaches and performativity approaches; on an analytical level, we suggest a novel future research agenda for studying organizational transparency that pays attention to its dynamics, paradoxes, and performative characteristics. (shrink)

The concept of individual autonomy is one of the most frequently utilized--and perhaps least understood--terms of current moral, political, and legal debate. The first anthology devoted entirely to this philosophical concept, The Inner Citadel includes both extensive discussions of autonomy itself and theoretical applications of autonomy to various areas of philosophical inquiry. John Christman has assembled essays, many appearing in print for the first time, by such eminent philosophers as Gerald Dworkin, Joel Feinberg, Harry Frankfurt, and David A. J. Richards. (...) Together, these essays provide the necessary foundation for the myriad debates and controversies in areas such as bioethics, feminism, and paternalism whose resolution turns on the nature and value of individual autonomy. As the idea of autonomy is central to such a wide range of philosophical issues and impinges on other disciplines as well, The Inner Citadel will be essential for courses in moral, political, social, and legal philosophy, as well as a valuable resource for students of law, political science, and psychology. (shrink)

This paper undertakes a critical examination of recent philosophical discussions of the concept of individual autonomy. The paper is divided into two parts. Part I focusses on the work of joel feinberg, Gerald dworkin, Harry frankfurt and others, As well as their critics, In the development of the concept of autonomy itself (or its analogues). The suggestion defended is that autonomy is an important complement to freedom when the latter is construed only as the absence of restraints. Also considered is (...) the relation between autonomy and reason or rationality. In part ii, I examine various recent attempts to utilize the property of autonomy in moral and political theory. (shrink)

Focusing on contemporary debates in moral and political theory, Situating the Self argues that a non-relative ethics, binding on us in virtue of out humanity, is still a philosophically viable project. This intersting new book should be read by all those concerned with the problems of critical theory, the analysis of modernity, and contemporary ethics, as well as students and professionals in philosophy, sociology and political science.

'Most of us are still groping for answers about what makes life worth living, or what confers meaning on individual lives', writes Charles Taylor in Sources of the Self. 'This is an essentially modern predicament.' Charles Taylor's latest book sets out to define the modern identity by tracing its genesis, analysing the writings of such thinkers as Augustine, Descartes, Montaigne, Luther, and many others. This then serves as a starting point for a renewed understanding of modernity. Taylor argues that modern (...) subjectivity has its roots in ideas of human good, and is in fact the result of our long efforts to define and attain the good. The modern turn inwards is far from being a disastrous rejection of rationality, as its critics contend, but has at its heart what Taylor calls the affirmation of ordinary life. He concludes that the modern identity, and its attendant rejection of an objective order of reason, is far richer in moral sources that its detractors allow. Sources of the Self provides a decisive defence of the modern order and a sharp rebuff to its critics. (shrink)

This work examines the concept of trust in the light of virtue theory, and takes our responsibility to be trustworthy as central. Rather than thinking of trust as risk-taking, Potter views it as equally a matter of responsibility-taking. Her work illustrates that relations of trust are never independent from considerations of power, and that asking ourselves what we can do to be trustworthy allows us to move beyond adversarial trust relationships and toward a more democratic, just, and peaceful society.

Why has autonomy been a leading idea in philosophical writing on bioethics, and why has trust been marginal? In this important book, Onora O'Neill suggests that the conceptions of individual autonomy so widely relied on in bioethics are philosophically and ethically inadequate, and that they undermine rather than support relations of trust. She shows how Kant's non-individualistic view of autonomy provides a stronger basis for an approach to medicine, science and biotechnology, and does not marginalize untrustworthiness, while also explaining why (...) trustworthy individuals and institutions are often undeservingly mistrusted. Her arguments are illustrated with issues raised by practices such as the use of genetic information by the police or insurers, research using human tissues, uses of new reproductive technologies, and media practices for reporting on medicine, science and technology. Autonomy and Trust in Bioethics will appeal to a wide range of readers in ethics, bioethics and related disciplines. (shrink)

This important new book develops a new concept of autonomy. The notion of autonomy has emerged as central to contemporary moral and political philosophy, particularly in the area of applied ethics. professor Dworkin examines the nature and value of autonomy and uses the concept to analyse various practical moral issues such as proxy consent in the medical context, paternalism, and entrapment by law enforcement officials.

In information societies, operations, decisions and choices previously left to humans are increasingly delegated to algorithms, which may advise, if not decide, about how data should be interpreted and what actions should be taken as a result. More and more often, algorithms mediate social processes, business transactions, governmental decisions, and how we perceive, understand, and interact among ourselves and with the environment. Gaps between the design and operation of algorithms and our understanding of their ethical implications can have severe consequences (...) affecting individuals as well as groups and whole societies. This paper makes three contributions to clarify the ethical importance of algorithmic mediation. It provides a prescriptive map to organise the debate. It reviews the current discussion of ethical aspects of algorithms. And it assesses the available literature in order to identify areas requiring further work to develop the ethics of algorithms. (shrink)

The public debate surrounding the General Data Protection Regulation's “right to explanation” has sparked a global conversation of profound social and.

Since approval of the EU General Data Protection Regulation (GDPR) in 2016, it has been widely and repeatedly claimed that the GDPR will legally mandate a ‘right to explanation’ of all decisions made by automated or artificially intelligent algorithmic systems. This right to explanation is viewed as an ideal mechanism to enhance the accountability and transparency of automated decision-making. However, there are several reasons to doubt both the legal existence and the feasibility of such a right. In contrast to the (...) right to explanation of specific automated decisions claimed elsewhere, the GDPR only mandates that data subjects receive meaningful, but properly limited, information (Articles 13-15) about the logic involved, as well as the significance and the envisaged consequences of automated decision-making systems, what we term a ‘right to be informed’. Further, the ambiguity and limited scope of the ‘right not to be subject to automated decision-making’ contained in Article 22 (from which the alleged ‘right to explanation’ stems) raises questions over the protection actually afforded to data subjects. These problems show that the GDPR lacks precise language as well as explicit and well-defined rights and safeguards against automated decision-making, and therefore runs the risk of being toothless. We propose a number of legislative and policy steps that, if taken, may improve the transparency and accountability of automated decision-making when the GDPR comes into force in 2018. (shrink)

J. B. Schneewind's "The Invention of Autonomy" has been hailed as a major interpretation of modern moral thought. Schneewind's narrative, however, elides several serious interpretive issues, particularly in the transition from late medieval to early modern thought. This results in potentially distorted accounts of Thomas Aquinas, Hugo Grotius, and G. W. Leibniz. Since these thinkers play a crucial role in Schneewind's argument, uncertainty over their work calls into question at least some of Schneewind's larger agenda for the history of ethics.