Algorithms have developed into somewhat of a modern myth. On the one hand, they have been depicted as powerful entities that rule, sort, govern, shape, or otherwise control our lives. On the other hand, their alleged obscurity and inscrutability make it difficult to understand what exactly is at stake. What sustains their image as powerful yet inscrutable entities? And how to think about the politics and governance of something that is so difficult to grasp? This editorial essay provides a critical (...) backdrop for the special issue, treating algorithms not only as computational artifacts but also as sensitizing devices that can help us rethink some entrenched assumptions about agency, transparency, and normativity. (shrink)

Much bioethical literature and policy guidances for big data analytics in biomedical research emphasize the importance of trust. It is essential that potential participants trust so they will allow their data to be used to further research. However, comparatively, little guidance is offered as to what trustworthy oversight mechanisms are, or how policy should support them, as data are collected, shared, and used. Generally, “trust” is not characterized well enough, or meaningfully enough, for the term to be systematically applied in (...) policy development. Yet points made in the philosophical literature on trust can help. They allow us, not only to better distinguish the different ways the term “trust” may be interpreted, but also to better determine how different approaches to trust can align with policy and governance—in what ways they may relate to key bioethical concepts and related laws, and in what ways they can help to balance individual and group interests in data sharing. This article draws from the philosophical literature on trust to identify a relationship among consent, trust, and justice. Specifically, parallels are drawn between “character-trustworthiness” and “natural justice,” a set of widely held legal safeguards intended to ensure decision-makers follow a pattern of procedural fairness which protects the rights of the individual and thereby maintains public confidence in the decision-making process. Relevance to traditional bioethical principles, established laws, and consent procedures are addressed throughout. In conclusion, policy actions are suggested. (shrink)

Information security governance has become an elusive goal and a murky concept. This paper problematizes both information security governance and the broader concept of governance. What does it mean to govern information security, or for that matter, anything? Why have information technologies proven difficult to govern? And what assurances can governance provide for the billions of people who rely on information technologies every day? Drawing together several distinct bodies of literature—including multiple strands of governance theory, actor–network theory, and scholarship on (...) sociotechnical regimes—this paper conceptualizes networked action on a spectrum from uncertain governance to governing uncertainty. I advance a twofold argument. First, I argue that networks can better govern uncertainty as they become more able not only to enroll actors in a collective agenda, but also to cut ties with those who seek to undermine that agenda. And second, I argue that the dominant conception of information security governance, which emphasizes governing uncertainty through risk management, in practice devolves to uncertain governance. This is largely because information technologies have evolved toward greater connectedness—and with it, greater vulnerability—creating a regime of insecurity. This evolution is illustrated using the history of the US government’s efforts to govern information security. (shrink)

In light of the recent emergence of predictive techniques in law enforcement to forecast crimes before they occur, this paper examines the temporal operation of power exercised by predictive policing algorithms. I argue that predictive policing exercises power through a paranoid style that constitutes a form of temporal governmentality. Temporality is especially pertinent to understanding what is ethically at stake in predictive policing as it is continuous with a historical racialized practice of organizing, managing, controlling, and stealing time. After first (...) clarifying the concept of temporal governmentality, I apply this lens to Chicago Police Department’s Strategic Subject List. This predictive algorithm operates, I argue, through a paranoid logic that aims to preempt future possibilities of crime on the basis of a criminal past codified in historical crime data. (shrink)

Applications of artificial intelligence/machine learning in health care are dynamic and rapidly growing. One strategy for anticipating and addressing ethical challenges related to AI/ml for health care is patient and public involvement in the design of those technologies – often referred to as ‘co-design’. Co-design has a diverse intellectual and practical history, however, and has been conceptualized in many different ways. Moreover, AI/ml introduces challenges to co-design that are often underappreciated. Informed by perspectives from critical data studies and critical digital (...) health studies, we review the research literature on involvement in health care, and involvement in design, and examine the extent to which co-design as commonly conceptualized is capable of addressing the range of normative issues raised by AI/ml for health care. We suggest that AI/ml technologies have amplified and modified existing challenges related to patient and public involvement, and created entirely new challenges. We outline three pitfalls associated with co-design for ethical AI/ml for health care and conclude with suggestions for addressing these practical and conceptual challenges. (shrink)

How should automated vehicles react in emergency circumstances? Most research projects and scientific literature deal with this question from a moral perspective. In particular, it is customary to treat emergencies involving AVs as instances of moral dilemmas and to use the trolley problem as a framework to address such alleged dilemmas. Some critics have pointed out some shortcomings of this strategy and have urged to focus on mundane traffic situations instead of trolley cases involving AVs. Besides, these authors rightly point (...) out the political nature of the most interesting debates involving AVs. However, in our view, they do not offer an adequate account of the distinction between ethics and politics and still see their proposals as contributions to the ethics of AVs. We argue that many of the interesting questions about how AVs should behave, both in emergency and other situations, are of political, and not moral, nature. This view is based on a conception of politics and political normativity that we have developed elsewhere and that we call “political minimalism.” Additionally, we show that this proposed perspective has significant consequences for the design, management, and regulation of transport systems. (shrink)

All datasets emerge from and are enmeshed in power-laden semiotic systems. While emerging data ethics curriculum is supporting data science students in identifying data biases and their consequences, critical attention to the cultural histories and vested interests animating data semantics is needed to elucidate the assumptions and political commitments on which data rest, along with the externalities they produce. In this article, I introduce three modes of reading that can be engaged when studying datasets—a denotative reading, a connotative reading, and (...) a deconstructive reading. I then outline how I have taught students to engage these methods when analyzing three datasets in Data and Society—a course designed to cultivate student competency in politically aware data analysis and interpretation. I show how combined, the reading strategies prompt students to grapple with the double binds of perceiving contemporary problems through systems of representation that are always situated, incomplete, and inflected with diverse politics. While I introduce these methods in the context of teaching, I argue that the methods are integral to any data practice in the conclusion. (shrink)

In the age of ubiquitous computing and artificially intelligent applications, social machines serves as a powerful framework for understanding and interpreting interactions in socio-algorithmic ecosystems. Although researchers have largely used it to analyze the interactions of individuals and algorithms, limited attempts have been made to investigate the politics in social machines. In this study, I claim that social machines are per se political machines, and introduce a five-point framework for classifying influence processes in socio-algorithmic ecosystems. By drawing from scholars from (...) political theory, I use a notion of influence that functions as a meta-concept for connecting and comparing different conceptions of politics. In this way, I can associate multiple political aspects of social machines from a cybernetic perspective. I show that the framework efficiently categorizes dimensions of influence that shape interactions between individuals and algorithms. These categories are symbolic influence, political conduct, algorithmic influence, design, and regulatory influence. Using case studies, I describe how they interact with each other on online social networks and in algorithmic decision-making systems and illustrate how the framework is able to guide scientists in further research. (shrink)

Rapid urbanization has meant that cities around the world must deal with problems like traffic congestion, aging infrastructure, affordable housing, and climate change. Increasingly, policymakers are turning to investments in technology and digital infrastructure to address these problems. Yet the move towards so-called smart cities is not simply responsive, and policymakers increasingly advocate for smart city initiatives as a necessary step towards objective, efficient, and rational governance. This understanding of technological interventions as inherently progressive, however, causes many to overlook the (...) erasures, biases, and limitations that emerge from trying to leave the past behind. As the problems associated with this enthusiasm become more apparent, the smart city movement must therefore recalibrate its relationship to not just technology but time itself. Building on deconstructive temporalities emerging out of quantum physics, I argue that cities must begin drawing from alternative temporalities more open to the intersections between past, present, and future. As such, I suggest that the time has come to replace the ideal of the smart city with that of the spectral city – an incomplete city haunted by the ghosts of the past. (shrink)

Rapid urbanization has meant that cities around the world must deal with problems like traffic congestion, aging infrastructure, affordable housing, and climate change. Increasingly, policymakers are turning to investments in technology and digital infrastructure to address these problems. Yet the move towards so-called smart cities is not simply responsive, and policymakers increasingly advocate for smart city initiatives as a necessary step towards objective, efficient, and rational governance. This understanding of technological interventions as inherently progressive, however, causes many to overlook the (...) erasures, biases, and limitations that emerge from trying to leave the past behind. As the problems associated with this enthusiasm become more apparent, the smart city movement must therefore recalibrate its relationship to not just technology but time itself. Building on deconstructive temporalities emerging out of quantum physics, I argue that cities must begin drawing from alternative temporalities more open to the intersections between past, present, and future. As such, I suggest that the time has come to replace the ideal of the smart city with that of the spectral city – an incomplete city haunted by the ghosts of the past. (shrink)

Rapid urbanization has meant that cities around the world must deal with problems like traffic congestion, aging infrastructure, affordable housing, and climate change. Increasingly, policymakers are turning to investments in technology and digital infrastructure to address these problems. Yet the move towards so-called smart cities is not simply responsive, and policymakers increasingly advocate for smart city initiatives as a necessary step towards objective, efficient, and rational governance. This understanding of technological interventions as inherently progressive, however, causes many to overlook the (...) erasures, biases, and limitations that emerge from trying to leave the past behind. As the problems associated with this enthusiasm become more apparent, the smart city movement must therefore recalibrate its relationship to not just technology but time itself. Building on deconstructive temporalities emerging out of quantum physics, I argue that cities must begin drawing from alternative temporalities more open to the intersections between past, present, and future. As such, I suggest that the time has come to replace the ideal of the smart city with that of the spectral city – an incomplete city haunted by the ghosts of the past. (shrink)

Mature information societies are characterised by mass production of data that provide insight into human behaviour. Analytics has arisen as a practice to make sense of the data trails generated through interactions with networked devices, platforms and organisations. Persistent knowledge describing the behaviours and characteristics of people can be constructed over time, linking individuals into groups or classes of interest to the platform. Analytics allows for a new type of algorithmically assembled group to be formed that does not necessarily align (...) with classes or attributes already protected by privacy and anti-discrimination law or addressed in fairness- and discrimination-aware analytics. Individuals are linked according to offline identifiers and shared behavioural identity tokens, allowing for predictions and decisions to be taken at a group rather than individual level. This article examines the ethical significance of such ad hoc groups in analytics and argues that the privacy interests of algorithmically assembled groups in inviolate personality must be recognised alongside individual privacy rights. Algorithmically grouped individuals have a collective interest in the creation of information about the group, and actions taken on its behalf. Group privacy is proposed as a third interest to balance alongside individual privacy and social, commercial and epistemic benefits when assessing the ethical acceptability of analytics platforms. (shrink)

Theories related to cognitive sciences, Human-in-the-loop Cyber-physical systems, data analysis for decision-making, and computational ethics make clear the need to create transdisciplinary learning, research, and application strategies to bring coherence to the paradigm of a truly human-oriented technology. Autonomous objects assume more responsibilities for individual and collective phenomena, they have gradually filtered into routines and require the incorporation of ethical practice into the professions related to the development, modeling, and design of algorithms. To make this possible, it is pertinent and (...) urgent to bring them closer to the problems and approaches of the humanities. Increasingly transdisciplinary research must be part of the construction of systems that provide developers and scientists with the necessary bases to understand the ethical debate and therefore their commitment to society. This article considers two theories as articulating axes: Blumenberg’s, coming from the field of philosophy, for whom the process of technification and especially the implementation of mathematical models in their algorithmic form leads to an emptying of meaning and therefore makes programmers who implement their functions to be alien to the concerns that gave them origin; Daston’s, belonging to the field of the history of science and according to which the division of labor in the processes of technification of the calculation implies a kind of subordination in which those who implement the inventions of a small group of privileged mathematicians ignore the procedures that put them into operation. Given these two theories, the black box models prevalent in AI development, and the urgency of establishing explanatory frameworks for the development of computational ethics, this article exposes the need to give a voice to the cultural history of consciousness for promoting the discussions around the implementation of mathematical algorithms. The paper takes as a reference the different points of view that have emerged around the study of technological ethics, its applicability, management, and design. It criticizes the current state of studies from a humanistic perspective and explains how the historical perspective allows promoting the training of software engineers, developers and creators so that they assume intuitions and moral values in the development of their work. Specifically, it aims to expose how cultural history, applied to the study of consciousness and its phenomena, makes those involved in this technological revolution aware of the effect that they, through their algorithms, have on society in general and on human beings in particular. (shrink)

Organizations increasingly rely on algorithm-based HR decision-making to monitor their employees. This trend is reinforced by the technology industry claiming that its decision-making tools are efficient and objective, downplaying their potential biases. In our manuscript, we identify an important challenge arising from the efficiency-driven logic of algorithm-based HR decision-making, namely that it may shift the delicate balance between employees’ personal integrity and compliance more in the direction of compliance. We suggest that critical data literacy, ethical awareness, the use of participatory (...) design methods, and private regulatory regimes within civil society can help overcome these challenges. Our paper contributes to literature on workplace monitoring, critical data studies, personal integrity, and literature at the intersection between HR management and corporate responsibility. (shrink)

Policy and guideline proposals for ethical artificial intelligence research have proliferated in recent years. These are supposed to guide the socially-responsible development of AI for a common good. However, there typically exist incentives for non-cooperation ; and, these proposals often lack effective mechanisms to enforce their own normative claims. The situation just described constitutes a social dilemma—namely, a situation where no one has an individual incentive to cooperate, though mutual cooperation would lead to the best outcome for all involved. In (...) this paper, we use stochastic evolutionary game dynamics to model this social dilemma in the context of the ethical development of artificial intelligence. This formalism allows us to isolate variables that may be intervened upon, thus providing actionable suggestions for increased cooperation amongst numerous stakeholders in AI. Our results show how stochastic effects can help make cooperation viable in such a scenario. They suggest that coordination for a common good should be attempted in smaller groups in which the cost of cooperation is low, and the perceived risk of failure is high. This provides insight into the conditions under which we should expect such ethics proposals to be successful with regard to their scope, scale, and content. (shrink)

A wave of recent scholarship has warned about the potential for discriminatory harms of algorithmic systems, spurring an interest in algorithmic accountability and regulation. Meanwhile, parallel concerns about surveillance practices have already led to multiple successful regulatory efforts of surveillance technologies—many of which have algorithmic components. Here, we examine municipal surveillance regulation as offering lessons for algorithmic oversight. Taking the 2017 Seattle Surveillance Ordinance as our primary case study and surveying efforts across five other cities, we describe the features of (...) existing surveillance regulation; including procedures for describing surveillance technologies in detail, requirements for public engagement, and processes for establishing acceptable uses. Although the Seattle Surveillance Ordinance was not intended to address algorithmic accountability, we find these considerations to be relevant to the law’s aim of surfacing disparate impacts of systems in use. We also find that in notable cases government employees did not identify regulated algorithmic surveillance technologies as reliant on algorithmic or machine learning systems, highlighting definitional gaps that could hinder future efforts toward algorithmic regulation. We argue that finer-grained distinctions between types of information systems in the language of law and policy, and risk assessment tools integrated into their implementation would strengthen future regulatory efforts by rendering underlying algorithmic components more legible and accountable to political and community stakeholders. (shrink)

This article employs Spinoza’s ideas as a springboard for developing a novel philosophical interpretation of today’s technologically enhanced world. As a starting point, today’s digitized and datafied world has brought about fundamental changes not only to the ways in which humans live their lives but also to our understanding of the role and place of the human person as such. As the conditions and, in many cases, the content of everyday life are shaped by data, code, devices and the infrastructure (...) necessary for connectivity and interoperability, anthropocentric notions of the human begin to fall apart. Hence, this article embraces the post-humanist displacement of the human by demonstrating human beings to be merely parts of hybrid agglomerations, united by the flows of affect. It is within these affective flows that agency and existence are seen to be located. Moreover, through appreciation of Spinozist monism, it becomes evident that today’s hybrid agglomerations, understood as manifestations of a single substance under the attributes of thought and extension, are not aberrations but merely manifestations of natural human embeddedness. (shrink)

In more and more contexts, human decision-making is replaced by algorithmic decision-making. While promising to deliver efficient and objective decisions, algorithmic decision systems have specific weaknesses, some of which are particularly dangerous if data are collected and processed by profit-oriented companies. In this paper, I focus on two problems that are at the root of the logic of algorithmic decision-making: (1) (in)tolerance for ambiguity, and (2) instantiations of Campbell’s law, i. e. of indicators that are used for “social decision-making” being (...) subject to “corruption pressures” and tending to “distort and corrupt” the underlying social processes. As a result, algorithmic decision-making can risk missing the point of the social practice in question. These problems are intertwined with problems of structural injustice; hence, if algorithms are to deliver on their promises of efficiency and objectivity, accountability and critical scrutiny are needed. (shrink)

AI technology is capturing the African imaginations as a gateway to progress and prosperity. There is a growing interest in AI by different actors across the continent including scientists, researchers, humanitarian and aid organizations, academic institutions, tech start-ups, and media organizations. Several African states are looking to adopt AI technology to capture economic growth and development opportunities. On the other hand, African researchers highlight the gap in regulatory frameworks and policies that govern the development of AI in the continent. They (...) argue that this could lead to AI technology exacerbating problems of inequalities and injustice in the continent. However, most of the literature on AI ethics is biased toward Euro-American perspectives and lack the understanding of how AI development is apprehended in the Global South, and particularly Africa. Drawing on the case study of the first African Master’s in Machine Intelligence program, this paper argues for looking beyond the question of ethics in AI and examining AI governance issues through the analytical lens of the raciality of computing and the political economy of technoscience to understand AI development in Africa. By doing so, this paper seeks a different theorization for AI ethics from the South that is based on lived experiences of those in the margins and avoids the framings of technological futures that simplistically pathologize or celebrate Africa. (shrink)

PurposeThis paper aims to investigate algorithmic governmentality – as proposed by Antoinette Rouvroy – specifically in relation to law. It seeks to show how algorithmic profiling can be particularly attractive for those in legal practice, given restraints on time and resources. It deviates from Rouvroy in two ways. First, it argues that algorithmic governmentality does not contrast with neoliberal modes of government in that it allows indirect rule through economic calculations. Second, it argues that critique of such systems is possible, (...) especially if the creative nature of law can be harnessed effectively.Design/methodology/approachThis is a conceptual paper, with a theory-based approach, that is intended to explore relevant issues related to algorithmic governmentality as a basis for future empirical research. It builds on governmentality and socio-legal studies, as well as research on algorithmic practices and some documentary analysis of reports and public-facing marketing of relevant technologies.FindingsThis paper provides insights on how algorithmic knowledge is collected, constructed and applied in different situations. It provides examples of how algorithms are currently used and how trends are developing. It demonstrates how such uses can be informed by socio-political and economic rationalities.Research limitations/implicationsFurther empirical research is required to test the theoretical findings.Originality/valueThis paper takes up Rouvroy’s question of whether we are at the end of critique and seeks to identify where such critique can be made possible. It also highlights the importance of acknowledging the role of political rationalities in informing the activity of algorithmic assemblages. (shrink)

This paper explores how calculative cultures shape perceptions of models and practices of model use in the financial industry. A calculative culture comprises a specific set of practices and norms concerning data and model use in an organizational setting. Drawing on interviews with model users working in algorithmic securities trading, I argue that the introduction of complex machine-learning models changes the dynamics in calculative cultures, which leads to a displacement of human judgment in quantitative finance. In this paper, I distinguish (...) between three calculative cultures: an idealistic culture of undivided trust in models, a pragmatic culture of skepticism toward model accuracy, and a pragmatic idealist culture of early stage skepticism and implementation and production-phase idealism. Based on the empirical material, the analysis engages with examples of each of the three calculative cultures. The study contributes to the social studies of finance and science and technology studies more broadly by showing how perceptions of models shape and are shaped through model work in data-intensive, computerized finance. (shrink)

Current advances in research, development and application of artificial intelligence systems have yielded a far-reaching discourse on AI ethics. In consequence, a number of ethics guidelines have been released in recent years. These guidelines comprise normative principles and recommendations aimed to harness the “disruptive” potentials of new AI technologies. Designed as a semi-systematic evaluation, this paper analyzes and compares 22 guidelines, highlighting overlaps but also omissions. As a result, I give a detailed overview of the field of AI ethics. Finally, (...) I also examine to what extent the respective ethical principles and values are implemented in the practice of research, development and application of AI systems—and how the effectiveness in the demands of AI ethics can be improved. (shrink)

Information communication technology is spreading fast and wide. Driven by convenience, it enables people to undertake personal tasks and make decisions more easily and efficiently. Convenience enjoys an air of liberation as well as self-expression affecting all areas of life. The industry for children's toys is a major economic market becoming ever more tech-related and drawn into the battle for convenience. Like any other tech-related industry, this battle is about industry dominance and, currently, that involves networked toys. Networked toys aim (...) to enhance convenience for children and parents alike. Increasingly difficult to resist, these convenient networked devices are also a societal game changer. Neatly nestled in a lacuna juris and surrounded by a lack of clinical evidence, networked toys raise complex ethical issues concerning human development. This article lays bare the regulatory nexus for networked toys and invites ethical thinking to fill the gap to ensure sufficient protection for all human developmental stages. Networked toys not only affect but also might interfere with child development. Therefore, the article initially summarises the four key psychological stages through which the neurological development of the human brain processes. Each of these stages involves vital windows for human development in cognitive, emotional and social dimensions. Missing any of these developmental windows changes an individual human for life. The article then takes a look at the two main legal frameworks protecting the stages of human development which are applicable to networked toys: First, the examination of the human rights framework with its major segments emanating from the fundamental rights to privacy for family and home, to a child's education as well as to personal data reveals the use of current networked toys as a shielded part of parenting which tends to be at odds with privacy and data protection requirements. Second, the product liability framework for toy manufacturers requires evidence-based causality for putting a child's safety at risk. Unfortunately, these legal frameworks fail to offer sufficient protection of the human developmental stages. There is a lacuna juris. Although networked toys involve the risk of negatively impacting human development in every dimension, clinical psychological studies are impossible to acquire as court evidence for product liability because they take too long to provide reliable data while exposing several generations of children to the examined risk in the process. Meanwhile the temptation of convenience continues to drive the industry and consumers of networked toys and devices, which are already impacting children of all age groups. Accepting this phenomenon as an element of cognitive dissonance in society and in science falls far short of an appropriate ethical balance. The need for creating such an ethical balance concerning networked toys is all the more imperative because even if the networked toy industry managed to eliminate all psychological risks for human development and every legal conflict with privacy and security, significant ethical and societal risks of networked toys remain due to inevitable technological bias. Against these mounting changes, it is suggested that only an ethical approach of interdisciplinary research and learning seems most promising to develop an appropriate equilibrium between the complex challenges posed by networked toys and the societal values at stake. (shrink)

Algorithms, once obscure objects of technical art, have lately been subject to considerable popular and scholarly scrutiny. What does it mean to adopt the algorithm as an object of analytic attention? What is in view, and out of view, when we focus on the algorithm? Using Niklaus Wirth's 1975 formulation that “algorithms + data structures = programs” as a launching-off point, this paper examines how an algorithmic lens shapes the way in which we might inquire into contemporary digital culture.

What claims are made about the objectivity of machines versus that of human experts? Whereas most current debates focus on the growing impact of algorithms in the age of Big Data, I argue here in favor of taking a longer historical perspective on these developments. Drawing on Daston and Galison's analysis of scientific production since the eighteenth century, I show that their distinction among three forms of objectivity sheds light on existing discussions about algorithmic objectivity and accountability in expert fields.

While organizations today make extensive use of complex algorithms, the notion of algorithmic accountability remains an elusive ideal due to the opacity and fluidity of algorithms. In this article, we develop a framework for managing algorithmic accountability that highlights three interrelated dimensions: reputational concerns, engagement strategies, and discourse principles. The framework clarifies that accountability processes for algorithms are driven by reputational concerns about the epistemic setup, opacity, and outcomes of algorithms; that the way in which organizations practically engage with emergent (...) expectations about algorithms may be manipulative, adaptive, or moral; and that when accountability relationships are heavily burdened by the opacity and fluidity of complex algorithmic systems, the emphasis of engagement should shift to a rational communication process through which a continuous and tentative assessment of the development, workings, and consequences of algorithms can be achieved over time. The degree to which such engagement is, in fact, rational can be assessed based on four discourse-ethical principles of participation, comprehension, multivocality, and responsiveness. We conclude that the framework may help organizations and their environments to jointly work toward greater accountability for complex algorithms. It may further help organizations in reputational positioning surrounding accountability issues. The discourse-ethical principles introduced in this article are meant to elevate these positioning contests to extend beyond mere adaption or compliance and help guide organizations to find moral and forward-looking solutions to accountability issues. (shrink)

Algorithms and data-driven technologies are increasingly being embraced by a variety of different sectors and institutions. This paper examines how algorithms and data-driven technologies, enacted by an organization like Facebook, can induce similarity across an industry. Using theories from organizational sociology and neoinstitutionalism, this paper traces the bureaucratic roots of Big Data and algorithms to examine the institutional dependencies that emerge and are mediated through data-driven and algorithmic logics. This type of analysis sheds light on how organizational contexts are embedded (...) into algorithms, which can then become embedded within other organizational and individual practices. By investigating technical practices as organizational and bureaucratic, discussions about accountability and decision-making can be reframed. (shrink)

The distinction between distributive and non-distributive profiles figures prominently in current evaluations of the ethical and epistemological risks that are associated with automated profiling practices. The diagnosis that non-distributive profiles may coincidentally situate an individual in the wrong category is often perceived as the central shortcoming of such profiles. According to this diagnosis, most risks can be retraced to the use of non-universal generalisations and various other statistical associations. This article develops a top-down analysis of non-distributive profiles in which this (...) fallibility of non-distributive profiles is no longer central. Instead, it focuses on how profiling creates various asymmetries between an individual data-subject and a profiler. The emergence of informational, interest, and perspectival asymmetries between data-subject and profiler explains how non-distributive profiles weaken the epistemic position of a profiled individual. This alternative analysis provides a more balanced assessment of the epistemic risks associated with non-distributive profiles. (shrink)

Data about the accessibility of United States municipalities is infrastructure in the smart city. What is counted and how, reflects the sociotechnical imaginary of a time or place. In this paper we focus on features identified by people with disabilities as promoting or hindering safe pedestrian travel. We use a regionally stratified sample of 178 cities across the United States. The municipalities were scored on two factors: their open data practices, and the degree to which they cataloged the environmental features (...) that persons with disabilities deemed critical for safe movement through urban spaces. In contradiction to the dominating narrative of too much data and not enough analyses, we find that when it comes to data points that might be useful to persons with disabilities, data are lacking. This data gap has consequences both politically and materially—on one hand data could help enforce compliance with the Americans with Disabilities Act, on the other they would allow for safe route planning. We find that reading these data formats and collection patterns from the perspective of critical disability studies—particularly those whose work disrupts notions of “normal” —helps answer questions about potential benefits and harms of data practices. This lens has the potential to promote analysis that is as disruptive to injustices as it is practical. (shrink)

In information societies, operations, decisions and choices previously left to humans are increasingly delegated to algorithms, which may advise, if not decide, about how data should be interpreted and what actions should be taken as a result. More and more often, algorithms mediate social processes, business transactions, governmental decisions, and how we perceive, understand, and interact among ourselves and with the environment. Gaps between the design and operation of algorithms and our understanding of their ethical implications can have severe consequences (...) affecting individuals as well as groups and whole societies. This paper makes three contributions to clarify the ethical importance of algorithmic mediation. It provides a prescriptive map to organise the debate. It reviews the current discussion of ethical aspects of algorithms. And it assesses the available literature in order to identify areas requiring further work to develop the ethics of algorithms. (shrink)

This essay tries to demarcate and analyse Artificial Intelligence ethics. Going away from the traditional distinction in normative, meta, and applied ethics, a different split is executed, inspired by the three most prominent schools of thought: deontology, consequentialism, and Aristotelian virtue ethics. The reason behind this alternative approach is to connect all three schools back to ancient Greek philosophy. Having proven that the majority of arguments derive from some ancient Greek scholars, a new voice is initiated into the discussion, Protagoras (...) the Sophist. A big advocate of -the later conceived- humanism and relativism, Protagoras is used as a prism to examine a new ethical model that is based on the personalization of agents. In other words, even though theories of objectivity have overflown contemporary discussions of finding a robust ethical model for Artificial Intelligence agents, there is potential in a subjective model, personalised after each and every user. (shrink)

The conjunction of wireless computing, ubiquitous Internet access, and the miniaturisation of sensors have opened the door for technological applications that can monitor health and well-being outside of formal healthcare systems. The health-related Internet of Things (H-IoT) increasingly plays a key role in health management by providing real-time tele-monitoring of patients, testing of treatments, actuation of medical devices, and fitness and well-being monitoring. Given its numerous applications and proposed benefits, adoption by medical and social care institutions and consumers may be (...) rapid. However, a host of ethical concerns are also raised that must be addressed. The inherent sensitivity of health-related data being generated and latent risks of Internet-enabled devices pose serious challenges. Users, already in a vulnerable position as patients, face a seemingly impossible task to retain control over their data due to the scale, scope and complexity of systems that create, aggregate, and analyse personal health data. In response, the H-IoT must be designed to be technologically robust and scientifically reliable, while also remaining ethically responsible, trustworthy, and respectful of user rights and interests. To assist developers of the H-IoT, this paper describes nine principles and nine guidelines for ethical design of H-IoT devices and data protocols. (shrink)

Since approval of the EU General Data Protection Regulation (GDPR) in 2016, it has been widely and repeatedly claimed that the GDPR will legally mandate a ‘right to explanation’ of all decisions made by automated or artificially intelligent algorithmic systems. This right to explanation is viewed as an ideal mechanism to enhance the accountability and transparency of automated decision-making. However, there are several reasons to doubt both the legal existence and the feasibility of such a right. In contrast to the (...) right to explanation of specific automated decisions claimed elsewhere, the GDPR only mandates that data subjects receive meaningful, but properly limited, information (Articles 13-15) about the logic involved, as well as the significance and the envisaged consequences of automated decision-making systems, what we term a ‘right to be informed’. Further, the ambiguity and limited scope of the ‘right not to be subject to automated decision-making’ contained in Article 22 (from which the alleged ‘right to explanation’ stems) raises questions over the protection actually afforded to data subjects. These problems show that the GDPR lacks precise language as well as explicit and well-defined rights and safeguards against automated decision-making, and therefore runs the risk of being toothless. We propose a number of legislative and policy steps that, if taken, may improve the transparency and accountability of automated decision-making when the GDPR comes into force in 2018. (shrink)