Brain Computer Interfaces (BCIs) enable one to control peripheral ICT and robotic devices by processing brain activity on-line. The potential usefulness of BCI systems, initially demonstrated in rehabilitation medicine, is now being explored in education, entertainment, intensive workflow monitoring, security, and training. Ethical issues arising in connection with these investigations are triaged taking into account technological imminence and pervasiveness of BCI technologies. By focussing on imminent technological developments, ethical reflection is informatively grounded into realistic protocols of brain-to-computer communication. In particular, (...) it is argued that human-machine adaptation and shared control distinctively shape autonomy and responsibility issues in current BCI interaction environments. Novel personhood issues are identified and analyzed too. These notably concern (i) the “sub-personal” use of human beings in BCI-enabled cooperative problem solving, and (ii) the pro-active protection of personal identity which BCI rehabilitation therapies may afford, in the light of so-called motor theories of thinking, for the benefit of patients affected by severe motor disabilities. (shrink)

Traditionally, the manufacturer/operator of a machine is held (morally and legally) responsible for the consequences of its operation. Autonomous, learning machines, based on neural networks, genetic algorithms and agent architectures, create a new situation, where the manufacturer/operator of the machine is in principle not capable of predicting the future machine behaviour any more, and thus cannot be held morally responsible or liable for it. The society must decide between not using this kind of machine any more (which is not a (...) realistic option), or facing a responsibility gap, which cannot be bridged by traditional concepts of responsibility ascription. (shrink)

Traditionally, the manufacturer/operator of a machine is held (morally and legally) responsible for the consequences of its operation. Autonomous, learning machines, based on neural networks, genetic algorithms and agent architectures, create a new situation, where the manufacturer/operator of the machine is in principle not capable of predicting the future machine behaviour any more, and thus cannot be held morally responsible or liable for it. The society must decide between not using this kind of machine any more (which is not a (...) realistic option), or facing a responsibility gap, which cannot be bridged by traditional concepts of responsibility ascription. (shrink)

Robot ethics encompasses ethical questions about how humans should design, deploy, and treat robots; machine morality encompasses questions about what moral capacities a robot should have and how these capacities could be computationally implemented. Publications on both of these topics have doubled twice in the past 10 years but have often remained separate from one another. In an attempt to better integrate the two, I offer a framework for what a morally competent robot would look like and discuss a number (...) of ethical questions about the design, use, and treatment of such moral robots in society. Instead of searching for a fixed set of criteria of a robot’s moral competence I identify the multiple elements that make up human moral competence and probe the possibility of designing robots that have one or more of these human elements, which include: moral vocabulary; a system of norms; moral cognition and affect; moral decision making and action; moral communication. Juxtaposing empirical research, philosophical debates, and computational challenges, this article adopts an optimistic perspective: if robotic design truly commits to building morally competent robots, then those robots could be trustworthy and productive partners, caretakers, educators, and members of the human community. Moral competence does not resolve all ethical concerns over robots in society, but it may be a prerequisite to resolve at least some of them. (shrink)

The ethical monitoring of brain-machine interfaces (BMIs) is discussed in connection with the potential impact of BMIs on distinguishing traits of persons, changes of personal identity, and threats to personal autonomy. It is pointed out that philosophical analyses of personhood are conducive to isolating an initial thematic framework for this ethical monitoring problem, but a contextual refinement of this initial framework depends on applied ethics analyses of current BMI models and empirical case-studies. The personal autonomy-monitoring problem is approached by identifying (...) various ways in which the inclusion of a robotic controller in the motor pathway of an output BMI may limit or jeopardize personal autonomy. (shrink)

The combination of increased availability of large amounts of fine-grained human behavioral data and advances in machine learning is presiding over a growing reliance on algorithms to address complex societal problems. Algorithmic decision-making processes might lead to more objective and thus potentially fairer decisions than those made by humans who may be influenced by greed, prejudice, fatigue, or hunger. However, algorithmic decision-making has been criticized for its potential to enhance discrimination, information and power asymmetry, and opacity. In this paper, we (...) provide an overview of available technical solutions to enhance fairness, accountability, and transparency in algorithmic decision-making. We also highlight the criticality and urgency to engage multi-disciplinary teams of researchers, practitioners, policy-makers, and citizens to co-develop, deploy, and evaluate in the real-world algorithmic decision-making processes designed to maximize fairness and transparency. In doing so, we describe the Open Algortihms project as a step towards realizing the vision of a world where data and algorithms are used as lenses and levers in support of democracy and development. (shrink)

This comment responds to Kevin Warwick’s article on predictability and responsibility with respect to brain-machine interfaces in action. It compares conventional responsibility for device use with the potential consequences of phenomenological human-machine integration which obscures the causal chain of an act. It explores two senses of “responsibility”: 1) when it is attributed to a person, suggesting the morally important way in which the person is a causal agent, and 2) when a person is accountable and, on the basis of fairness (...) about rewards and sanctions, has a duty to act responsibly and accept liability. The comment suggests that, in the absence of absolute knowledge and predictability, we continue to engage in practical forms of reasoning about the responsibility for BMI-use in ways which are inclusive of uncertainties about the liability of persons versus devices and those who create them. (shrink)

The algorithm, a building block of computer science, is defined from an intuitive and pragmatic point of view, through a methodological lens of philosophy rather than that of formal computation. The treatment extracts properties of abstraction, control, structure, finiteness, effective mechanism, and imperativity, and intentional aspects of goal and preconditions. The focus on the algorithm as a robust conceptual object obviates issues of correctness and minimality. Neither the articulation of an algorithm nor the dynamic process constitute the algorithm itself. Analysis (...) for implications in computer science and philosophy reveals unexpected results, new questions, and new perspectives on current questions, including the relationship between our informally construed algorithms and Turing machines. Exploration in terms of current computational and philosophical thinking invites further developments. (shrink)

Brain–computer interfacing (BCI) aims at directly capturing brain activity in order to enable a user to drive an application such as a wheelchair without using peripheral neural or motor systems. Low signal to noise ratio’s, low processing speed, and huge intra- and inter-subject variability currently call for the addition of intelligence to the applications, in order to compensate for errors in the production and/or the decoding of brain signals. However, the combination of minds and machines through BCI’s and intelligent devices (...) (IDs) can affect a user’s sense of agency. Particularly confusing cases can arise when the behavioral control switches implicitly from user to ID. I will suggest that in such situations users may be insecure about the extent to which the resulting behavior, whether successful or unsuccessful, is genuinely their own. Hence, while performing an action, a user of a BCI–ID may be uncertain about being the agent of the act. Several cases will be examined and some implications for (legal) responsibility (e.g. establishing the presence of a ‘guilty mind’) are discussed. (shrink)

The article shows where the argument of responsibility-gap regarding brain-computer interfaces acquires its plausibility from, and suggests why the argument is not plausible. As a way of an explanation, a distinction between the descriptive third-person perspective and the interpretative first-person perspective is introduced. Several examples and metaphors are used to show that ascription of agency and responsibility does not, even in simple cases, require that people be in causal control of every individual detail involved in an event. Taking up the (...) current debate on liability in BCI use, the article provides and discusses some rules that should be followed when potentially harmful BCI-based devices are brought from the laboratory into everyday life. (shrink)

Decision-making assisted by algorithms developed by machine learning is increasingly determining our lives. Unfortunately, full opacity about the process is the norm. Would transparency contribute to restoring accountability for such systems as is often maintained? Several objections to full transparency are examined: the loss of privacy when datasets become public, the perverse effects of disclosure of the very algorithms themselves, the potential loss of companies’ competitive edge, and the limited gains in answerability to be expected since sophisticated algorithms usually are (...) inherently opaque. It is concluded that, at least presently, full transparency for oversight bodies alone is the only feasible option; extending it to the public at large is normally not advisable. Moreover, it is argued that algorithmic decisions preferably should become more understandable; to that effect, the models of machine learning to be employed should either be interpreted ex post or be interpretable by design ex ante. (shrink)

BackgroundBiobanks are considered to be key infrastructures for research development and have generated a lot of debate about their ethical, legal and social implications. While the focus has been on human genomic research, rapid advances in human microbiome research further complicate the debate.DiscussionWe draw on two cystic fibrosis biobanks in Toronto, Canada, to illustrate our points. The biobanks have been established to facilitate sample and data sharing for research into the link between disease progression and microbial dynamics in the lungs (...) of pediatric and adult patients. We begin by providing an overview of some of the ELSI associated with human microbiome research, particularly on the implications for the broader society. We then discuss ethical considerations regarding the identifiability of samples biobanked for human microbiome research, and examine the issue of return of results and incidental findings. We argue that, for the purposes of research ethics oversight, human microbiome research samples should be treated with the same privacy considerations as human tissues samples. We also suggest that returning individual microbiome-related findings could provide a powerful clinical tool for care management, but highlight the need for a more grounded understanding of contextual factors that may be unique to human microbiome research.ConclusionsWe revisit the ELSI of biobanking and consider the impact that human microbiome research might have. Our discussion focuses on identifiability of human microbiome research samples, and return of research results and incidental findings for clinical management. (shrink)

This article considers the issue of opacity as a problem for socially consequential mechanisms of classification and ranking, such as spam filters, credit card fraud detection, search engines, news trends, market segmentation and advertising, insurance or loan qualification, and credit scoring. These mechanisms of classification all frequently rely on computational algorithms, and in many cases on machine learning algorithms to do this work. In this article, I draw a distinction between three forms of opacity: opacity as intentional corporate or state (...) secrecy, opacity as technical illiteracy, and an opacity that arises from the characteristics of machine learning algorithms and the scale required to apply them usefully. The analysis in this article gets inside the algorithms themselves. I cite existing literatures in computer science, known industry practices, and do some testing and manipulation of code as a form of lightweight code audit. I argue that recognizing the distinct forms of opacity that may be coming into play in a given application is a key to determining which of a variety of technical and non-technical solutions could help to prevent harm. (shrink)

Brain-Computer Interface is a set of technologies that are of increasing interest to researchers. BCI has been proposed as assistive technology for individuals who are non-communicative or paralyzed, such as those with amyotrophic lateral sclerosis or spinal cord injury. The technology has also been suggested for enhancement and entertainment uses, and there are companies currently marketing BCI devices for those purposes as well as health-related purposes. The unprecedented direct connection created by BCI between human brains and computer hardware raises various (...) ethical, social, and legal challenges that merit further examination and discussion. To identify and characterize the key issues associated with BCI use, we performed a scoping review of biomedical ethics literature, analyzing the ethics concerns cited across multiple disciplines, including philosophy and medicine. Based on this investigation, we report that BCI research and its potential translation to therapeutic intervention generate significant ethical, legal, and social concerns, notably with regards to personhood, stigma, autonomy, privacy, research ethics, safety, responsibility, and justice. Our review of the literature determined, furthermore, that while these issues have been enumerated extensively, few concrete recommendations have been expressed. We conclude that future research should focus on remedying a lack of practical solutions to the ethical challenges of BCI, alongside the collection of empirical data on the perspectives of the public, BCI users, and BCI researchers. (shrink)