Artificial intelligence (AI) and robotics are digital technologies that will have significant impact on the development of humanity in the near future. They have raised fundamental questions about what we should do with these systems, what the systems themselves should do, what risks they involve, and how we can control these. - After the Introduction to the field (§1), the main themes (§2) of this article are: Ethical issues that arise with AI systems as objects, i.e., tools made and used (...) by humans. This includes issues of privacy (§2.1) and manipulation (§2.2), opacity (§2.3) and bias (§2.4), human-robot interaction (§2.5), employment (§2.6), and the effects of autonomy (§2.7). Then AI systems as subjects, i.e., ethics for the AI systems themselves in machine ethics (§2.8) and artificial moral agency (§2.9). Finally, the problem of a possible future AI superintelligence leading to a “singularity” (§2.10). We close with a remark on the vision of AI (§3). - For each section within these themes, we provide a general explanation of the ethical issues, outline existing positions and arguments, then analyse how these play out with current technologies and finally, what policy consequences may be drawn. (shrink)

Risk decisions often appear unsatisfactory after a calamity has taken place. This holds even when they are products of systematic risk analysis. Yet, if relevant considerations available to be known pre-accident were adequately taken into account and safety measures implemented accordingly, nobody seems morally blameworthy. In this paper, I advance a two-way argument. Firstly, I show how analysis of post-accident apologizing sheds new light on vexed tensions in ethical assessment of risk impositions. This amounts to exposing conflicting moral intuitions in (...) risk decisions, discussing problematic tenets in risk analysis as well as outlining three lines of arguments that destabilize the very notion of correct risk analysis. The analysis indicates that bringing different discussions of moral blameworthiness together facilitates resolving the tensions. It also calls for further and early-on collaboration between risk theorists and ethicists in order to carry these insights to risk analysis. Secondly, I argue that analysis of risk decisions, in part, reveals a discrepancy between the definitional work done on apology and what is required by ethics. Virtually every suggestion for the gold standard for apology involves moral blameworthiness as a necessary condition. I highlight different kinds of cases in which nobody is culpable, but an apology can be morally fitting or required. It would be nonsensical to say that, in these cases, one ought to apologize, but in a disingenuous manner. (shrink)

Philosophy of science has traditionally focused on the epistemological dimensions of scientific practice at the expense of the ethical and political questions scientists encounter when addressing questions of policy in advisory contexts. In this article, I will explore how an exclusive focus on epistemology and theoretical reason can function to reinforce common, yet flawed assumptions concerning the role of scientific knowledge in policy decision making when reproduced in philosophy courses for science students. In order to address this concern, I will (...) argue that such courses should supplement the traditional focus on theoretical reason with an analysis of the practical reasoning employed by scientists in advisory contexts. Later sections of this paper outline a teaching strategy by which this can be achieved that consists of two steps: the first examines idealized examples of scientific advising in order to highlight the irreducible role played by moral reasoning in justifying policy recommendations. The second employs argument analysis to reveal implicit moral assumptions in actual advisory reports that form the basis for class discussion. This paper concludes by examining some of the wider benefits that can be expected from adopting such an approach. (shrink)

Value sensitive design aims at creating better technology based on social and ethical values. However, VSD has not been applied to long-term and uncertain future developments, such as societal planning for climate change. This paper describes a new method that combines elements from VSD with scenario planning. The method was developed for and applied to a case study of adaptation to sea level rise in southern Sweden in a series of workshops. The participants of the workshops found that the method (...) provided a framework for discussing long-term planning, enabled identification of essential values, challenged established planning practices, helped find creative solutions, and served as a reminder that we do not know what will happen in the future. Finally, we reflect on the limitations of the method and suggest further research on how it can be improved for value sensitive design of adaptation measures to manage uncertain future sea level rise. (shrink)

Journal of Social Philosophy, EarlyView.

Much in Responsible Research and Innovation (RRI) is part of a participatory turn within the Technology Assessment (TA) and Science and Technology Studies (STS) community. This has an influence also on the evaluation of Climate Engineering (CE) options, as it will be shown by reference to the SPICE project. The SPICE example and the call for democratisation of science and innovation raise some interesting concerns for the normative evaluation of CE options that will be addressed in the paper. It is (...) by far not clear, or so it will be argued, how much of the innovation process of CE technologies should be put in the hands of social actors and the wider public. This is due not only to special features about CE technologies but also to some more principle concerns against some features of participatory RRI approaches. Still, this does by no way mean that ethical and societal issues in the context of CE technologies should be ignored. Rather, the paper will argue that one can take a step back to expert TA linked to the evolution of approaches of ethical impact analysis in this area. This does not only lead to reconsider the emphasis on participation and democratisation of research and innovation, but also opens up for an alternative evaluative framework for CE technologies developed in the last part of the paper. (shrink)

Many healthcare practices expose people to risks of harmful outcomes. However, the major theories of moral philosophy struggle to assess whether, when and why it is ethically justifiable to expose individuals to risks, as opposed to actually harming them. Sven Ove Hansson has proposed an approach to the ethical assessment of risk imposition that encourages attention to factors including questions of justice in the distribution of advantage and risk, people’s acceptance or otherwise of risks, and the scope individuals have to (...) influence the practices that generate risk. This paper investigates the ethical justifiability of preventive healthcare practices that expose people to risks including overdiagnosis. We applied Hansson’s framework to three such practices: an ‘ideal’ breast screening service, a commercial personal genome testing service, and a guideline that lowers the diagnostic threshold for hypertension. The framework was challenging to apply, not least because healthcare has unclear boundaries and involves highly complex practices. Nonetheless, the framework encouraged attention to issues that would be widely recognised as morally pertinent. Our assessment supports the view that at least some preventive healthcare practices that impose risks including that of overdiagnosis are not ethically justifiable. Further work is however needed to develop and/or test refined assessment criteria and guidance for applying them. (shrink)

Self-driving cars hold out the promise of being safer than manually driven cars. Yet they cannot be a 100 % safe. Collisions are sometimes unavoidable. So self-driving cars need to be programmed for how they should respond to scenarios where collisions are highly likely or unavoidable. The accident-scenarios self-driving cars might face have recently been likened to the key examples and dilemmas associated with the trolley problem. In this article, we critically examine this tempting analogy. We identify three important ways (...) in which the ethics of accident-algorithms for self-driving cars and the philosophy of the trolley problem differ from each other. These concern: the basic decision-making situation faced by those who decide how self-driving cars should be programmed to deal with accidents; moral and legal responsibility; and decision-making in the face of risks and uncertainty. In discussing these three areas of disanalogy, we isolate and identify a number of basic issues and complexities that arise within the ethics of the programming of self-driving cars. (shrink)

Human germline gene editing is often debated in hypothetical terms: if it were safe and efficient, on what further conditions would it then be ethically acceptable? This paper takes another course. The key question is: how can scientists reduce uncertainty about safety and efficiency to a level that may justify initiation of first-time clinical trials? The only way to proceed is by well-designed preclinical studies. However, what kinds of investigation should preclinical studies include and what specific conditions should they satisfy (...) in order to be considered well-designed? It is argued that multispecies and multigenerational animal studies are needed as well as human embryo editing without implantation. In order to be possible to translate to first-time clinical trials, animal studies need to satisfy strict conditions of validity. Moreover, embryo studies intended for translation to first-time clinical trials need to correspond to the animal studies in experimental design. Only in this way can uncertainty about risk for harm and prospect of benefit in first-time clinical trials be reduced to a modest level. If uncertainty is not reduced to such a level, first-time clinical trials in germline gene editing should not be initiated. (shrink)

This paper develops a philosophical account of moral disruption. According to Robert Baker, moral disruption is a process in which technological innovations undermine established moral norms without clearly leading to a new set of norms. Here I analyze this process in terms of moral uncertainty, formulating a philosophical account with two variants. On the harm account, such uncertainty is always harmful because it blocks our knowledge of our own and others’ moral obligations. On the qualified harm account, there is no (...) harm in cases where moral uncertainty is related to innovation that is “for the best” in historical perspective or where uncertainty is the expression of a deliberative virtue. The two accounts are compared by applying them to Baker’s historical case of the introduction of mechanical ventilation and organ transplantation technologies, as well as the present-day case of mass data practices in the health domain. (shrink)

So-called ‘existential risks’ present virtually unlimited reasons for probing them and responses to them further. The ensuing normative pull to respond to such risks thus seems to present us with r...

How cautious should regulators be? A standard answer is consequentialist: regulators should be just cautious enough to maximize expected social value. This paper charts the prospects of a nonconsequentialist - and more precautionary - alternative. More specifically, it argues that a contractualism focused on ex ante consent can motivate the following regulatory criterion: regulators should permit a socially beneficial risky activity only if no one can be expected to be made worse off by it. Broadly speaking, there are two strategies (...) regulators can use to help risky activities satisfy this criterion: regulators can mandate strict safety standards that protect those who would otherwise stand to lose, and they can require that some of the benefits of the activity be redirected to them. In developing these themes, the paper aims to provide a theoretical grounding for those who oppose using risk-cost-benefit analysis as the primary regulatory standard, and in particular, for advocates of the precautionary principle. (shrink)

This paper argues that some of the major theories in current business ethics fail to provide an adequate account of moral responsibility for the creation of systemic financial risk. Using the trading of credit default swaps during the 2008 financial crisis as a case study, I will formulate three challenges that these theories must address: the problem of risk imposition, the problem of unstructured collective harm and the problem of limited knowledge. These challenges will be used to work out key (...) shortcomings of stakeholder approaches and Integrative Social Contracts Theory. I will argue that pluralist connection models used in political theory can help to overcome these shortcomings. Adopting an approach based on these models shows that financial institutions incur obligations in five main areas: managing their own risk profile; remedying some of the harms caused by financial crises; supporting the development of better epistemic methods; curbing the transmission and amplification of initial losses; and instigating structural reforms. (shrink)

This paper discusses the ethical implications of perverse incentives with regard to autonomous driving. We define perverse incentives as a feature of an action, technology, or social policy that invites behavior which negates the primary goal of the actors initiating the action, introducing a certain technology, or implementing a social policy. As a special form of means-end-irrationality, perverse incentives are to be avoided from a prudential standpoint, as they prove to be directly self-defeating: They are not just a form of (...) unintended side effect that must be balanced against the main goal or value to be realized by an action, technology, or policy. Instead, they directly cause the primary goals of the actors—i.e., the goals that they ultimately pursue with the action, technology, or policy—to be “worse achieved”. In this paper, we elaborate on this definition and distinguish three ideal-typical phases of adverse incentives, where only in the last one the threshold for a perverse incentive is crossed. In addition, we discuss different possible relevant actors and their goals in implementing autonomous vehicles. We conclude that even if some actors do not pursue traffic safety as their primary goal, as part of a responsibility network they incur the responsibility to act on the common primary goal of the network, which we argue to be traffic safety. (shrink)

Standard tools used in societal risk management such as probabilistic risk analysis or cost–benefit analysis typically define risks in terms of only probabilities and consequences and assume a utilitarian approach to ethics that aims to maximize expected utility. The philosopher Carl F. Cranor has argued against this view by devising a list of plausible aspects of the acceptability of risks that points towards a non-consequentialist ethical theory of societal risk management. This paper revisits Cranor’s list to argue that the alternative (...) ethical theory responsibility-catering prioritarianism can accommodate the aspects identified by Cranor and that the elements in the list can be used to inform the details of how to view risks within this theory. An approach towards operationalizing the theory is proposed based on a prioritarian social welfare function that operates on responsibility-adjusted utilities. A responsibility-catering prioritarian ethical approach towards managing risks is a promising alternative to standard tools such as cost–benefit analysis. (shrink)

Many moral theories are committed to the idea that some kinds of moral considerations should be respected, whatever the cost to ‘lesser’ types of considerations. A person's life, for instance, should not be sacrificed for the trivial pleasures of others, no matter how many would benefit. However, according to the decision-theoretic critique of lexical priority theories, accepting lexical priorities inevitably leads us to make unacceptable decisions in risky situations. It seems that to operate in a risky world, we must reject (...) lexical priorities altogether. This paper argues that lexical priority theories can, in fact, offer satisfactory guidance in risky situations. It does so by equipping lexical priority theories with overlooked resources from decision theory. (shrink)

We address the moral importance of fish, invertebrates such as crustaceans, snails and insects, and other animals about which there is qualified scientific uncertainty about their sentience. We argue that, on a sentientist basis, one can at least say that how such animals fare make ethically significant claims on our character. It is a requirement of a morally decent person that she at least pays attention to and is cautious regarding the possibly morally relevant aspects of such animals. This involves (...) having a moral stance, in the sense of patterns of perception, such that one notices such animals as being morally relevant in various situations. For the person who does not already consider these animals in this way, this could be a big change in moral psychology, and can be assumed to have behavioural consequences, albeit indeterminate. Character has been largely neglected in the literature, which focuses on act-centred approaches. We see our character-centred approach as complementary to, not superior to, act-centred approaches. Our approach has the advantage of allowing us to make ethically interesting and practically relevant claims about a wider range of cases, but it has the drawback of providing less specific action guidance. (shrink)

In this paper I examine the prospects for a rights-based approach to the morality of pure risk-imposition. In particular, I discuss a practical challenge to proponents of the thesis that we have a right against being imposed a risk of harm. According to an influential criticism, a right against risk-imposition will rule out all ordinary activities. The paper examines two strategies that rights theorists may follow in response to this “Paralysis Problem”. The first strategy introduces a threshold for when a (...) risk-imposition is a rights violation. The second strategy drops the claim that rights are absolute and maintains that all rights infringements generate compensation duties. It is argued that both strategies face significant practical problems of their own and that the Paralysis Problem seems fatal for a right against risk-imposition in the absence of an adequate account of the morally relevant threshold risk. (shrink)

Volume 20, Issue 7, July 2020, Page 95-97.

Real-life decision-making often begins with a disorderly decision problem that has to be clarified and systematized before a decision can be made. This is the process of decision structuring that has largely been ignored both in decision theory and applied decision analysis. In this contribution, ten major components of decision structuring are identified, namely the determination of its scope, subdivision, agency, timing, options, control ascriptions, framing, horizon, criteria and restructuring. Four of these components, namely the scope, subdivision, options, and horizon (...) of a decision, are subjected to a more detailed analysis. (shrink)

Scientific evidence and scientific values under risk and uncertainty are strictly connected from the point of view of Peirce’s pragmaticism. In addition, economy and statistics play a key role in both choosing and testing hypotheses. Hence we may show also the connection between the methodology of the economy of research and statistical frequentism, both originating from pragmaticism. The connection is drawn by the regulative principles of synechism, tychism and uberty. These principles are values that have both epistemic and non-epistemic dimension. (...) They concern both the decisions to test a hypothesis as well as inductive risk. The validity of this result stems from the values cost–benefit analysis imposes on scientific inquiry. Values associated with the economy of research are important not only in the pre-test phases of generating hypotheses but also when hypotheses are effectively tested. Peirce took these economic considerations to leave room for an interpretation of probability which is not only a frequentist and propensity-theoretic but also a conceptualist one referring to degrees of belief. We show that this leeway nonetheless agrees with the theory of the economy of scientific methods. (shrink)

This paper explores the intertwining of uncertainty and values. We consider an important but underexplored field of fundamental uncertainty and values in decision-making. Some proposed methodologies to deal with fundamental uncertainty have included potential surprise theory, scenario planning and hypothetical retrospection. We focus on the principle of uncertainty transduction in hypothetical retrospection as an illustrative case of how values interact with fundamental uncertainty. We show that while uncertainty transduction appears intuitive in decision contexts it nevertheless fails in important ranges of (...) strategic game-theoretic cases. The methodological reasons behind the failure are then examined. (shrink)

Clinical equipoise has been proposed as an ethical principle relating uncertainty and moral leeway in clinical research. Although CE has traditionally been indicated as a necessary condition for a morally justified introduction of a new RCT, questions related to the interpretation of this principle remain woefully open. Recent proposals to rehabilitate CE have divided the bioethical community on its ethical merits. This paper presents a new argument that brings out the epistemological difficulties we encounter in justifying CE as a principle (...) to connect uncertainty and moral leeway in clinical ethics. The argument proposes, first, that the methodology of hypothetical retrospection is applicable to the RCT design and that it can accommodate uncertainty. As currently understood, however, HR should give up its reliance on the assumption of uncertainty transduction, because the latter assumes the principle of indifference, which does not accommodate uncertainty in the right way. The same principle is then seen to distort also the received interpretations of CE. (shrink)

In this paper, we argue that solutions to normative challenges associated with autonomous driving, such as real-world trolley cases or distributions of risk in mundane driving situations, face the problem of reasonable pluralism: Reasonable pluralism refers to the fact that there exists a plurality of reasonable yet incompatible comprehensive moral doctrines within liberal democracies. The corresponding problem is that a politically acceptable solution cannot refer to only one of these comprehensive doctrines. Yet a politically adequate solution to the normative challenges (...) of autonomous driving need not come at the expense of an ethical solution, if it is based on moral beliefs that are (1) shared in an overlapping consensus and (2) systematized through public reason. Therefore, we argue that a Rawlsian justificatory framework is able to adequately address the normative challenges of autonomous driving and elaborate on how such a framework might be employed for this purpose. (shrink)

Graphene is a nanomaterial with many promising and innovative applications, yet early studies indicate that graphene may pose risks to humans and the environment. According to ideas of responsible research and innovation, all relevant actors should strive to reduce risks related to technological innovations. Through semi-structured interviews, we investigated the idea of graphene as a risk held by two types of key actors: graphene researchers and innovation advisors at universities, where the latter are facilitating the movement of graphene from the (...) laboratory to the marketplace. The most common idea found is that graphene is not a risk due to, e.g., low toxicity, low amounts produced/used, and its similarity to harmless materials. However, some researchers and advisors also say that graphene is a risk, e.g., under certain conditions or due to a lack of risk-related information. We explain the co-existence of these seemingly contradictory ideas through the semantic ambiguity of the word risk and a risk/no-risk rhetoric, where risks are mentioned rhetorically only to be disregarded as manageable or negligible. We suggest that some of the ideas held by the researchers and innovation advisors constitute a challenge to responsible research and innovation regarding graphene. At the same time, we acknowledge the dilemma that the discourse of responsible innovation creates for the actors: denying graphene risks makes them irresponsible due to a lack of risk awareness, while affirming graphene risks makes them irresponsible due to their everyday engagement in graphene development. We therefore recommend more research into what researchers and innovation advisors should do in practice in order to qualify as responsible. (shrink)

Law is often linked to ethics and morality. Regulations of genetically modified organisms ensue from a discussion on how well the law is composed to accommodate ethical considerations. The precautionary principle and biotechnology have undeniable moral connotations. Besides, the principle has socio-economic implications. The application of the precautionary principle in plant breeding should be legally justified on the basis of the best available evidence. On the other hand, scientific information cannot provide all the necessary information on which a risk management (...) decision should be based. This article addresses the issue of gap between science, ethics, and socio-economic considerations related to the cultivation and authorisation of GM crops. (shrink)

This review provides an overview of the ethics of extinctions with a focus on the Western analytical environmental ethics literature. It thereby gives special attention to the possible philosophical grounds for Michael Soulé’s assertion that the untimely ‘extinction of populations and species is bad’. Illustrating such debates in environmental ethics, the guiding question for this review concerns why – or when – anthropogenic extinctions are bad or wrong, which also includes the question of when that might not be the case (...) (i.e. which extinctions are even desirable). After providing an explanation of the disciplinary perspective taken (section “Introduction”), the concept of extinction and its history within that literature are introduced (section “Understanding extinction”). Then, in section “Why (or when) might anthropogenic extinctions be morally problematic?”, different reasons for why anthropogenic extinctions might be morally problematic are presented based on the loss of species’ value, harm to nonhuman individuals, the loss of valuable biological variety and duties to future generations. This section concludes by also considering cases where anthropogenic extinctions might be justified. Section “How to respond to extinctions?” then addresses a selection of topics concerning risks and de-extinction technologies. Finally, the section on “Extinction studies” introduces other viewpoints on the ethics of extinction from the extinction studies literature, followed by the “Conclusion”. (shrink)