In response to the many social impacts of automated mobility, in September 2020 the European Commission published Ethics of Connected and Automated Vehicles, a report in which recommendations on road safety, privacy, fairness, explainability, and responsibility are drawn from a set of eight overarching principles. This paper presents the results of an interdisciplinary research where philosophers and engineers joined efforts to operationalize the guidelines advanced in the report. To this aim, we endorse a function-based working approach (...) to support the implementation of values and recommendations into the design of automated vehicle technologies. Based on this, we develop methodological tools to tackle issues related to personal autonomy, explainability, and privacy as domains that most urgently require fine-grained guidance due to the associated ethical risks. Even though each tool still requires further inquiry, we believe that our work might already prove the productivity of the function-based approach and foster its adoption in the CAV scientific community. (shrink)

This book reports on theoretical and practical analyses of the ethical challenges connected to driving automation. It also aims at discussing issues that have arisen from the European Commission 2020 report “Ethics of Connected and Automated Vehicles. Recommendations on Road Safety, Privacy, Fairness, Explainability and Responsibility”. Gathering contributions by philosophers, social scientists, mechanical engineers, and UI designers, the book discusses key ethical concerns relating to responsibility and personal autonomy, privacy, safety, and cybersecurity, as well as explainability (...) and human-machine interaction. On the one hand, it examines these issues from a theoretical, normative point of view. On the other hand, it proposes practical strategies to face the most urgent ethical problems, showing how the integration of ethics and technology can be achieved through design practices. All in all, this book fosters a multidisciplinary approach where philosophy, ethics, and engineering are integrated, rather than just juxtaposed. It is meant to inform and inspire an audience of philosophers of technology, ethicists, engineers, developers, manufacturers, and regulators, among other interested readers. (shrink)

The paper has two goals. The first is presenting the main results of the recent report Ethics of Connected and Automated Vehicles: recommendations on road safety, privacy, fairness, explainability and responsibility written by the Horizon 2020 European Commission Expert Group to advise on specific ethical issues raised by driverless mobility, of which the author of this paper has been member and rapporteur. The second is presenting some broader ethical and philosophical implications of these recommendations, and using these (...) to contribute to the establishment of Ethics of Transportation as an independent branch of applied ethics. The recent debate on the ethics of Connected and Automated Vehicles presents a paradox and an opportunity. The paradox is the presence of a flourishing debate on the ethics of one very specific transportation technology without ethics of transportation being in itself a well-established academic discipline. The opportunity is that now that a spotlight has been switched on the ethical dimensions of CAVs it may be easier to establish a broader debate on ethics of transportation. While the 20 recommendations of the EU report are grouped in three macro-areas: road safety, data ethics, and responsibility, in this paper they will be grouped according to eight philosophical themes: Responsible Innovation, road justice, road safety, freedom, human control, privacy, data fairness, responsibility. These are proposed as the first topics for a new ethics of transportation. (shrink)

We address the considerations of the European Commission Expert Group on the ethics of connected and automated vehicles regarding data provision in the event of collisions. While human drivers’ appropriate post-collision behavior is clearly defined, regulations for automated driving do not provide for collision detection. We agree it is important to systematically incorporate citizens’ intuitions into the discourse on the ethics of automated vehicles. Therefore, we investigate whether people expect automated vehicles to (...) behave like humans after an accident, even if this behavior does not directly affect the consequences of the accident. We find that appropriate post-collision behavior substantially influences people’s evaluation of the underlying crash scenario. Moreover, people clearly think that automated vehicles can and should record the accident, stop at the site, and call the police. They are even willing to pay for technological features that enable post-collision behavior. Our study might begin a research program on post-collision behavior, enriching the empirically informed study of automated driving ethics that so far exclusively focuses on pre-collision behavior. (shrink)

In this paper, we explore and describe what is needed to allow connected and automated vehicles to break traffic rules in order to minimise road safety risk and to operate with appropriate transparency. Reviewing current traffic rules with particular reference to two driving situations, we illustrate why current traffic rules are not suitable for CAVs and why making new traffic rules specifically for CAVs would be inappropriate. In defining an alternative approach to achieving safe CAV driving behaviours, (...) we describe the use of ethical goal functions as part of hybrid AI systems, suggesting that functions should be defined by governmental bodies with input from citizens and stakeholders. Ethical goal functions for CAVs would enable developers to optimise driving behaviours for safety under conditions of uncertainty whilst allowing for differentiation of products according to brand values. Such functions can differ between regions according to preferences for safety behaviours within that region and can be updated over time, responding to continual socio-technological feedback loops. We conclude that defining ethical goal functions is an urgent and necessary step from governmental bodies to enable the safe and transparent operation of CAVs and accelerate the reduction in road casualties they promise to achieve. (shrink)

This book offers a systematic and thorough philosophical analysis of the ways in which driving automation crosses path with ethical values. Upon introducing the different forms of driving automation and examining their relation to human autonomy, it provides readers with in-depth reflections on safety, privacy, moral judgment, control, responsibility, sustainability, and other ethical issues. Driving is undoubtedly a moral activity as a human act. Transferring it to artificial agents such as connected and automated vehicles necessarily raises many (...) philosophical questions. When driving is automated, what happens to its ethical dimensions? Could artificial agents accomplish ethical objectives on our behalf, take moral decisions in our place, and drive us into a more ethical transportation future? In doing so, would they be “moral” as we are or in a way that is similar to, but also remarkably different from, our own? And what role is yet to be played by human responsibility and commitment? The book addresses these questions with the aim of stimulating an interdisciplinary dialogue between different stakeholders. They include automotive engineers, computer scientists, and moral philosophers, as well as industry representatives, policymakers, regulators, transportation experts, and the general public. Indeed, connected and automated vehicles will not take the high road for us . We must drive them there. (shrink)

The present paper aims at contributing to the ethical debate on the impacts of artificial intelligence (AI) systems on human autonomy. More specifically, it intends to offer a clearer understanding of the design challenges to the effort of aligning driving automation technologies to this ethical value. After introducing the discussion on the ambiguous impacts that AI systems exert on human autonomy, the analysis zooms in on how the problem has been discussed in the literature on connected and automated (...) vehicles (CAVs). On this basis, it is claimed that the issue has been mainly tackled on a fairly general level, and mostly with reference to the controversial issue of crash-optimization algorithms, so that only limited design insights have been drawn. However, integrating ethical analysis and design practices is critical to pursue the implementation of such an important ethical value into CAV technologies. To this aim, it is argued, a more applied approach targeted at examining the impacts on human autonomy of current CAV functions should also be explored. As an example of the intricacy of this task, the case of automated route planning is discussed in some detail. (shrink)

The present paper aims at contributing to the ethical debate on the impacts of artificial intelligence (AI) systems on human autonomy. More specifically, it intends to offer a clearer understanding of the design challenges to the effort of aligning driving automation technologies to this ethical value. After introducing the discussion on the ambiguous impacts that AI systems exert on human autonomy, the analysis zooms in on how the problem has been discussed in the literature on connected and automated (...) vehicles (CAVs). On this basis, it is claimed that the issue has been mainly tackled on a fairly general level, and mostly with reference to the controversial issue of crash-optimization algorithms, so that only limited design insights have been drawn. However, integrating ethical analysis and design practices is critical to pursue the implementation of such an important ethical value into CAV technologies. To this aim, it is argued, a more applied approach targeted at examining the impacts on human autonomy of current CAV functions should also be explored. As an example of the intricacy of this task, the case of automated route planning is discussed in some detail. (shrink)

The present paper aims at contributing to the ethical debate on the impacts of artificial intelligence (AI) systems on human autonomy. More specifically, it intends to offer a clearer understanding of the design challenges to the effort of aligning driving automation technologies to this ethical value. After introducing the discussion on the ambiguous impacts that AI systems exert on human autonomy, the analysis zooms in on how the problem has been discussed in the literature on connected and automated (...) vehicles (CAVs). On this basis, it is claimed that the issue has been mainly tackled on a fairly general level, and mostly with reference to the controversial issue of crash-optimization algorithms, so that only limited design insights have been drawn. However, integrating ethical analysis and design practices is critical to pursue the implementation of such an important ethical value into CAV technologies. To this aim, it is argued, a more applied approach targeted at examining the impacts on human autonomy of current CAV functions should also be explored. As an example of the intricacy of this task, the case of automated route planning is discussed in some detail. (shrink)

Over the past decade, unmanned aerial vehicles (UAVs) have received increasing attention and are being used in the areas of harvesting, videotaping, and the military industry. In this article, the consideration is focused on areas where video recording is required for ground inspections. This paper describes modern communication technologies and systems that enable interaction and data exchange between UAVs and a ground control station (GCS). This article focuses on different architectures of communication systems, establishing the characteristics of each to (...) identify the preferred architecture that does not require a significant consumption of resources and whose data transmission is reliable. A coherent architecture that includes multiple UAVs, wireless sensor networks, cellular networks, GCSs, and satellite network to duplicate communications for enhanced system security has been offered. Some reliability problems have been discussed, the solution of which was suggested to be a backup connection via satellite, i.e., a second connection. This study focused not only on the communication channels but also on the data exchanged between system components, indicating the purpose of their application. Some of the communication problems and shortcomings of various systems, as well as further focus areas and improvement recommendations were discussed. (shrink)

Cooperative, connected and automated mobility technologies have the potential to revolutionize transportation systems and enhance safety, efficiency and sustainability. However, the increasing reliance on digital technologies also introduces new cybersecurity risks that can compromise the safety and privacy of passengers and the integrity of transportation systems. The purpose of this article is to examine the most important threats, vulnerabilities, risks and challenges related to automated mobility and to review the status of the most promising standardization initiatives on (...) cryptography in a world where quantum computers will soon represent an actual threat. (shrink)

The ethics of autonomous cars and automated driving have been a subject of discussion in research for a number of years :28–58, 2016). As levels of automation progress, with partially automated driving already becoming standard in new cars from a number of manufacturers, the question of ethical and legal standards becomes virulent. For exam-ple, while automated and autonomous cars, being equipped with appropriate detection sensors, processors, and intelligent mapping material, have a chance of being much safer than (...) human-driven cars in many regards, situations will arise in which accidents cannot be completely avoided. Such situations will have to be dealt with when programming the software of these vehicles. In several instances, internationally, regulations have been passed, based on legal considerations of road safety, mostly. However, to date, there have been few, if any, cases of a broader ethics code for autonomous or automated driving preceding actual regulation and being based on a broadly composed ethics committee of independent experts. In July 2016, the German Federal Minister of Transport and Digital Infrastructure, Alexander Dobrindt, appointed a national ethics committee for automated and connected driving, which began its work in September 2016. In June 2017, this committee presented a code of ethics which was published in German and in English. It consists of 20 ethical guidelines. Having been a member of this committee, I will present the main ethical topics of these guidelines and the discussions that lay behind them. (shrink)

Despite numerous ethical examinations of automated vehicles, philosophers have neglected to address how these technologies will affect vulnerable people. To account for this lacuna, researchers must analyze how driverless cars could hinder or help social justice. In addition to thinking through these aspects, scholars must also pay attention to the extensive moral dimensions of automated vehicles, including how they will affect the public, nonhumans, future generations, and culturally significant artifacts. If planners and engineers undertake this task, (...) then they will have to prioritize their efforts to avoid additional harm. The author shows how employing an approach called a “complex moral assessment” can help professionals implement these technologies into existing mobility systems in a just and moral fashion. (shrink)

The automobile is a tool like no other. There is much excitement and enthusiasm for new and emerging transportation tools such as vehicle automation and driver assistance systems. Although there are high hopes for these technologies, there are many unknowns including the extent to which these new transportation tools can realistically and reliably improve driver safety and affect the subjective driving experience. This paper explores these questions in the context of evaluating collision warning systems on the behavior and perceptions of (...) drivers with different amounts of experience and places the results in the greater context of tool use and skilled learning focusing on the adoption and utilization of mental models. (shrink)

In this paper we focus on how automated vehicles can reduce the number of deaths and injuries in accident situations in order to protect public health. This is actually a problem not only of public health and ethics, but also of big data—not only in terms of all the different data that could be used to inform such decisions, but also in the sense of deciding how wide the scope of data should be. We identify three key different (...) types of data, including basic data, advanced data and preference data, provide an ethical analysis of the use of these different types of data and of different ways of prioritizing between pedestrians and passengers, and propose four rules that can help set ethical priorities for ethical data use and decision making by automated vehicles. (shrink)

How should automated vehicles react in emergency circumstances? Most research projects and scientific literature deal with this question from a moral perspective. In particular, it is customary to treat emergencies involving AVs as instances of moral dilemmas and to use the trolley problem as a framework to address such alleged dilemmas. Some critics have pointed out some shortcomings of this strategy and have urged to focus on mundane traffic situations instead of trolley cases involving AVs. Besides, these authors (...) rightly point out the political nature of the most interesting debates involving AVs. However, in our view, they do not offer an adequate account of the distinction between ethics and politics and still see their proposals as contributions to the ethics of AVs. We argue that many of the interesting questions about how AVs should behave, both in emergency and other situations, are of political, and not moral, nature. This view is based on a conception of politics and political normativity that we have developed elsewhere and that we call “political minimalism.” Additionally, we show that this proposed perspective has significant consequences for the design, management, and regulation of transport systems. (shrink)

Are automated vehicles really safer than manually driven vehicles? If so, how would we know? Answering this question has spurred a contentious debate. Unfortunately, several issues make answering this question difficult for the foreseeable future. First, how do we measure safety? Second, how can we keep track of automated vehicle safety? Finally, how do we determine what is or what is not an AV? Until these questions are addressed, it will continue to be difficult to determine (...) whether or when AVs might really be safer than manually driven vehicles. (shrink)

In this paper, I will argue that automated vehicles should not swerve to avoid a person or vehicle in its path, unless they can do so without imposing risks onto others. I will argue that this is the conclusion that we should reach even if we start by assuming that we should divert the trolley in the standard trolley case. In defence of this claim, I appeal to the distribution of moral and legal responsibilities, highlighting the importance of (...) safe spaces, and arguing in favour of constraints on what can be done to minimise casualties. My arguments draw on the methodology associated with the trolley problem. As such, this paper also defends this methodology, highlighting a number of ways in which authors misunderstand and misrepresent the trolley problem. For example, the ‘trolley problem’ is not the ‘name given by philosophers to classic examples of unavoidable crash scenarios, historically involving runaway trolleys’, as Millar suggests, and trolley cases should not be compared with ‘model building in the sciences’, as Gogoll and Müller suggest. Trolley cases have more in common with lab experiments than model building, and the problem referred to in the trolley problem is not the problem of deciding what to do in any one case. Rather, it refers to the problem of explaining what appear to be conflicting intuitions when we consider two cases together. The problem, for example, could be: how do we justify the claim that automated vehicles should not swerve even if we accept the claim that we should divert the trolley in an apparently similar trolley case? (shrink)

Fully automated vehicles (AVs) hold promise toward providing numerous societal benefits including reducing road fatalities. However, we are uncertain about how individuals’ perceptions will influence their ability to accept and adopt AVs. The 28-item Automated Vehicle User Perception Survey (AVUPS) is a visual analog scale that was previously constructed, with established face and content validity, to assess individuals’ perceptions of AVs. In this study, we examined construct validity, via exploratory factor analysis and subsequent Mokken scale analyses. Next, (...) internal consistency was assessed via Cronbach’s alpha (α) and 2-week test–retest reliability was assessed via Spearman’s rho (ρ) and intraclass correlation coefficient (ICC). The Mokken scale analyses resulted in a refined 20-item AVUPS and three Mokken subscales assessing specific domains of adults’ perceptions of AVs: (a)Intention to use; (b)perceived barriers; and (c)well-being. The Mokken scale analysis showed that all item-coefficients of homogeneity (H) exceeded 0.3, indicating that the items reflect a single latent variable. The AVUPS indicated a strong Mokken scale (Hscale= 0.51) with excellent internal consistency (α = 0.95) and test–retest reliability (ρ = 0.76, ICC = 0.95). Similarly, the three Mokken subscales ranged from moderate to strong (rangeHscale= 0.47–0.66) and had excellent internal consistency (range α = 0.84–0.94) and test–retest reliability (range ICC = 0.84–0.93). The AVUPS and three Mokken subscales of AV acceptance were validated in a moderate sample size (N= 312) of adults living in the United States. Two-week test–retest reliability was established using a subset of Amazon Mechanical Turk participants (N= 84). The AVUPS, or any combination of the three subscales, can be used to validly and reliably assess adults’ perceptions before and after being exposed to AVs. The AVUPS can be used to quantify adults’ acceptance of fully AVs. (shrink)

Accidents involving autonomous vehicles raise difficult ethical dilemmas and legal issues. It has been argued that self-driving cars should be programmed to kill, that is, they should be equipped with pre-programmed approaches to the choice of what lives to sacrifice when losses are inevitable. Here we shall explore a different approach, namely, giving the user/passenger the task of deciding what ethical approach should be taken by AVs in unavoidable accident scenarios. We thus assume that AVs are equipped with what (...) we call an “Ethical Knob”, a device enabling passengers to ethically customise their AVs, namely, to choose between different settings corresponding to different moral approaches or principles. Accordingly, AVs would be entrusted with implementing users’ ethical choices, while manufacturers/programmers would be tasked with enabling the user’s choice and ensuring implementation by the AV. (shrink)

In recent years, philosophical examinations of automated vehicles have progressed far beyond initial concerns over the ethical decisions that pertain to programming in the event of a crash. In turn, this paper moves in that direction, focusing on the motivations behind efforts to implement driverless vehicles into urban settings. The author argues that the many perceived benefits of these technologies yield a received view of automated vehicles. This position holds that driverless vehicles can solve (...) most if not all urban mobility issues. However, the problem with such an outlook is that it lends itself to transportation planning for automated vehicles, rather than using them as part of planning efforts that could serve urban mobility. Due to this condition, present efforts aimed at improving transportation systems should resist dogmatic thinking. Instead, they should focus on goals that keep topics such a human flourishing, sustainability, and transportation justice firmly in view. (shrink)

Automated Vehicles (AVs) are designed and programmed to follow traffic rules. However, there is no separate and comprehensive regulatory framework dedicated to AVs. The current Queensland traffic rules were designed for humans. These rules often contain open texture expressions, exceptions, and potential conflicts (conflict arises when exceptions cannot be handled in rules), which makes it hard for AVs to follow. This paper presents an automatic compliance checking framework to assess AVs behaviour against current traffic rules by addressing these (...) issues. Specifically, it proposes a framework to determine which traffic rules and open texture expressions need some additional interpretation. Essentially this enables AVs to have a suitable and executable formalization of the traffic rules. Defeasible Deontic Logic (DDL) is used to formalize traffic rules and reasoning with AV information (behaviour and environment). The representation of rules in DDL helps effectively in handling and resolving exceptions, potential conflicts, and open textures in rules. 40 experiments were conducted on eight realistic traffic scenarios to evaluate the framework. The evaluation was undertaken both quantitatively and qualitatively. The evaluation result shows that the proposed framework is a promising system for checking Automated Vehicle interpretation and compliance with current traffic rules. (shrink)

This article takes a speculative and design fiction approach to the critical analysis of the role of smart and autonomous vehicles (AVs) in the context of smart cities. The article explores arguments that these cars of the future will have decisive impacts on mobility, sustainability and road safety. The article examines the main parameters of smart city and smart car developments and then focuses on the visions of increasing AI-driven autonomy. The article demonstrates how these debates are linked to (...) speculative design as full autonomy does not currently exist but takes a speculative position as to what the critical issues are that face smart/autonomous city visions (enhanced surveillance and data mining) and considers the potentially hazardous ethical dilemmas that AVs may encounter once fully rolled out onto city roads. From a design fiction perspective, the article envisions the viability of AV prioritizing public rather than private transport as a means by which the ‘techno-utopic’ visions of smart city/AV integration can be realized and make positive impacts to enhance urban living in rendering future cities as more sustainable, efficiently mobile and safer urban spaces. (shrink)

With the advent of automated decision-making, governments have increasingly begun to rely on artificially intelligent algorithms to inform policy decisions across a range of domains of government interest and influence. The practice has not gone unnoticed among philosophers, worried about “algocracy”, and its ethical and political impacts. One of the chief issues of ethical and political significance raised by algocratic governance, so the argument goes, is the lack of transparency of algorithms. One of the best-known examples of philosophical analyses (...) of algocracy is John Danaher’s “The threat of algocracy”, arguing that government by algorithm undermines political legitimacy. In this paper, I will treat Danaher’s argument as a springboard for raising additional questions about the connections between algocracy, comprehensibility, and legitimacy, especially in light of empirical results about what we can expect the voters and policymakers to know. The paper has the following structure: in Sect. 2, I introduce the basics of Danaher’s argument regarding algocracy. In Sect. 3 I argue that the algocratic threat to legitimacy has troubling implications for social justice. In Sect. 4, I argue that, nevertheless, there seem to be good reasons for governments to rely on algorithmic decision support systems. Lastly, I try to resolve the apparent tension between the findings of the two preceding Sections. (shrink)

This paper argues against the view that trolley cases are of little or no relevance to the ethics of automated vehicles. Four arguments for this view are outlined and rejected: the Not Going to Happen Argument, the Moral Difference Argument, the Impossible Deliberation Argument and the Wrong Question Argument. In making clear where these arguments go wrong, a positive account is developed of how trolley cases can inform the ethics of automated vehicles.

In this paper, in line with the general framework of value-sensitive design, we aim to operationalize the general concept of “Meaningful Human Control” in order to pave the way for its translation into more specific design requirements. In particular, we focus on the operationalization of the first of the two conditions investigated: the so-called ‘tracking’ condition. Our investigation is led in relation to one specific subcase of automated system: dual-mode driving systems. First, we connect and compare meaningful human control (...) with a concept of control very popular in engineering and traffic psychology, and we explain to what extent tracking resembles and differs from it. This will help clarifying the extent to which the idea of meaningful human control is connected to, but also goes beyond, current notions of control in engineering and psychology. Second, we take the systematic analysis of practical reasoning as traditionally presented in the philosophy of human action and we adapt it to offer a general framework where different types of reasons and agents are identified according to their relation to an automated system’s behaviour. This framework is meant to help explaining what reasons and what agents play a role in controlling a given system, thereby enabling policy makers to produce usable guidelines and engineers to design systems that properly respond to selected human reasons. In the final part, we discuss a practical example of how our framework could be employed in designing automated driving systems. (shrink)

Following societal and policy pressures for responsible innovation, innovators are more and more expected to consider the broader socio-ethical context of their work, and more importantly, to integrate such considerations into their daily practices. This may require the involvement of ‘outsiders’ in innovation trajectories, including e.g. societal and governmental actors. However, methods on how to functionally organize such integration in light of responsible innovation have only recently started to emerge. We present an approach to do just that, in which we (...) first develop value profiles of the involved actors, and second, design a workshop setting that allows innovators to develop design requirements in collaboration with representatives of parties that are not usually involved in such innovation design practices. Using a case study in automated vehicle development, we positively demonstrate the possibility and utility of our approach. We stress that in this study we wish to demonstrate the functionality of our developed method, and did not search for scientifically valid outcomes regarding this technical field. (shrink)

Automated vehicles (AVs) are expected to operate on public roads, together with non-automated vehicles and other road users such as pedestrians or bicycles. Recent ethical reports and guidelines raise worries that AVs will introduce injustice or reinforce existing social inequalities in road traffic. One major injustice concern in today’s traffic is that different types of road users are exposed differently to risks of corporal harm. In the first part of the paper, we discuss the responsibility of (...) AV developers to address existing injustice concerns regarding risk exposure as well as approaches on how to fulfill the responsibility for a fairer distribution of risk. In contrast to popular approaches on the ethics of risk distribution in unavoidable accident cases, we focus on low and moderate risk situations, referred to as routine driving. For routine driving, the obligation to distribute risks fairly must be discussed in the context of risk-taking and risk-acceptance, balancing safety objectives of occupants and other road users with driving utility. In the second part of the paper, we present a typical architecture for decentralized automated driving which contains a dedicated module for real-time risk estimation and management. We examine how risk estimation modules can be adjusted and parameterized to redress some inequalities. (shrink)

Following societal and policy pressures for responsible innovation, innovators are more and more expected to consider the broader socio-ethical context of their work, and more importantly, to integrate such considerations into their daily practices. This may require the involvement of ‘outsiders’ in innovation trajectories, including e.g. societal and governmental actors. However, methods on how to functionally organize such integration in light of responsible innovation have only recently started to emerge. We present an approach to do just that, in which we (...) first develop value profiles of the involved actors, and second, design a workshop setting that allows innovators to develop design requirements in collaboration with representatives of parties that are not usually involved in such innovation design practices. Using a case study in automated vehicle development, we positively demonstrate the possibility and utility of our approach. We stress that in this study we wish to demonstrate the functionality of our developed method, and did not search for scientifically valid outcomes regarding this technical field. (shrink)

Future automated vehicles of different sizes will share the same space with other road users, e. g., pedestrians. For a safe interaction, successful communication needs to be ensured, in particular, with vulnerable road users, such as pedestrians. Two possible communication means exist for AVs: vehicle kinematics for implicit communication and external human-machine interfaces for explicit communication. However, the exact interplay is not sufficiently studied yet for pedestrians' interactions with AVs. Additionally, very few other studies focused on the interplay (...) of vehicle kinematics and eHMI for pedestrians' interaction with differently sized AVs, although the precise coordination is decisive to support the communication with pedestrians. Therefore, this study focused on how the interplay of vehicle kinematics and eHMI affects pedestrians' willingness to cross, trust and perceived safety for the interaction with two differently sized AVs. In this experimental online study, the participants interacted with the AVs in a shared space. Both AVs were equipped with a 360° LED light-band eHMI attached to the outer vehicle body. Three eHMI statuses were displayed. The vehicle kinematics were varied at two levels. Moreover, “non-matching” conditions were included for both AVs in which the dynamic eHMI falsely communicated a yielding intent although the vehicle did not yield. Overall, results showed that pedestrians' willingness to cross was significantly higher for the smaller AV compared to the larger AV. Regarding the interplay of vehicle kinematics and eHMI, results indicated that a dynamic eHMI increased pedestrians' perceived safety when the vehicle yielded. When the vehicle did not yield, pedestrians' perceived safety still increased for the dynamic eHMI compared to the static eHMI and no eHMI. The findings of this study demonstrated possible negative effects of eHMIs when they did not match the vehicle kinematics. Further implications for a holistic communication strategy for differently sized AVs will be discussed. (shrink)

A human driver and an automated driving system might share control of automated vehicles in the near future. This raises many concerns associated with the assignment of responsibility for negative outcomes caused by them; one is that the human driver might be required to bear the brunt of moral and legal responsibilities. The psychological consequences of responsibility misattribution have not yet been examined. We designed a hypothetical crash similar to Uber’s 2018 fatal crash. We incorporated five legal (...) responsibility attributions. Participants chose their preferred liability attribution and then were randomly assigned into one of the five actual liability attribution conditions. They then responded to a series of questions concerning liability assignment, the crash, and AVs. Slightly more than 50% of participants thought that the human driver should bear full or primary liability. Legal responsibility misattribution negatively influenced these mentioned responses, regardless of overly attributing human or manufacturer liability. Overly attributing human liability had more negative influences. Improper liability attribution might hinder the adoption of AVs. Public opinion should not be ignored in developing a legal framework for AVs. (shrink)

The aim of this essay is to examine the long-term evolution of the material reproductive vehicles of society. The fairly continuous trend of economic integration and progressive enfranchisement of the world’s people is indicated, ascertainable even with the emergence from general slavery of ancient times, through feudalism to the modern stage of industrialism and widespread national sovereignties. With greater political expression has come higher degrees and penetration of economic prosperity. Both vicious and virtuous tendencies of automation are considered. The (...) necessary foundation of living labor is recognized. (shrink)

In the near future, vehicles will gradually gain more autonomous functionalities. Drivers’ activity will be less about driving than about monitoring intelligent systems to which driving action will be delegated. Road safety, therefore, remains dependent on the human factor and we should identify the limits beyond which driver’s functional state (DFS) may no longer be able to ensure safety. Depending on the level of automation, estimating the DFS may have different targets, e.g. assessing driver’s situation awareness in lower levels (...) of automation and his ability to respond to emerging hazard or assessing driver’s ability to monitor the vehicle performing operational tasks in higher levels of automation. Unfitted DFS (e.g., drowsiness) may impact the driver ability respond to taking over abilities. This paper reviews the most appropriate psychophysiological indices in naturalistic driving while considering the DFS through exogenous sensors, providing the more efficient trade-off between reliability and intrusiveness. The DFS also originates from kinematic data of the vehicle, thus providing information that indirectly relates to drivers behaviour. The whole data should be synchronously processed, providing a diagnosis on the DFS, and bringing it to the attention of the decision maker in real time. Next, making the information available can be permanent or intermittent (or even undelivered), and may also depend on the automation level. Such interface can include recommendations for decision support or simply give neutral instruction. Mapping of relevant psychophysiological and behavioural indicators for DFS will enable practitioners and researchers provide reliable estimates, fitted to the level of automation. (shrink)

A self-fulfilling prophecy is, roughly, a prediction that brings about its own truth. Although true predictions are hard to fault, self-fulfilling prophecies are often regarded with suspicion. In this article, we vindicate this suspicion by explaining what self-fulfilling prophecies are and what is problematic about them, paying special attention to how their problems are exacerbated through automated prediction. Our descriptive account of self-fulfilling prophecies articulates the four elements that define them. Based on this account, we begin our critique by (...) showing that typical self-fulfilling prophecies arise due to mistakes about the relationship between a prediction and its object. Such mistakes—along with other mistakes in predicting or in the larger practical endeavor—are easily overlooked when the predictions turn out true. Thus we note that self-fulfilling prophecies prompt no error signals; truth shrouds their mistakes from humans and machines alike. Consequently, self-fulfilling prophecies create several obstacles to accountability for the outcomes they produce. We conclude our critique by showing how failures of accountability, and the associated failures to make corrections, explain the connection between self-fulfilling prophecies and feedback loops. By analyzing the complex relationships between accuracy and other evaluatively significant features of predictions, this article sheds light both on the special case of self-fulfilling prophecies and on the ethics of prediction more generally. (shrink)

Automated vehicles promise much in the way of both economic boons and increased personal safety. For better or worse, the effects of automating personal vehicles will not be felt for some time. In contrast, the effects of automated work vehicles, like semi-trucks, will be felt much sooner—within the next decade. The costs and benefits of automation will not be distributed evenly; while most of us will be positively affected by the lower prices overall, those losing (...) their livelihoods to the automated semi-trucks and other similar work vehicles will be much worse off. This sets up a classic distributive justice problem: how do we balance the harms and benefits of automation? In this paper, the authors recommend work alternatives: policies that the government would enact in order to ensure that each person could live a decent life even if one could not work, especially for reasons like having one’s job automated. After arguing for this position, we propose some policy guidelines. (shrink)

Various methods have been employed to investigate different aspects of the brain activity modulation related to the performance of a cycling task. In our study we examined how functional connectivity and brain network efficiency varied during an endurance cycling task. To this purpose, we reconstructed EEG signals at source level: we computed current densities in 28 anatomical regions of interest (ROIs) through the eLORETA algorithm, then we calculated the Lagged Coherence of the 28 current density signals to define the adjacency (...) matrix. To quantify changes of functional network efficiency during an exhaustive cycling task, we computed three graph theoretical indices: local efficiency (LE), global efficiency (GE) and Density (D) in two different frequency bands, Alpha and Beta bands, that indicate alertness processes and motor binding/fatigue respectively. This analysis was conducted for six different task intervals: pre-cycling, initial, intermediate and final stages of cycling, active recovery and passive recovery. Fourteen participants performed an incremental cycling task with simultaneous EEG recording and RPE monitoring to detect participants’ exhaustion. LE remained constant during the endurance cycling task in both bands. Therefore, we speculate that fatigue processes did not affect segregated neural processing. We observed an increase of GE in the Alpha band only during cycling, that could be due to greater alertness processes and preparedness to stimuli during exercise. Conversely, although D did not change significantly over time in the Alpha band, its general reduction in the Beta bands during cycling could be interpreted within the framework of the neural efficiency hypothesis, which posits a reduced neural activity for expert/automated performances. We argue that the use of graph theoretical indices represents a clear methodological advancement in studying endurance performance. (shrink)

We motivate the desire for self-driving and explain its potential and limitations, and explore the need for—and potential implementation of—morals, ethics, and other value systems as complementary “capabilities” to the Deep Technologies behind self-driving. We consider how the incorporation of such systems may drive or slow adoption of high automation within vehicles. First, we explore the role for morals, ethics, and other value systems in self-driving through a representative hypothetical dilemma faced by a self-driving car. Through the lens of (...) engineering, we explain in simple terms common moral and ethical frameworks including utilitarianism, deontology, and virtue ethics before characterizing their relationship to the fundamental algorithms enabling self-driving. The concepts of behavior cloning, state-based modeling, and reinforcement learning are introduced, with some algorithms being more suitable for the implementation of value systems than others. We touch upon the contemporary cross-disciplinary landscape of morals and ethics in self-driving systems from a joint philosophical and technical perspective, and close with considerations for practitioners and the public, particularly as individuals may not appreciate the nuance and complexity of using imperfect information to navigate diverse scenarios and tough-to-quantify value systems, while “typical” software development reduces complex problems to black and white decision-making. (shrink)

Too often, advocates of domain-specific belief systems overlook the implications of their beliefs when choosing communications technologies and strategies, although they rarely overlook the importance of content. This essay argues that both environmentalism and sustainable agriculture, as systems of belief, favor certain strategies of generating and distributing information over others; that is, the essay argues that both the content and form of communications imply certain value preferences, hence both are subject to value-relevant choices. An additional purpose of the essay is (...) to set a context for this special edition of Agriculture and Human Values. Collectively the articles in this edition discuss a wide variety of issues, including but not limited to questions connected to information generation, access to information and information technologies, and the value systems conveyed by communications vehicles, including what is conveyed and different discussions of what should be conveyed. This essay looks at the importance of four sets of domain-specific value systems (environmentalism, sustainable agriculture, and the conventionalism counters to both of these) for two different sets of value systems connected to information generation, and further discusses each of these value sets in connection to choosing asymmetrical or symmetrical communications. It is hoped that this discussion of the flow of information, from generation to distribution, will provide a context for reading the edition as a whole. (shrink)

Algorithms influence every facet of modern life: criminal justice, education, housing, entertainment, elections, social media, news feeds, work… the list goes on. Delegating important decisions to machines, however, gives rise to deep moral concerns about responsibility, transparency, freedom, fairness, and democracy. Algorithms and Autonomy connects these concerns to the core human value of autonomy in the contexts of algorithmic teacher evaluation, risk assessment in criminal sentencing, predictive policing, background checks, news feeds, ride-sharing platforms, social media, and election interference. Using these (...) case studies, the authors provide a better understanding of machine fairness and algorithmic transparency. They explain why interventions in algorithmic systems are necessary to ensure that algorithms are not used to control citizens' participation in politics and undercut democracy. This title is also available as Open Access on Cambridge Core. (shrink)

Autonomous vehicles have the potential to save tens of thousands of lives, but legal and social barriers may delay or even deter manufacturers from offering fully automated vehicles and thereby cost lives that otherwise could be saved. Moral philosophers use “thought experiments” to teach us about what ethics might say about the ethical behavior of AVs. If a manufacturer designing an AV decided to make what it believes is an ethical choice to save a large group of (...) lives by steering away from the large group towards a single individual, could the manufacturer be liable to that single individual? I believe the answer is yes. This article discusses famous “trolley problem” thought experiments in moral philosophy, which news articles have recently applied to AVs. After establishing a hypothetical case, applying product liability law to AV behavior may show a way, in some jurisdictions, that will permit a manufacturer to implement an ethical choice without triggering liability, but liability risk remains. I then turn to possible traditional defenses to see if they prevent liability for a manufacturer making what it believes is an ethical design choice—necessity, defense of self, and the sudden emergency doctrine. None of them provides an effective defense. Under current law, maximizing collision avoidance appears to minimize legal risk. I conclude that the only way to provide effective protection to a manufacturer seeking to implement ethical choices about AV behavior is through special legislation or regulation. (shrink)

In this article we outline two different ways of ‘seeing’ autonomous driving (AD) cars. The first corresponds with the technological innovation narrative, published in online industry, policy, business and other news contexts, that pitches AD cars as the solution to societal problems, and urges users to trust and accept them so that such benefits can be accrued. The second is a narrative of everyday improvisation, which was visualized through our video ethnography and participant mapping exercises. Our research, undertaken in Sweden, (...) involved possible future everyday users of AD cars. We argue for a research and intervention agenda that examines how the visual narration of how AD cars might participate in human futures, could be shifted to create new modes of trust and reassurance for publics. (shrink)

Dilemma situations involving the choice of which human life to save in the case of unavoidable accidents are expected to arise only rarely in the context of autonomous vehicles. Nonetheless, the scientific community has devoted significant attention to finding appropriate and acceptable automated decisions in the event that AVs or drivers of AVs were indeed to face such situations. Awad and colleagues, in their now famous paper “The Moral Machine Experiment”, used a “multilingual online ‘serious game’ for collecting (...) large-scale data on how citizens would want AVs to solve moral dilemmas in the context of unavoidable accidents.” Awad and colleagues undoubtedly collected an impressive and philosophically useful data set of armchair intuitions. However, we argue that applying their findings to the development of “global, socially acceptable principles for machine learning” would violate basic tenets of human rights law and fundamental principles of human dignity. To make its arguments, our paper cites principles of tort law, relevant case law, provisions from the Universal Declaration of Human Rights, and rules from the German Ethics Code for Autonomous and Connected Driving. (shrink)

Certain characteristics make machine learning a powerful tool for processing large amounts of data, and also particularly unsuitable for explanatory purposes. There are worries that its increasing use in science may sideline the explanatory goals of research. We analyze the key characteristics of ML that might have implications for the future directions in scientific research: epistemic opacity and the ‘theory-agnostic’ modeling. These characteristics are further analyzed in a comparison of ML with the traditional statistical methods, in order to demonstrate what (...) it is specifically that makes ML methodology substantially unsuitable for reaching explanations. The analysis is given broader philosophical context by connecting it with the views on the role of prediction and explanation in science, their relationship, and the value of explanation. We proceed to show, first, that ML disrupts the relationship between prediction and explanation commonly understood as a functional relationship. Then we show that the value of explanation is not exhausted in purely predictive functions, but rather has a ubiquitously recognized value for both science and everyday life. We then invoke two hypothetical scenarios with different degrees of automatization of science, which help test our intuitions on the role of explanation in science. The main question we address is whether ML will reorient or otherwise impact our standard explanatory practice. We conclude with a prognosis that ML would diversify science into purely predictively oriented research based on ML-like techniques and, on the other hand, remaining faithful to anthropocentric research focused on the search for explanation. (shrink)

This article argues that vehicles, roads and routes merit a much more central place in theorizations of migration politics. This argument is developed in terms of three theses. First, the study of migration politics should examine how vehicles feature in the public mediation of migration and border controversies. Second, it is important to analyze vehicles as mobile sites of power and contestation in their own right. Third, an understanding of the materiality of transportation helps to explain how (...) the vehicle can sometimes become a site of strategic political action. These arguments are in turn used to develop a concept of viapolitics as a contribution to literatures on migration, mobilities and power. Viapolitics orients us to see migration from the middle, that is, from the angle of the vehicle and not just the state. It also seeks to connect migration studies to the history of problematizations, cultural types and the mythopoetics of the road. (shrink)

"A runaway trolley is speeding down a track" So begins what is perhaps the most fecund thought experiment of the past several decades since its invention by Philippa Foot. Since then, moral philosophers have applied the "trolley problem" as a thought experiment to study many different ethical conflicts - and chief among them is the programming of autonomous vehicles. Nowadays, however, very few philosophers accept that the trolley problem is a perfect analogy for driverless cars or that the situations (...) autonomous vehicles face will resemble the forced choice of the unlucky bystander in the original thought experiment. This book represents a substantial and purposeful effort to move the academic discussion beyond the trolley problem to the broader ethical, legal, and social implications that autonomous vehicles present. There are still urgent questions waiting to be addressed, for example: how AVs might interact with human drivers in mixed or "hybrid" traffic environments; how AVs might reshape our urban landscapes; what unique security or privacy concerns are raised by AVs as connected devices in the "Internet of Things"; how the benefits and burdens of this new technology, including mobility, traffic congestion, and pollution, will be distributed throughout society; and more. An attempt to map the landscape of these next-generation questions and to suggest preliminary answers, this volume draws on the disciplines of philosophy, sociology, economics, urban planning and transportation engineering, business ethics and more, and represents a global range of perspectives. (shrink)

This article discusses the connection between Western socialist parties and technological development during the 1950s. The cases of the British Labour Party (LP), the German Social Democracy (SPD), and the Italian Socialist Party (PSI) let us to examine socialist perspectives in managing technological progress and in conceiving programmes and purposes on scientific research. This choice allows to understand two different aspects: on the one hand, the new pragmatism of socialist and social democratic parties, which was a typical trait of Postwar's (...) socialist revisionism; on the other hand, the predominance assumed by domestic affairs in socialists’ vision, instead international topics. A very specific choice concerns the article's main focus. A large historiographical dispute has started to trace about Postwar Social Democracy's revisionism. Given such historiographical debate, this article firstly explores the behaviour and politics of the LP, the SPD, and the PSI about the the so-called modernization, a process which concerned the entire Postwar Europe. It also discusses programmes or ideas circulations about the 1950s ‘technological revolution’ and the agendas settled by socialist and social democratic parties to govern such global phenomena. (shrink)