This article provides a methodology for the interpretation of AI ethics principles to specify ethical criteria for the development and deployment of AI systems in high-risk domains. The methodology consists of a three-step process deployed by an independent, multi-stakeholder ethics board to: (1) identify the appropriate level of abstraction for modelling the AI lifecycle; (2) interpret prescribed principles to extract specific requirements to be met at each step of the AI lifecycle; and (3) define the criteria to inform purpose- and (...) context-specific balancing of the principles. The methodology presented in this article is designed to be agile, adaptable, and replicable, and when used as part of a pro-ethical institutional culture, will help to foster the ethical design, development, and deployment of AI systems. The application of the methodology is illustrated through reference to the UK Ministry of Defence AI ethics principles. (shrink)

Zu Beginn der Pandemie im Frühjahr 2020, und nach einem weitreichenden Lockdown, ruhten große Erwartungen auf Corona-Warn-Apps, um einen erneuten Lockdown zu verhindern. Diese Erwartungen haben sich nicht erfüllt; stattdessen wurden in Deutschland als Reaktion auf erneute Wellen von COVID-19 weitere Kontaktbeschränkungen verordnet. Wie hätte die digitale Kontaktverfolgung wirksamer gestaltet werden können? Wir argumentieren, dass es ein Spannungsfeld zwischen der Datensparsamkeit und einer wirksamen Bekämpfung der Pandemie besteht. Im Gegensatz zur deutschen Corona-Warn-App wäre eine Variante der App, in der pseudonymisierte (...) Kennungen zentral gespeichert werden, in der Lage gewesen, die Effektivität der Kontaktverfolgung entscheidend zu erhöhen. Schließlich argumentieren wir, dass das Spannungsfeld zwischen Datensparsamkeit und einer wirksamen Pandemiebekämpfung sich jedoch nicht in einen Wertekonflikt übersetzt, weil zentrale Systeme uns trotz ihrer erhöhten Wirksamkeit nicht vor deutlich gravierendere Probleme beim Datenschutz stellen als dezentrale Systeme. Zentrale Möglichkeiten der digitalen Kontaktverfolgung wären daher ethisch gerechtfertigt, um auf weitere Wellen von COVID-19 oder auf zukünftige Epidemien effektiv zu reagieren. (shrink)

Since the outbreak of COVID-19, governments have turned their attention to digital contact tracing. In many countries, public debate has focused on the risks this technology poses to privacy, with advocates and experts sounding alarm bells about surveillance and mission creep reminiscent of the post 9/11 era. Yet, when Apple and Google launched their contact tracing API in April 2020, some of the world’s leading privacy experts applauded this initiative for its privacy-preserving technical specifications. In an interesting twist, the tech (...) giants came to be portrayed as greater champions of privacy than some democratic governments. This article proposes to view the Apple/Google API in terms of a broader phenomenon whereby tech corporations are encroaching into ever new spheres of social life. From this perspective, the advantage these actors have accrued in the sphere of the production of digital goods provides them with access to the spheres of health and medicine, and more worrisome, to the sphere of politics. These sphere transgressions raise numerous risks that are not captured by the focus on privacy harms. Namely, a crowding out of essential spherical expertise, new dependencies on corporate actors for the delivery of essential, public goods, the shaping of public policy by non-representative, private actors and ultimately, the accumulation of decision-making power across multiple spheres. While privacy is certainly an important value, its centrality in the debate on digital contact tracing may blind us to these broader societal harms and unwittingly pave the way for ever more sphere transgressions. (shrink)

The global Covid-19 pandemic has resulted in social and economic disruption unprecedented in the modern era. Many countries have introduced severe measures to contain the virus, including travel restrictions, public event bans, non-essential business closures and remote work policies. While digital technologies help governments and organizations to enforce protection measures, such as contact tracing, their rushed deployment and adoption also raises profound concerns about surveillance, privacy and data protection. This article presents two critical cases on digital surveillance technologies implemented during (...) the Covid-19 pandemic and delineates the privacy implications thereof. We explain the contextual nature of privacy trade-offs during a pandemic and explore how regulatory and technical responses are needed to protect privacy in such circumstances. By providing a multi-disciplinary conversation on the value of privacy and data protection during a global pandemic, this article reflects on the implications digital solutions have for the future and raises the question of whether there is a way to have expedited privacy assessments that could anticipate and help mitigate adverse privacy implications these may have on society. (shrink)

The success of digital COVID-19 contact tracing requires a strategy that successfully addresses the digital divide—inequitable access to technology such as smartphones. Lack of access both undermines the degree of social benefit achieved by the use of tracing apps, and exacerbates existing social and health inequities because those who lack access are likely to already be disadvantaged. Recently, Singapore has introduced portable tracing wearables (with the same functionality as a contact tracing app) to address the equity gap and promote public (...) health. We argue that governments have an ethical obligation to ensure fair access to the protective benefits of contract tracing during the pandemic and that wearables are an effective way of addressing some important equity issues. The most contentious issues about contact tracing apps have been the potential infringements of privacy and individual liberty, especially where the use of apps or other technology (such as wearables or QR codes) is required for access to certain spaces. Here we argue that wearables, as opposed to apps alone, will make a digital contact tracing mandate more practical and explain some conditions under which such a mandate would be justified. We focus on Singapore as a case study that has recently deployed contact tracing wearables nationally, but also reference debate about wearables in Australia and New Zealand. Our analysis will be relevant to counties trialling similar portable tracing wearables. (shrink)

In April 2020, close to the start of the first U.K. COVID-19 lockdown, the U.K. government announced the development of a COVID-19 contact tracing app, which was later trialled on the U.K. island, the Isle of Wight, in May/June 2020. United Kingdom surveys found general support for the development of such an app, which seemed strongly influenced by public trust. Institutions developing the app were called upon to fulfil the commitment to public trust by acting with trustworthiness. Such calls presuppose (...) that public trust associated with the app can emerge if the conditions for trustworthiness are met and that public trust is simplistic, i.e., linearly the sum of each member of the publics’ individual – U.K. government trust relationship. Drawing on a synthesis of the trust literature and fifteen interviews with members of the public trialling the app on the Isle of Wight, this paper aims to explore what trust mechanisms and relationships are at play when thinking about public trust in the context of the U.K. COVID-19 app. We argue that public trust is a complex social phenomenon and not linearly correlated with institutional trustworthiness. As such, attention needs to widen from calls for trustworthy infrastructures as a way to build public trust, to a deeper understanding of those doing the trusting; in particular, what or whom do people place their trust in when considering whether using the app and why. An understanding of this will help when trying to secure public trust during the implementation of necessary public health measures. (shrink)

There is growing interest in contact tracing apps for pandemic management. It is crucial to consider ethical requirements before, while, and after implementing such apps. In this paper, we illustrate the complexity and multiplicity of the ethical considerations by presenting an ethical framework for a responsible design and implementation of CT apps. Using this framework as a starting point, we briefly highlight the interconnection of social and political contexts, available measures of pandemic management, and a multi-layer assessment of CT apps. (...) We will discuss some trade-offs that arise from this perspective. We then suggest that public trust is of major importance for population uptake of contact tracing apps. Hasty, ill-prepared or badly communicated implementations of CT apps will likely undermine public trust, and as such, risk impeding general effectiveness. (shrink)

Several countries have implemented COVID-19 health passes or certificates to promote a safer return to in-person social activities. These passes have been proposed as a way to prove that someone has been vaccinated, has recovered from the disease, or has negative results on a diagnostic test. However, many people have questioned their ethical justification. This article presents some practical and ethical problems to consider in the event of wishing to implement these passes. Among the former, it is questioned how accurate (...) diagnostic tests are as a means of ensuring that a person is not contagious, whether vaccination guarantees immunity, the fact that health passes can be forged, whether they encourage vaccination, and the problem that there is no universally recognized health pass. Among the ethical issues, it is discussed whether health passes promote discrimination and inequality and whether they violate rights to privacy and freedom. It is concluded that health passes have enough ethical justification to be implemented. (shrink)

By mid-2019 there were more than 80 AI ethics guides available in the public domain. Despite this, 2020 saw numerous news stories break related to ethically questionable uses of AI. In part, this is because AI ethics theory remains highly abstract, and of limited practical applicability to those actually responsible for designing algorithms and AI systems. Our previous research sought to start closing this gap between the ‘what’ and the ‘how’ of AI ethics through the creation of a searchable typology (...) of tools and methods designed to translate between the five most common AI ethics principles and implementable design practices. Whilst a useful starting point, that research rested on the assumption that _all_ AI practitioners are aware of the ethical implications of AI, understand their importance, and are actively seeking to respond to them. In reality, it is unclear whether this is the case. It is this limitation that we seek to overcome here by conducting a mixed-methods qualitative analysis to answer the following four questions: what do AI practitioners understand about the need to translate ethical principles into practice? What motivates AI practitioners to embed ethical principles into design practices? What barriers do AI practitioners face when attempting to translate ethical principles into practice? And finally, what assistance do AI practitioners want and need when translating ethical principles into practice? (shrink)

As the range of potential uses for Artificial Intelligence, in particular machine learning, has increased, so has awareness of the associated ethical issues. This increased awareness has led to the realisation that existing legislation and regulation provides insufficient protection to individuals, groups, society, and the environment from AI harms. In response to this realisation, there has been a proliferation of principle-based ethics codes, guidelines and frameworks. However, it has become increasingly clear that a significant gap exists between the theory of (...) AI ethics principles and the practical design of AI systems. In previous work, we analysed whether it is possible to close this gap between the ‘what’ and the ‘how’ of AI ethics through the use of tools and methods designed to help AI developers, engineers, and designers translate principles into practice. We concluded that this method of closure is currently ineffective as almost all existing translational tools and methods are either too flexible or too strict. This raised the question: if, even with technical guidance, AI ethics is challenging to embed in the process of algorithmic design, is the entire pro-ethical design endeavour rendered futile? And, if no, then how can AI ethics be made useful for AI practitioners? This is the question we seek to address here by exploring why principles and technical translational tools are still needed even if they are limited, and how these limitations can be potentially overcome by providing theoretical grounding of a concept that has been termed ‘Ethics as a Service.’. (shrink)

In the past months, there has been a lively debate about so-called COVID-19 apps developed to deal with the pandemic (Morley et al. 2020b). Some of the best solutions use the Bluetooth connection of mobile phones to determine contacts between people and therefore the probability of contagion, and then suggested related measures. In theory, it may seem simple. In practice, there are several ethical problems (Morley et al. 2020a), not only legal and technical ones. To understand them, it is useful (...) to distinguish between the validation and the verification of a system, remembering that these words are used here only in the design/engineering sense, and certainly not philosophically. The validation of a system answers the following question:“are we building the right system?”. (shrink)

This paper explores ethical debates associated with the UK COVID-19 contact tracing app that occurred in the public news media and broader public policy, and in doing so, takes ethics debate as an object for sociological study. The research question was: how did UK national newspaper news articles and grey literature frame the ethical issues about the app, and how did stakeholders associated with the development and/or governance of the app reflect on this? We examined the predominance of different ethical (...) issues in news articles and grey literature, and triangulated this using stakeholder interview data. Findings illustrate how news articles exceptionalised ethical debate around the app compared to the way they portrayed ethical issues relating to ‘manual’ contact tracing. They also narrowed the debate around specific privacy concerns. This was reflected in the grey literature, and interviewees perceived this to have emerged from a ‘privacy lobby’. We discuss the findings, and argue that this limited public ethics narrative masked broader ethical issues. (shrink)

We conducted a systematic literature review on the ethical considerations of the use of contact tracing app technology, which was extensively implemented during the COVID-19 pandemic. The rapid and extensive use of this technology during the COVID-19 pandemic, while benefiting the public well-being by providing information about people’s mobility and movements to control the spread of the virus, raised several ethical concerns for the post-COVID-19 era. To investigate these concerns for the post-pandemic situation and provide direction for future events, we (...) analyzed the current ethical frameworks, research, and case studies about the ethical usage of tracing app technology. The results suggest there are seven essential ethical considerations—privacy, security, acceptability, government surveillance, transparency, justice, and voluntariness—in the ethical use of contact tracing technology. In this paper, we explain and discuss these considerations and how they are needed for the ethical usage of this technology. The findings also highlight the importance of developing integrated guidelines and frameworks for implementation of such technology in the post- COVID-19 world. (shrink)

Following the storming of the US Capitol building, Donald Trump became digitally toxic, and was deplatformed from Facebook, Instagram, Twitter and YouTube—as well as a host of other social media networks. Subsequent debate has centred on the questions of whether these companies did the right thing and the possible ramifications of their actions for the future of digital societies along with their democratic organisation. This article seeks to answer this question through examining complex, and seemingly contradictory notions (legality and the (...) protection of public interest vs issues of democratic legitimacy and digital sovereignty) and argues that reform is needed to determine who, in the future, will control the infosphere—and how. (shrink)

Digital sovereignty, and the question of who ultimately controls AI seems, at first glance, to be an issue that concerns only specialists, politicians and corporate entities. And yet the fight for who will win digital sovereignty has far-reaching societal implications. Drawing on five case studies, the paper argues that digital sovereignty affects everyone, whether digital users or not, and makes the case for a hybrid system of control which has the potential to offer full democratic legitimacy as well as innovative (...) flexibility. (shrink)

Many governments have seen digital health technologies as promising tools to tackle the current COVID-19 pandemic. A much-talked example in this context involves the recent deluge of digital contact tracing apps aimed at detecting Covid-19 exposure. In this short contribution we look at the bio-political justification of this phenomenon and reflect on whether DCT apps constitute, as it is often argued, a serious potential breach of our right to privacy. Despite praising efforts attempting to develop legal and ethical frameworks for (...) DCT apps’ usage; we argue that such endeavours are not sufficient to tackle the more fundamental problem of mass surveillance, which will remain largely unaddressed unless we deal with the biopolitical arguments presented and resort to a technical and structural defence. (shrink)

Zusammenfassung In der öffentlichen Debatte über die Corona-Warn-App kann der Solidaritätsbegriff als wichtiger, aber inhaltlich umstrittener normativer Bezugspunkt gelten. So stehen hier unterschiedliche Solidaritätsrekurse mit heterogenen Voraussetzungen, normativen Implikationen und praktischen Konsequenzen nebeneinander, die einer medizinethischen Untersuchung bedürfen. Vor diesem Hintergrund ist es Ziel des Beitrags, _erstens_ die Bandbreite der Verwendungsweisen des Solidaritätsbegriffs in der öffentlichen Debatte zur Corona-Warn-App anschaulich zu machen sowie _zweitens_ die Voraussetzungen und normativen Implikationen dieser Verwendungsweisen herauszuarbeiten und einer ethischen Bewertung zu unterziehen. Dazu stelle ich (...) nach einer kurzen Einführung in die Corona-Warn-App und einer Vergegenwärtigung der Grundzüge des Solidaritätskonzepts vier Beispiele aus der öffentlichen Debatte zur Corona-Warn-App dar, die mit Blick auf die zugrundeliegende Identifikation, die Solidaritätsgruppe, den solidarischen Beitrag sowie das normative Ziel erhebliche Unterschiede aufweisen. Sie unterstreichen die Notwendigkeit weiterführender Maßstäbe, um ihre Legitimität zu bewerten. Dazu greife ich auf vier normative Kriterien einer kontextsensitiven, moralisch gehaltvollen Solidaritätskonzeption zurück (Solidaritätsoffenheit, gestaltbare Inklusivität, Angemessenheit des solidarischen Beitrags, normative Abhängigkeit) und evaluiere auf dieser Grundlage die vorgestellten Solidaritätsrekurse ethisch. Für alle dargestellten Solidaritätsrekurse lassen sich in der Folge kritische Rückfragen formulieren. Dabei werden einerseits die Potenziale und Limitationen von Solidaritätsrekursen in öffentlichen Debatten deutlich. Andererseits werden Schlussfolgerungen möglich, wann eine Tracing-App tatsächlich als solidarische Technologie zur Pandemiebekämpfung verstanden werden kann. (shrink)

Mobile phone-based applications (apps) can promote faster targeted actions to control COVID-19. However, digital contact tracing systems raise concerns about data security, system effectiveness, and their potential to normalise privacy-invasive surveillance technologies. In the absence of mandates, public uptake depends on the acceptability and perceived legitimacy of using technologies that log interactions between individuals to build public health capacity. We report on six online deliberative workshops convened in New South Wales to consider the appropriateness of using the COVIDSafe app to (...) enhance Australian contact tracing systems. All groups took the position (by majority) that the protections enacted in the app design and supporting legislation were appropriate. This support is contingent on several system attributes including: the voluntariness of the COVIDSafe app; that the system relies on proximity rather than location tracking; and, that data access is restricted to local public health practitioners undertaking contact tracing. Despite sustained scepticism in media coverage, there was an underlying willingness to trust Australian governing institutions such that in principle acceptance of the new contact tracing technology was easy to obtain. However, tensions between the need to prove system effectiveness through operational transparency and requirements for privacy protections could be limiting public uptake. Our study shows that informed citizens are willing to trade their privacy for common goods such as COVID-19 suppression. But low case numbers and cautionary public discourses can make trustworthiness difficult to establish because some will only do so when it can be demonstrated that the benefits justify the costs to individuals. (shrink)

In this paper, we examine the practice and promises of digital phenotyping. We build on work on the ‘data self’ to focus on a medical domain in which the value and nature of knowledge and relations with data have been played out with particular persistence, that of Alzheimer's disease research. Drawing on research with researchers and developers, we consider the intersection of hopes and concerns related to both digital tools and Alzheimer's disease using the metaphor of the ‘data shadow’. We (...) suggest that as a tool for engaging with the nature of the data self, the shadow is usefully able to capture both the dynamic and distorted nature of data representations, and the unease and concern associated with encounters between individuals or groups and data about them. We then consider what the data shadow ‘is’ in relation to ageing data subjects, and the nature of the representation of the individual's cognitive state and dementia risk that is produced by digital tools. Second, we consider what the data shadow ‘does’, through researchers and practitioners’ discussions of digital phenotyping practices in the dementia field as alternately empowering, enabling and threatening. (shrink)

Several digital contact tracing smartphone applications have been developed worldwide in the effort to combat COVID-19 that warn users of potential exposure to infectious patients and generate big data that helps in early identification of hotspots, complementing the manual tracing operations. In most democracies, concerns over a breach in data privacy have resulted in severe opposition toward their mandatory adoption. This paper examines India as a noticeable exception, where the compulsory installation of such a government-backed application, the “Aarogya Setu” has (...) been deemed mandatory in certain situations. We argue that the mandatory app requirement constitutes a legitimate public health intervention during a public health emergency. (shrink)

As the range of potential uses for Artificial Intelligence (AI), in particular machine learning (ML), has increased, so has awareness of the associated ethical issues. This increased awareness has led to the realisation that existing legislation and regulation provides insufficient protection to individuals, groups, society, and the environment from AI harms. In response to this realisation, there has been a proliferation of principle-based ethics codes, guidelines and frameworks. However, it has become increasingly clear that a significant gap exists between the (...) theory of AI ethics principles and the practical design of AI systems. In previous work , we analysed whether it is possible to close this gap between the ‘what’ and the ‘how’ of AI ethics through the use of tools and methods designed to help AI developers, engineers, and designers translate principles into practice. We concluded that this method of closure is currently ineffective as almost all existing translational tools and methods are either too flexible (and thus vulnerable to ethics washing) or too strict (unresponsive to context). This raised the question: if, even with technical guidance, AI ethics is challenging to embed in the process of algorithmic design, is the entire pro-ethical design endeavour rendered futile? And, if no, then how can AI ethics be made useful for AI practitioners? This is the question we seek to address here by exploring why principles and technical translational tools are still needed even if they are limited, and how these limitations can be potentially overcome by providing theoretical grounding of a concept that has been termed ‘Ethics as a Service’. (shrink)