As AI Systems become increasingly autonomous, they are expected to engage in decision-making processes that have moral implications. In this research we integrate theoretical and empirical lines of thought to address the matters of moral reasoning and moral uncertainty in AI Systems. We reconceptualize the metanormative framework for decision-making under moral uncertainty and we operationalize it through a latent class choice model. The core idea being that moral heterogeneity in society can be codified in terms of a small number of (...) classes with distinct moral preferences and that this codification can be used to express moral uncertainty of an AI. Choice analysis allows for the identification of classes and their moral preferences based on observed choice data. Our reformulation of the metanormative framework is theory-rooted and practical in the sense that it avoids runtime issues in real time applications. To illustrate our approach we conceptualize a society in which AI Systems are in charge of making policy choices. While one of the systems uses a baseline morally certain model, the other uses a morally uncertain model. We highlight cases in which the AI Systems disagree about the policy to be chosen, thus illustrating the need to capture moral uncertainty in AI systems. (shrink)

Artificial Intelligence (AI) is set to bring changes to legal systems. These technologies may have positive practical implications when it comes to access, efficiency, and accuracy in Justice. However, there are still many uncertainties and challenges associated with the implementation of AI in the legal space. In this research, we surveyed Judges on critical challenges related to the Judging Profession in the AI paradigm; Automated Adjudication; and Legal Principles. Our results suggest that (i) Judges are hesitant about changes in their (...) profession. They signal the need for adequate training that fosters legal literacy in AI, but are less open to changes in legal writing or their social and institutional role; (ii) Judges believe higher levels of automation only lead to fair outcomes if used in earlier phases of adjudication; (iii) Judges believe and are concerned about AI leading to Techno-Legal Positivism; and (iv) Judges consider that Legal AI technologies may have a positive impact in some legal principles, as long as everyone has equal access to those technologies and cybersecurity and judge on the loop safeguards are in place; and (v) Judges are strongly concerned about the de-humanization of Justice. They consider that assessing evidence, analyzing arguments, and deciding on a legal case should be inherently human. By surveying these practitioners, we aim to foster a responsible, inclusive, and transparent innovation in Justice. (shrink)