This paper presents a new trilemma with respect to resolving the control and alignment problems in machine ethics. Section 1 outlines three possible types of artificial moral agents (AMAs): (1) 'Inhuman AMAs' programmed to learn or execute moral rules or principles without understanding them in anything like the way that we do; (2) 'Better-Human AMAs' programmed to learn, execute, and understand moral rules or principles somewhat like we do, but correcting for various sources of human moral error; and (3) 'Human-Like (...) AMAs' programmed to understand and apply moral values in broadly the same way that we do, with a human-like moral psychology. Sections 2–4 then argue that each type of AMA generates unique control and alignment problems that have not been fully appreciated. Section 2 argues that Inhuman AMAs are likely to behave in inhumane ways that pose serious existential risks. Section 3 then contends that Better-Human AMAs run a serious risk of magnifying some sources of human moral error by reducing or eliminating others. Section 4 then argues that Human-Like AMAs would not only likely reproduce human moral failures, but also plausibly be highly intelligent, conscious beings with interests and wills of their own who should therefore be entitled to similar moral rights and freedoms as us. This generates what I call the New Control Problem: ensuring that humans and Human-Like AMAs exert a morally appropriate amount of control over each other. Finally, Section 5 argues that resolving the New Control Problem would, at a minimum, plausibly require ensuring what Hume and Rawls term ‘circumstances of justice’ between humans and Human-Like AMAs. But, I argue, there are grounds for thinking this will be profoundly difficult to achieve. I thus conclude on a skeptical note. Different approaches to developing ‘safe, ethical AI’ generate subtly different control and alignment problems that we do not currently know how to adequately resolve, and which may or may not be ultimately surmountable. (shrink)

This paper tracks the development of Merleau-Ponty's inquiries into language through the themes of institution, symbolism, and nature in his Collège de France lectures of 1953-1960. It seeks to show the continuity of Merleau-Ponty's inquiries over this period. The Problem of Speech course (1953-1954) constitutes his last extended treatment of speech, language, and expression, and it leaves many questions unanswered. Nonetheless, a careful study of the course reveals that the inquiries that follow into institution and symbolism, and later into nature, (...) do not mark a sharp rupture with his earlier thought. Rather, the later investigations are required by those into language and expression to clarify the underlying functions that support them. Ultimately, the themes of language and nature will be deeply interwoven in Merleau-Ponty's late thought, with institution and symbolism serving as important mediating concepts. (shrink)