Are computers on the way to acquiring “superintelligence”? Can human deliberation and decision-making be fully simulated by the mechanical execution of AI programmes? On close examination these expectations turn out not to be well-founded, since algorithms do, ultimately, have “heteronomous” characteristics. So-called AI-“autonomy” is a sensor-directed performance automatism, which — compared with the potential for ethical judgment in human “practical reason” — proves to be limited in significant ways. This is shown in some detail with reference to the idea of (...) a “digital humanism”, which was introduced by Julian Nida-Rümelin and Nathalie Weidenfeld, who argue that algorithms are useful “tools”, but emphasise — thus rejecting excessive “post-humanist” ideas about AI — that there exists a crucial difference between human action and its AI-simulation. While Nida-Rümelin/Weidenfeld´s “digital humanism” is, on the one hand, inspired by Kant’s conception of human autonomous self-determination, the concept of “structural rationality” that they advocate is, on the other hand, quite problematic. “Digital humanism”, however, can be improved as I argue — with reference to Barbara Herman’s analysis of “moral judgment” and to Allen Wood’s reflections on “human dignity”. (shrink)

Software systems play an ever more important role in our lives and software engineers and their companies find themselves in a position where they are held responsible for ethical issues that may arise. In this paper, we try to disentangle ethical considerations that can be performed at the level of the software engineer from those that belong in the wider domain of business ethics. The handling of ethical problems that fall into the responsibility of the engineer has traditionally been addressed (...) by the publication of Codes of Ethics and Conduct. We argue that these Codes are barely able to provide normative orientation in software development. The main contribution of this paper is, thus, to analyze the normative features of Codes of Ethics in software engineering and to explicate how their value-based approach might prevent their usefulness from a normative perspective. Codes of Conduct cannot replace ethical deliberation because they do not and cannot offer guidance because of their underdetermined nature. This lack of orientation, we argue, triggers reactive behavior such as “cherry-picking,” “risk of indifference,” “ex-post orientation,” and the “desire to rely on gut feeling.” In the light of this, we propose to implement ethical deliberation within software development teams as a way out. (shrink)