This article presents a conceptual investigation into the value impacts and relations of algorithms in the domain of justice and security. As a conceptual investigation, it represents one step in a value sensitive design based methodology. Here, we explicate and analyse the expression of values of accuracy, privacy, fairness and equality, property and ownership, and accountability and transparency in this context. We find that values are sensitive to disvalue if algorithms are designed, implemented or deployed inappropriately or without sufficient consideration (...) for their value impacts, potentially resulting in problems including discrimination and constrained autonomy. Furthermore, we outline a framework of conceptual relations of values indicated by our analysis, and potential value tensions in their implementation and deployment with a view towards supporting future research, and supporting the value sensitive design of algorithms in justice and security. (shrink)

Governments and companies are increasingly promoting and organizing Responsible Innovation. It is, however, unclear how the seemingly incompatible demands for responsibility, which is associated with care and caution, can be harmonized with demands for innovation, which is associated with risk-taking and speed. We turn to the tradition of virtue ethics and argue that it can be a strong accomplice to Responsible Innovation by focussing on the agential side of innovation. Virtue ethics offers an adequate response to the epistemic and moral (...) complexity in innovation and encourages moral behaviour. We enumerate a number of virtues that people involved in Responsible Innovation would need to cultivate both related to responsibility, such as justice, anticipation, civility and inclusion, and virtues related to innovation, such as courage, dedication, curiosity and creativity. We put forward practical wisdom as a key virtue to regulate relevant virtues and to deal with the tension between responsibility and innovation. Practical wisdom helps an agent to find an appropriate mean in exercising and expressing the other virtues—where the mean is relative to the specific context of action and the role and abilities of the agent. (shrink)

Contemporary design practices, such as participatory design, human-centered design, and codesign, have inherent ethical qualities, which often remain implicit and unexamined. Three design projects in the high-tech industry were studied using three ethical traditions as lenses. Virtue ethics helped to understand cooperation, curiosity, creativity, and empowerment as virtues that people in PD need to cultivate, so that they can engage, for example, in mutual learning and collaborative prototyping. Ethics of alterity helped to understand human-centered design as a fragile encounter between (...) project team members and prospective users, and foregrounds the ethics in these encounters: our tendencies to “grasp the other” and to “program invention.” And pragmatist ethics helped to understand codesign as a process of joint inquiry and imagination, involving the organization of iterative processes of problem setting and solution finding, with moral qualities. When we open the “black boxes” of design practices, we find them filled with ethics. Moreover, it is proposed that design practitioners need to make explicit their practices’ inherent ethical qualities and that they can do that by embracing reflexivity. (shrink)

Developers and designers make all sorts of moral decisions throughout an innovation project. In this article, we describe how teams of developers and designers engaged with ethics in the early phases of innovation based on case studies in the SUBCOP project. For that purpose, Value Sensitive Design will be used as a reference. Specifically, we focus on the following two research questions: How can researchers/developers learn about users’ perspectives and values during the innovation process? and How can researchers/developers take into (...) account these values, and related design criteria, in their decision-making during the innovation process? Based on a case study of several innovation processes in this project, we conclude the researchers/developers involved are able to do something similar to VSD, supported by relatively simple exercises in the project, e.g., meetings with potential end-users and discussions with members of the Ethical Advisory Board of the project. Furthermore, we also found—possibly somewhat counterintuitively—that a commercial, with its focus on understanding and satisfying customers’ needs, can promote VSD. (shrink)

In this essay several virtues are discussed that are needed in people who work in participatory design (PD). The term PD is used here to refer specifically to an approach in designing information systems with its roots in Scandinavia in the 1970s and 1980s. Through the lens of virtue ethics and based on key texts in PD, the virtues of cooperation, curiosity, creativity, empowerment and reflexivity are discussed. Cooperation helps people in PD projects to engage in cooperative curiosity and cooperative (...) creativity. Curiosity helps them to empathize with others and their experiences, and to engage in joint learning. Creativity helps them to envision, try out and materialize ideas, and to jointly create new products and services. Empowerment helps them to share power and to enable other people to flourish. Moreover, reflexivity helps them to perceive and to modify their own thoughts, feelings and actions. In the spirit of virtue ethics—which focuses on specific people in concrete situations—several examples from one PD project are provided. Virtue ethics is likely to appeal to people in PD projects because it is practice-oriented, provides room for exploration and experimentation, and promotes professional and personal development. In closing, some ideas for practical application, for education and for further research are discussed. (shrink)