Foundation models such as GPT-4 are fine-tuned to avoid unsafe or otherwise problematic behavior, such as helping to commit crimes or producing racist text. One approach to fine-tuning, called reinforcement learning from human feedback, learns from humans' expressed preferences over multiple outputs. Another approach is constitutional AI, in which the input from humans is a list of high-level principles. But how do we deal with potentially diverging input from humans? How can we aggregate the input into consistent data about "collective" (...) preferences or otherwise use it to make collective choices about model behavior? In this paper, we argue that the field of social choice is well positioned to address these questions, and we discuss ways forward for this agenda, drawing on discussions in a recent workshop on Social Choice for AI Ethics and Safety held in Berkeley, CA, USA in December 2023. (shrink)

ABSTRACTNew methods of calculating indices from the dot-probe task measure temporal dynamics in attention bias or fluctuations in attention bias towards and away from emotional stimuli over time. H...

This paper presents a new kind of problem in the ethics of distribution. The problem takes the form of several “calibration dilemmas,” in which intuitively reasonable aversion to small-stakes inequalities requires leading theories of distribution to recommend intuitively unreasonable aversion to large-stakes inequalities. We first lay out a series of such dilemmas for prioritarian theories. We then consider a widely endorsed family of egalitarian views and show that they are subject to even more forceful calibration dilemmas than prioritarian theories. Finally, (...) we show that our results challenge common utilitarian accounts of the badness of inequalities in resources. (shrink)

Reading is not only “cold” information processing, but involves affective and aesthetic processes that go far beyond what current models of word recognition, sentence processing, or text comprehension can explain. To investigate such “hot” reading processes, standardized instruments that quantify both psycholinguistic and emotional variables at the sublexical, lexical, inter-, and supralexical levels (e.g., phonological iconicity, word valence, arousal-span, or passage suspense) are necessary. One such instrument, the Berlin Affective Word List (BAWL) has been used in over 50 published studies (...) demonstrating effects of lexical emotional variables on all relevant processing levels (experiential, behavioral, neuronal). In this paper, we first present new data from several BAWL studies. Together, these studies examine various views on affective effects in reading arising from dimensional (e.g., valence ) and discrete emotion features (e.g., happiness ), or embodied cognition features like smelling. Second, we extend our investigation of the complex issue of affective word processing to words characterized by a mixture of affects. These words entail positive and negative valence, and/or features making them beautiful or ugly. Finally, we discuss tentative neurocognitive models of affective word processing in the light of the present results, raising new issues for future studies. (shrink)

It is argued that current neuroimaging studies can provide useful constraints for the construction of models of cognition, and that these studies should be guided by cognitive models. A numberof challenges for a successful cross-fertilization between “mind mappers” and cognitive modelers are discussed in the light of current research on word recognition.

This paper is a discussion of critical hermeneutics as a research methodology employed in a conceptual analytic study of the concept ‘institutional culture’ within the context of higher education. The research was undertaken to develop an understanding of the concept and to explore its construction in university policy documents. The aim of this paper is to motivate the choice of critical hermeneutics as a research methodology for the mentioned study. I explore both aspects of critical hermeneutics, namely hermeneutics and critical (...) theory. The interpretive nature of hermeneutics enabled me to expose the hidden meanings of institutional culture, while its context-specific nature was beneficial for pointing out the nature of institutional culture in the university setting. Critical theory, on the other hand, was appropriate because it is a theory that is self-conscious about historicity and the role of the social environment. In combination, the merits of these two aspects of critical hermeneutics facilitated the understanding of the university setting as a social reality. Employing critical hermeneutics as a research methodology furthermore assisted in analysing the construction of institutional culture within university policy documents, taking into account the important role of history in interpretation. In essence, critical hermeneutics facilitated my understanding of the difficult-to-explain concept ‘institutional culture’ in the higher education setting. (shrink)

This paper argues that in modern biotechnology, naturalness as an argument contributed to a stalemate in public debate about innovative technologies. Naturalness in this is often placed opposite to human disruption. It also often serves as a label that shapes moral acceptance or rejection of agricultural innovative technologies. The cause of this lies in the use of nature as a closed, static reference to naturalness, while in fact ‘‘nature’’ is an open and dynamic concept with many different meanings. We propose (...) an approach for a dynamic framework that permits an integrative use of naturalness in debate, by connecting three sorts of meaning that return regularly in the arguments brought forward in debate; cultural, technological, and ecological. We present these as aspects of nature that are always present in the argument of naturalness. The approach proposes a dynamic relation between these aspects, formed by gradients of naturalness, which in turn are related to ethical concerns. In this way we come to an overview that makes it possible to give individual arguments a relative place and that does justice to the temporality of the concept of nature and the underlying ethical concerns stakeholders have in respect to innovation in agriculture. (shrink)

Given its non-invasive nature, there is increasing interest in the use of transcutaneous vagus nerve stimulation across basic, translational and clinical research. Contemporaneously, tVNS can be achieved by stimulating either the auricular branch or the cervical bundle of the vagus nerve, referred to as transcutaneous auricular vagus nerve stimulation and transcutaneous cervical VNS, respectively. In order to advance the field in a systematic manner, studies using these technologies need to adequately report sufficient methodological detail to enable comparison of results between (...) studies, replication of studies, as well as enhancing study participant safety. We systematically reviewed the existing tVNS literature to evaluate current reporting practices. Based on this review, and consensus among participating authors, we propose a set of minimal reporting items to guide future tVNS studies. The suggested items address specific technical aspects of the device and stimulation parameters. We also cover general recommendations including inclusion and exclusion criteria for participants, outcome parameters and the detailed reporting of side effects. Furthermore, we review strategies used to identify the optimal stimulation parameters for a given research setting and summarize ongoing developments in animal research with potential implications for the application of tVNS in humans. Finally, we discuss the potential of tVNS in future research as well as the associated challenges across several disciplines in research and clinical practice. (shrink)

Given its non-invasive nature, there is increasing interest in the use of transcutaneous vagus nerve stimulation across basic, translational and clinical research. Contemporaneously, tVNS can be achieved by stimulating either the auricular branch or the cervical bundle of the vagus nerve, referred to as transcutaneous auricular vagus nerve stimulation and transcutaneous cervical VNS, respectively. In order to advance the field in a systematic manner, studies using these technologies need to adequately report sufficient methodological detail to enable comparison of results between (...) studies, replication of studies, as well as enhancing study participant safety. We systematically reviewed the existing tVNS literature to evaluate current reporting practices. Based on this review, and consensus among participating authors, we propose a set of minimal reporting items to guide future tVNS studies. The suggested items address specific technical aspects of the device and stimulation parameters. We also cover general recommendations including inclusion and exclusion criteria for participants, outcome parameters and the detailed reporting of side effects. Furthermore, we review strategies used to identify the optimal stimulation parameters for a given research setting and summarize ongoing developments in animal research with potential implications for the application of tVNS in humans. Finally, we discuss the potential of tVNS in future research as well as the associated challenges across several disciplines in research and clinical practice. (shrink)