Limits need to be set on AI’s ability to simulate human feelings. Ensuring that chatbots don’t use emotive language, including emojis, would be a good start. Emojis are particularly manipulative. Humans instinctively respond to shapes that look like faces — even cartoonish or schematic ones — and emojis can induce these reactions.

Conversational Artificial Intelligence (CAI) systems (also known as AI “chatbots”) are among the most promising examples of the use of technology in mental health care. With already millions of users worldwide, CAI is likely to change the landscape of psychological help. Most researchers agree that existing CAIs are not “digital therapists” and using them is not a substitute for psychotherapy delivered by a human. But if they are not therapists, what are they, and what role can they play in (...) mental health care? To answer these questions, we appeal to two well-established and widely discussed concepts: cognitive and affective artifacts. Cognitive artifacts are artificial devices contributing functionally to the performance of a cognitive task. Affective artifacts are objects which have the capacity to alter subjects’ affective state. We argue that therapeutic CAIs are a kind of cognitive-affective artifacts which contribute to positive therapeutic change by (i) simulating a (quasi-)therapeutic interaction, (ii) supporting the performance of cognitive tasks, and (iii) altering the affective condition of their users. This sheds new light on why virtually all existing mental health CAIs implement principles and techniques of Cognitive Behavioral Therapy — a therapeutic orientation according to which affective change and, ultimately, positive therapeutic change is mediated by cognitive change. Simultaneously, it allows us to conceptualize better the potential and limitations of applying these technologies in therapy. (shrink)

According to widely accepted views in metasemantics, the outputs of chatbots and other artificial text generators should be meaningless. They aren’t produced with communicative intentions and the systems producing them are not following linguistic conventions. Nevertheless, chatbots have assumed roles in customer service and healthcare, they are spreading information and disinformation and, in some cases, it may be more rational to trust the outputs of bots than those of our fellow human beings. To account for the epistemic role (...) of chatbots in our society, we need to reconcile these observations. This paper argues that our engagement with chatbots should be understood as a form of prop-oriented make-believe; the outputs of chatbots are literally meaningless but fictionally meaningful. With the make-believe approach, we can understand how chatbots can provide us with knowledge of the world through quasi-testimony while preserving our metasemantic theories. This account also helps to connect the study of chatbots with the epistemology of scientific instruments. (shrink)

Many experts have emphasised that chatbots are not sufficiently mature to be able to technically diagnose patient conditions or replace the judgements of health professionals. The COVID-19 pandemic, however, has significantly increased the utilisation of health-oriented chatbots, for instance, as a conversational interface to answer questions, recommend care options, check symptoms and complete tasks such as booking appointments. In this paper, we take a proactive approach and consider how the emergence of task-oriented chatbots as partially automated consulting (...) systems can influence clinical practices and expert–client relationships. We suggest the need for new approaches in professional ethics as the large-scale deployment of artificial intelligence may revolutionise professional decision-making and client–expert interaction in healthcare organisations. We argue that the implementation of chatbots amplifies the project of rationality and automation in clinical practice and alters traditional decision-making practices based on epistemic probability and prudence. This article contributes to the discussion on the ethical challenges posed by chatbots from the perspective of healthcare professional ethics. (shrink)

Developers and vendors of large language models (“LLMs”) — such as ChatGPT, Google Bard, and Microsoft’s Bing at the forefront—can be subject to Health Insurance Portability and Accountability Act of 1996 (“HIPAA”) when they process protected health information (“PHI”) on behalf of the HIPAA covered entities. In doing so, they become business associates or subcontractors of a business associate under HIPAA.

In 2023, online search engine provider Microsoft integrated a language model that provides direct answers to search queries into its search engine Bing. Shortly afterwards, Google also introduced a similar feature to its search engine with the launch of Google Gemini. This introduction of direct answers to search queries signals an important and significant change in online search. This article explores the implications of this new search paradigm. Drawing on Donna Haraway’s theory of _Situated Knowledges_ and Rainer Mühlhoff’s concept of (...) _Sealed Surfaces_, I introduce the term _Sealed Knowledges_ to draw attention to the increasingly difficult access to the plurality of potential answers to search queries through the output of a singular, authoritative, and plausible text paragraph. I argue that the integration of language models for the provision of direct answers into search engines is based on a de-situated and disembodied understanding of knowledge and affects the subjectivities of its users. At the same time, the _sealing of knowledges_ can lead to an increasing spread of misinformation and may make marginalized knowledge increasingly difficult to find. The paper concludes with an outlook on how to resist the increasing _sealing of knowledges_ in online search. (shrink)

From past research it is well known that social exclusion has detrimental consequences for mental health. To deal with these adverse effects, socially excluded individuals frequently turn to other humans for emotional support. While chatbots can elicit social and emotional responses on the part of the human interlocutor, their effectiveness in the context of social exclusion has not been investigated. In the present study, we examined whether an empathic chatbot can serve as a buffer against the adverse effects of (...) social ostracism. After experiencing exclusion on social media, participants were randomly assigned to either talk with an empathetic chatbot about it (e.g., “I'm sorry that this happened to you”) or a control condition where their responses were merely acknowledged (e.g., “Thank you for your feedback”). Replicating previous research, results revealed that experiences of social exclusion dampened the mood of participants. Interacting with an empathetic chatbot, however, appeared to have a mitigating impact. In particular, participants in the chatbot intervention condition reported higher mood than those in the control condition. Theoretical, methodological, and practical implications, as well as directions for future research are discussed. (shrink)

Grief is, and has always been, technologically supported. From memorials and shrines to photos and saved voicemail messages, we engage with the dead through the technologies available to us. As our technologies evolve, so does how we grieve. In this paper, we consider the role chatbots might play in our grieving practices. Influenced by recent phenomenological work, we begin by thinking about the character of grief. Next, we consider work on developing “continuing bonds” with the dead. We argue that (...) for some, chatbots may play an important role in establishing these continuing bonds by helping us develop what we term “habits of intimacy”. We then turn to the “ick factor” some may feel about this prospect, focusing especially on ethical concerns raised by Patrick Stokes and Adam Buben about the risk of replacing our dead with chatbots. We argue that replacement worries are not as pressing as Stokes and Buben suggest. We resist these replacement worries by appealing to the “thin reciprocity”, as we refer to it, that such bots offer, as well as the fictionalist stance that we think users of the bots adopt when engaging with them. We conclude by briefly raising some additional concerns and highlighting future research questions. (shrink)

The article discusses the main trends in the development of artificial intelligence systems and robotics (AI&R). The main question that is considered in this context is whether artificial systems are going to become more and more anthropomorphic, both intellectually and physically. In the current article, the author analyzes the current state and prospects of technological development of artificial intelligence and robotics, and also determines the main aspects of the impact of these technologies on society and economy, indicating the geopolitical strategic (...) nature of this influence. The author considers various approaches to the definition of artificial intelligence and robotics, focusing on the subject-oriented and functional ones. It also compares AI&R abilities and human abilities in areas such as categorization, pattern recognition, planning and decision making, etc. Based on this comparison, we investigate in which areas AI&R’s performance is inferior to a human, and in which cases it is superior to one. The modern achievements in the field of robotics and artificial intelligence create the necessary basis for further discussion of the applicability of goal setting in engineering, in the form of a Turing test. It is shown that development of AI&R is associated with certain contradictions that impede the application of Turing’s methodology in its usual format. The basic contradictions in the development of AI&R technologies imply that there is to be a transition to a post-Turing methodology for assessing engineering implementations of artificial intelligence and robotics. In such implementations, on the one hand, the ‘Turing wall’ is removed, and on the other hand, artificial intelligence gets its physical implementation. (shrink)

En este ensayo, analizaré cómo el sujeto cibernético, los chatbots y el gólem artificial se relacionan entre sí y con el contexto histórico en el que surgen y se desarrollan en el cibermundo. El cibermundo es el escenario virtual y material donde se desarrollan las interacciones entre los sujetos cibernéticos y los dispositivos inteligentes que emplean la inteligencia artificial (IA) para comunicarse, aprender, crear y construir estrategia de saber- poder. Los conceptos de sujeto cibernético, chatbot y gólem artificial entran (...) en una interrelación dinámica en el cibermundo, generando reflexiones y produciendo debate filosófico sobre el sujeto cibernético ante la inteligencia artificial. (shrink)

This study deals with the failure of one of the most advanced chatbots called Tay, created by Microsoft. Many users, commentators and experts strongly anthropomorphised this chatbot in their assessment of the case around Tay. This view is so widespread that we can identify it as a certain typical cognitive distortion or bias. This study presents a summary of facts concerning the Tay case, collaborative perspectives from eminent experts: Tay did not mean anything by its morally objectionable statements because, (...) in principle, it was not able to think; the controversial content spread by this AI was interpreted incorrectly—not as a mere compilation of meaning, but as its disclosure; even though chatbots are not members of the symbolic order of spatiotemporal relations of the human world, we treat them in this way in many aspects. (shrink)

Ethically significant consequences of artificially intelligent artifacts will stem from their effects on existing social relations. Artifacts will serve in a variety of socially important roles—as personal companions, in the service of elderly and infirm people, in commercial, educational, and other socially sensitive contexts. The inevitable disruptions that these technologies will cause to social norms, institutions, and communities warrant careful consideration. As we begin to assess these effects, reflection on degrees and kinds of social agency will be required to make (...) properly informed decisions concerning the deployment of artificially intelligent artifacts in important settings. The social agency of these systems is unlike a human social agency, and this paper provides a methodological framework that is more suited for inquiry into artificial social agents than conventional philosophical treatments of the concept of agency. Separate aspects and dimensions of agency can be studied without assuming that agency must always look like adult human agency. This revised approach to the agency of artifacts is conducive to progress in the topics studied by AI ethics. (shrink)

Large Language Models (LLMs) like ChatGPT were trained on human conversation, but in the future they will also train us. As chatbots speak from our smartphones and customer service helplines, they will become a part of everyday life and a growing share of all the conversations we ever have. It’s hard to doubt this will have some effect on us. Here I explore a specific concern about the impact of artificial conversation on our capacity to deliberate and hold ourselves (...) accountable to reason – that is, to be autonomous, in Kant’s sense of the term. I develop ideas from psychologist Jean Piaget to show how chatbots are autonomy traps: their deference to our commands tempts us into venting authoritarian whims, ultimately weakening our own self-control. I argue that the Kantian tradition, including Piaget and sociologist Emile Durkheim, offers powerful conceptual resources for resisting this slide. But it will require us to do something that may seem bizarre: we will need to treat mindless chatbots as if they are autonomous persons too. (shrink)

Religion-based AI chatbots serve religious practitioners by bringing them godly wisdom through technology. These bots reply to spiritual and worldly questions by drawing insights or citing verses from the Quran, the Bible, the Bhagavad Gita, the Torah, or other holy books. They answer religious and theological queries by claiming to offer historical contexts and providing guidance and counseling to their users. A criticism of these bots is that they may give inaccurate answers and proliferate bias by propagating homogenized versions (...) of the religions they represent. These “embodied spiritual machines” may likewise bear bias against women, their gender, and their societal roles. This paper crafts a concept intended to address this GPT issue by reimagining, modifying, and implementing a feminist approach to these chatbots. It examines the concepts and designs of these bots and how they address women-related questions. Along with the challenge of bringing gender and diversity-sensitive religious wisdom closer to the people through technology, the paper proposes a re-engineered model of a fair religion-based AI chatbot. (shrink)

Digital records, from chat transcripts to social media posts, are being used to create chatbots that recreate the conversational style of deceased individuals. Some maintain that this is merely a new form of digital memorial, while others argue that they pose a variety of moral hazards. To resolve this, I turn to classical Chinese philosophy to make use of a debate over the ethics of funerals and mourning. This ancient argument includes much of interest for the contemporary issue at (...) hand, including the use of impersonators of the dead to help the bereaved to deal well with their grief. I connect this historical discussion with a modern trend in clinical psychology that reframes therapeutic interventions with bereaved individuals. The trend directs practitioners away from facilitating detachment and toward affirming continuing bonds. I conclude that these chatbots can offer an important source of support to mourners, but also discuss parameters and features of social context that will be important to avoid the moral hazards identified by sceptics. (shrink)

Interactions between human beings and chatbots are gradually becoming part of our everyday social lives. It is still unclear how human–chatbot interactions, compared to human–human interactions, influence individual morality. Building on the dual-process theory of moral judgment, a secondary data analysis, and two scenario-based experiments provide sufficient evidence that HCIs support utilitarian judgments, which reduce participants' donation amount. Study 3 further demonstrates that the negative effects of HCIs can be attenuated by inducing a social-oriented communication style in chatbots’ (...) verbal language designs. These findings highlight the negative impacts of HCIs on relationships among human beings and suggest a practical intervention for nonprofit organization managers. (shrink)

This study sought to examine the effect of the quality of chatbot services on customer satisfaction, repurchase intention, and positive word-of-mouth by comparing two groups, namely chatbots with and without emotion words. An online survey was conducted for 2 weeks in May 2021. A total of 380 responses were collected and analyzed using structural equation modeling to test the hypothesis. The theoretical basis of the study was the SERVQUAL theory, which is widely used in measuring and managing service quality (...) in various industries. The results showed that the assurance and reliability of chatbots positively impact customer satisfaction for both groups. However, empathy and interactivity positively affect customer satisfaction only for chatbots with emotion words. Responsiveness did not have an impact on customer satisfaction for both groups. Customer satisfaction positively impacts repurchase intention and positive word-of-mouth for both groups. The findings of this study can serve as a priori research to empirically prove the effectiveness of chatbots with emotion words. (shrink)

Exploring the relationship between humans and AI chatbots, as well as the ethical concerns surrounding their use, this paper argues that our relations with chatbots are not solely based on their function as a source of knowledge, but, rather, on the desire for the subject not to know. It is argued that, outside of the very fears and anxieties that underscore our adoption of AI, the desire not to know reveals the potential to embrace the very loss AI (...) avers. Consequently, rather than proposing a knowledge that seeks to disavow loss, we can instead recognize the potential in loss itself: an opportunity to assert and define the gap inherent to both the subject and AI we create. (shrink)

The accession and implementation of new generation free trade agreements bring numerous opportunities as well as challenges to Viet Nam, regarding trade, labor and investment. The increasing number of workers abroad puts a pressure on Vietnamese government to support them in new working cultures and environments. The application of chatbot, which has been known to help certain vulnerable groups such as patients, women and migrants could be one of the tools to support Vietnamese migrant workers by providing immediate information, network (...) connection and consultation. Analyzing the results of the qualitative interviews with 11 migrant workers and the group discussion with two sections from three public social media groups and three active informants, the article argues that migrant workers as a vulnerable group who are supposed to be promising users of chatbot due to their great demand and needs, may have a complicated form of trust and expectation in chatbot. (shrink)

Natural language processing is a critical part of the digital transformation. NLP enables user-friendly interactions between machine and human by making computers understand human languages. Intelligent chatbot is an essential application of NLP to allow understanding of users’ utterance and responding in understandable sentences for specific applications simulating human-to-human conversations and interactions for problem solving or Q&As. This research studies emerging technologies for NLP-enabled intelligent chatbot development using a systematic patent analytic approach. Some intelligent text-mining techniques are applied, including document (...) term frequency analysis for key terminology extractions, clustering method for identifying the subdomains, and Latent Dirichlet Allocation for finding the key topics of patent set. This research utilizes the Derwent Innovation database as the main source for global intelligent chatbot patent retrievals. (shrink)

This study is intended to create an innovative contextual English learning environment making use of the widely used communication software, LINE ChatBot, based on the Artificial Intelligence Markup Language, in order to improve speaking and listening ability among learners. A total of 73 students were invited to participate in learning activities involving a 4-week English conversation exercise including both speaking and listening. Additionally, in order to explore the influence of competition on language acquisition, we added competition characteristics to the learning (...) activities in the experimental group to enhance learning motivation and learning outcomes. The results showed that with the help of the LINE ChatBot contextual learning environment, the performance of both groups of students was slightly enhanced, but no significant differences were found. Meanwhile, extrinsic motivation in both the experimental and control group was improved if they spoke anonymously. That is, the contextual learning environment based on the LINE ChatBot significantly improved the learners’ English speaking and listening ability. In addition, the results showed that the addition of a competition element effectively enhanced the learners’ intrinsic motivation to learn English on the LINE ChatBot. (shrink)

Information of high evidentiary quality plays a crucial role in forensic investigations. Research shows that information provided by witnesses and victims often provide major leads to an inquiry. As such, statements should be obtained in the shortest possible time following an incident. However, this is not achieved in many incidents due to demands on resources. This intersectional study examined the effectiveness of a chatbot (the AICI), that uses artificial intelligence (AI) and a cognitive interview (CI) to help record statements following (...) an incident. After viewing a sexual harassment video, the present study tested recall accuracy in participants using AICI compared to other tools (i.e., Free Recall, CI Questionnaire, and CI Basic Chatbot). Measuring correct items (including descriptive items) and incorrect items (errors and confabulations), it was found that the AI CI elicited more accurate information than the other tools. The implications on society include AI CI provides an alternative means of effectively and efficiently recording high-quality evidential statements from victims and witnesses. (shrink)

In human-chatbot interaction, users casually and regularly offend and abuse the chatbot they are interacting with. The current paper explores the relationship between chatbot humanlikeness on the one hand and sexual advances and verbal aggression by the user on the other hand. 283 conversations between the Cleverbot chatbot and its users were harvested and analysed. Our results showed higher counts of user verbal aggression and sexual comments towards Cleverbot when Cleverbot appeared more humanlike in its behaviour. Caution is warranted with (...) the interpretation of the results however as no experimental manipulation was conducted and causality can thus not be inferred. Nonetheless, the findings are relevant for both the research on the abuse of conversational agents, and the development of efficient approaches to discourage or prevent verbal aggression by chatbot users. (shrink)

The article discusses the case of Microsoft's Twitter chatbot Tay that “turned into a Nazi” after less than 24 hours from its release on the Internet. The first section presents a brief recapitulation of Alan Turing's proposal for a test for artificial intelligence and the way it influenced subsequent discussions in the philosophy of mind. In the second section, I offer a few arguments appealing for caution regarding the identification of an accomplished chatbot as a thinking being. These are motivated (...) principally by Ludwig Wittgenstein's discussions of mind and soul and by some Wittgensteinian philosophers' criticisms of AI endeavours. I will try to show that it is very difficult, if not impossible, to make sense of AIs such as chatbots as thinking beings, rather independently of their technical perfection and accomplishment. In the third section, the case of the “Nazi chatbot” Tay will offer me material for some light to be shed on the peculiar character of our interconnected concepts of thinking, soul and person and on the importance of their further ramified connections. (shrink)

This article explores questions about chatbots in particular and artificial intelligence (AI) in general from a Pauline, that is, a Christian theological perspective. It does so in a way that focuses on a particular scene in the New Testament: Paul in the Athenian Areopagus, considering an altar to an “unknown God,” quoting Greek poets and philosophers, and sharing curious theology as he dialogues with Stoic and Epicurean thinkers (Acts 17:16–34). By examining the sociohistorical nuances of this scene and their (...) philosophical and theological implications, this article shows how the altar Paul considers philosophically and theologically becomes the focal point for an important dialogue about apocalyptic ends, or ideas about who we are, where we are going, and who or what is responsible for that who‐ness and where‐ness. In turn, this can teach us how to ask practical questions, which can uncover the unsuspected apocalyptic ends represented by, or even contained within, common technological objects such as chatbots. (shrink)

Due to huge advancements in natural language processing (NLP) and machine learning, chatbots are gaining significance in the field of customer service. For users, it may be hard to distinguish whether they are communicating with a human or a chatbot. This brings ethical issues, as users have the right to know who or what they are interacting with (European Commission in Regulatory framework proposal on artificial intelligence. https://digital-strategy.ec.europa.eu/en/policies/regulatory-framework-ai, 2022). One of the solutions is to include a disclosure at the (...) start of the interaction (e.g., “this is a chatbot”). However, companies are reluctant to use disclosures, as consumers may perceive artificial agents as less knowledgeable and empathetic than their human counterparts (Luo et al. in Market Sci 38(6):937–947, 2019). The current mixed methods study, combining qualitative interviews (n = 8) and a quantitative experiment (n = 194), delves into users’ responses to a disclosed vs. undisclosed customer service chatbot, focusing on source orientation, anthropomorphism, and social presence. The qualitative interviews reveal that it is the willingness to help the customer and the friendly tone of voice that matters to the users, regardless of the artificial status of the customer care representative. The experiment did not show significant effects of the disclosure (vs. non-disclosure). Implications for research, legislators and businesses are discussed. (shrink)

Chatbots such as ChatGPT have the potential to change researchers’ lives in many ways. Despite all the advantages of chatbots, many challenges to using chatbots in medical research remain. Wrong and incorrect content presented by chatbots is a major possible disadvantage. The authors’ credibility could be tarnished if wrong content is presented in medical research. Additionally, ChatGPT, as the currently most popular generative AI, does not routinely present references for its answers. Double-checking references and resources used (...) by chatbots might be challenging. Researchers must also be careful not to harm copyright law or cause plagiarism issues using applications such as ChatGPT. Chatbots are trained on publicly available sources on the internet, increasing the risk of copyright or plagiarism issues. Therefore, chatbots such as ChatGPT should not be used routinely for professional medical research for now. However, further developments could make chatbots usable in medical research in the near future. (shrink)

Interactions between humans and machines that include artificial intelligence are increasingly common in nearly all areas of life. Meanwhile, AI-products are increasingly endowed with emotional characteristics. That is, they are designed and trained to elicit emotions in humans, to recognize human emotions and, sometimes, to simulate emotions. The introduction of such systems in our lives is met with some criticism. There is a rather strong intuition that there is something wrong about getting attached to a machine, about having certain emotions (...) towards it, and about getting involved in a kind of affective relationship with it. In this paper, I want to tackle these worries by focusing on the last aspect: in what sense could it be problematic or even wrong to establish an emotional relationship with EAI-systems? I want to show that the justifications for the widespread intuition concerning the problems are not as strong as they seem at first sight. To do so, I discuss three arguments: the argument from self-deception, the argument from lack of mutuality, and the argument from moral negligence. (shrink)

To support older users’ accessibility and learning of the prevalent information and communication technologies, libraries, as informal learning institutes, are committed to information literacy education activities with friendly interfaces. Chatbots using Voice User Interfaces with natural and intuitive interactions have received growing research and practical attention; however, older users report regular frustrations and problems in using them. To serve as a basis for the subsequent design and development of an automated dialog mechanism in senior-friendly chatbots, a between-subject user (...) experiment was conducted with 30 older adults divided into three groups. The preliminary findings on their interactions with the voice chatbots designed with different error handling strategies were reported. Participants’ behavioral patterns, performances, and the tactics they employed in interacting with the three types of chatbots were analyzed. The results of the study showed that the use of multiple error handling strategies is beneficial for older users to achieve effectiveness and satisfaction in human-robot interactions, and facilitate their attitude toward information technology. This study contributes empirical evidence in the genuine and pragmatic field of gerontechnology and expands upon voice chatbots research by exploring conversation errors in human-robot interactions that could be of further application in designing educational and living gerontechnology. (shrink)

Fiction is an important tool in an artist/designer/developer’s vocabulary, but its usage is polyvalent. Speculative research in this article introduces the ‘rudiment’ to embrace the undeveloped and the improvisory phases of research practice. Fiction is used to reflect on the ways practicing designers and developers might already engage in misanthropic thinking – involving automated technologies. Tracing the misanthropic agencies in relation to automated technologies contributes to expanding the ways designers and developers reflect on the technical potential of their designs, with (...) whom they are designing (and for) and the way they understand their reflexive self. Bringing together Colson Whitehead’s novel The Intuitionist (1999) and its account of an elevator crash, their design and maintenance, with a narrative account of software agents enables an investigation into the promises made through a design-for-the-prevention-of-failure imperative. These examples highlight the relation between physical and non-physical failures such as failures to connect or to create intimacy. Those who contribute to designing in this article get caught up in configuring misanthropic agencies involving themselves, the designed artefact and the spaces they both inhabit be that an elevator in a housing block, or a sexbot in an online chat room. I will argue that the misanthropic agencies of automated technologies can have a confining impact on our emergent modes of design. Automated software operating in virtual spaces are confining in as much as they attempt to connect things to exploit the de-personalized aspects of automated, misanthropic agency. (shrink)

One in three university students experiences mental health problems during their study. A similar percentage leaves higher education without obtaining the degree for which they enrolled. Research suggests that both mental health problems and academic underperformance could be caused by students lacking control and purpose while they are adjusting to tertiary education. Currently, universities are not designed to cater to all the personal needs and mental health problems of large numbers of students at the start of their studies. Within the (...) literature aimed at preventing mental health problems among students (e.g., anxiety or depression), digital forms of therapy recently have been suggested as potentially scalable solutions to address these problems. Integrative psychological artificial intelligence (AI) in the form of a chatbot, for example, shows great potential as an evidence-based solution. At the same time, within the literature aimed at improving academic success, the online life-crafting intervention in which students write about values and passions, goals, and goal-attainment plans has shown to improve the academic performance and retention rates of students. Because the life-crafting intervention is delivered through the curriculum and doesn’t bear the stigma that is associated with therapy, it can reach larger populations of students. But life-crafting lacks the means for follow-up or the interactiveness that online AI-guided therapy can offer. In this paper, we propose to integrate the current literature on chatbot interventions aimed at the mental health of students with research about a life-crafting intervention that uses an inclusive curriculum-wide approach. When a chatbot asks students to prioritize both academic as well as social and health-related goals and provides personalized follow-up coaching, this can prevent -often interrelated- academic and mental health problems. Right on-time delivery, and personalized follow-up questions enhance the effects of both -originally separated- intervention types. Research on this new combination of interventions should use design principles that increase user-friendliness and monitor the technology acceptance of its participants. (shrink)

The present narrative review seeks to unravel where we are now, and where we need to go to delineate the active ingredients in psychotherapy delivered by conversational agents (e.g., chatbots). While psychotherapy delivered by conversational agents has shown promising effectiveness for depression, anxiety, and psychological distress across several randomized controlled trials, little emphasis has been placed on the therapeutic processes in these interventions. The theoretical framework of this narrative review is grounded in prominent perspectives on the active ingredients in (...) psychotherapy. Based on search terms derived from various theoretical perspectives, we conducted a systematic literature search of four scientific databases and identified 17 studies. Across the selected studies, three themes emerged: relationship variables, emotional venting, and cognitive factors. While methodological issues compromise the epistemic value of this evidence base, core questions also remain to be answered. Such questions include, but are not limited to, whether humans can form affectionate bonds to inanimate beings and whether these kind of mental health treatments should be understood as psychotherapy or something else. Researchers should therefore be cautious when applying theories of psychotherapy in the realm of conversational agents. We conclude the paper by introducing recommendations for future research, which we hope will help instigate methodologically sound studies in this field. (shrink)

Fast jeder hat Erfahrungen mit Siri, Alexa oder anderen Chatbots. Doch was geschieht, wenn ein Mensch einen Chatbot in einen Dialog über Philosophie verwickelt? Kann man mit künstlichen Intelligenzen (KI) überhaupt über Bewusstsein, Erinnerung und philosophische Theorien der Zeit diskutieren? -/- Ja, man kann – zumindest der Form nach. Und das gleich zweimal: Mit den beiden für den Loebner-Preis für KI dekorierten Chatbots Rose und Mitsuku. Ob das geistreich ist? Das muss jeder für sich entscheiden. Ob das unterhaltsam (...) ist? Ja – allerdings eher unfreiwillig. Im systematischen Teil des Essays werden die Dialoge ausgewertet. Dabei wird der gegenwärtige Hype um KI als maßlose Übertreibung sichtbar, ein Goldrausch der KI gewissermaßen, übrigens von Menschen und ihren allzu menschlichen Interessen veranlasst. -/- Die Begriffe rund um das Thema KI werden im Buch weggeholt von der Behauptung der Singularität, der Disruption oder der versteckten Science Fiction – zurück auf den Boden der funktionalen Tatsachen einer gleichwohl beachtlichen Innovationsspirale: Automatisierung, Standardisierung und maschinelles Verarbeiten von großen Echtzeit-Daten sind aktuell die sachgemäßen Beschreibungen des gegenwärtigen KI-Rauschs. Doch eigentlich geht es beim KI-Rausch um etwas anderes: Die Maschinisierung des Menschen durch Standardisierung, Automatisierung und verbesserte Kontrolle zur fortschreitenden Ökonomisierung aller Lebensbereiche, ermöglicht durch Algorithmen, Datafizierung und digitale Technologie in bisher ungeahnter Wirkmächtigkeit. -/- Der Essay enthält dazu fünf Thesen: -/- These 1: Maschinen werden immer effizienter im Automatisieren – oder: die Automatisierung der Automatisierung -/- These 2: Trotz Automatisierung der Automatisierung: Maschinen sind nicht geistreich intelligent -/- These 3: Menschen werden als Datenhaufen ausgemessen – und damit zu Datenhaufen gemacht -/- These 4: Datenhaufen quo vadis? Von der Präferenz-Erfassung zum „hackable animal“ -/- These 5: Synthese = Die Maschinisierung der Menschen – zur Bahnung der KI -/- Fazit: Mit den künstlichen Intelligenzen verhält es sich wie mit künstlichen Tränen: Sie erfüllen einen instrumentellen Zweck, der aber in keiner Weise mit jenen schillernden Gefühlen verbunden ist, die wir in Freude oder Trauer empfinden – und die uns zum Menschen machen. Alles andere ist Budenzauber oder Desinformation. -/- STIMMEN ZUM BUCH “Wir sollten die Ethik und Nachhaltigkeit der Digitalisierung noch viel ausführlicher erforschen. Dieses Buch ist ein provokativer Beitrag dazu.” -/- Dr. Matthias Stürmer, Leiter Forschungsstelle Digitale Nachhaltigkeit am Institut für Informatik der Universität Bern. (shrink)

The transformers that drive chatbots and other AI systems constitute large language models (LLMs). These are currently the focus of a lively discussion in both the scientific literature and the popular media. This discussion ranges from hyperbolic claims that attribute general intelligence and sentience to LLMs, to the skeptical view that these devices are no more than “stochastic parrots”. I present an overview of some of the weak arguments that have been presented against LLMs, and I consider several of (...) the more compelling criticisms of these devices. The former significantly underestimate the capacity of transformers to achieve subtle inductive inferences required for high levels of performance on complex, cognitively significant tasks. In some instances, these arguments misconstrue the nature of deep learning. The latter criticisms identify significant limitations in the way in which transformers learn and represent patterns in data. They also point out important differences between the procedures through which deep neural networks and humans acquire knowledge of natural language. It is necessary to look carefully at both sets of arguments in order to achieve a balanced assessment of the potential and the limitations of LLMs. (shrink)

Emotions are an integral part of human cognition and they guide not only our understanding of the world but also our actions within it. As such, whether we soothe or flame an emotion is not inconsequential. Recent work in conversational AI has focused on responding empathetically to users, validating and soothing their emotions without a real basis. This AI-aided emotional regulation can have negative consequences for users and society, tending towards a one-noted happiness defined as only the absence of "negative" (...) emotions. We argue that we must carefully consider whether and how to respond to users' emotions. (shrink)

Contemporary and emerging chatbots can be fine-tuned to imitate the style, tenor, and knowledge of a corpus, including the corpus of a particular individual. This makes it possible to build chatbots that imitate people who are no longer alive — deathbots. Such deathbots can be used in many ways, but one prominent way is to facilitate the process of grieving. In this paper, we present a framework that helps make sense of this process. In particular, we argue that (...) deathbots can serve as affective scaffolds, modulating and shaping the emotions of the bereaved. We contextualize this affective scaffolding by comparing it to earlier technologies that have also been used to scaffold the process of grieving, arguing that deathbots offer some interesting novelties that may transform the continuing bonds of intimacy that the bereaved can have with the dead. We conclude with some ethical reflections on the promises and perils of this new technology. (shrink)

A series of imitation games involving 3-participant (simultaneous comparison of two hidden entities) and 2-participant (direct interrogation of a hidden entity) were conducted at Bletchley Park on the 100th anniversary of Alan Turing’s birth: 23 June 2012. From the ongoing analysis of over 150 games involving (expert and non-expert, males and females, adults and child) judges, machines and hidden humans (foils for the machines), we present six particular conversations that took place between human judges and a hidden entity that produced (...) unexpected results. From this sample we focus on features of Turing’s machine intelligence test that the mathematician/code breaker did not consider in his examination for machine thinking: the subjective nature of attributing intelligence to another mind. (shrink)

U radu se nastoji prikazati kako se vjera i teologija mogu iskoristiti za testiranje uspješnosti velikih jezičnih modela (LLM–ova) i automatiziranih programa za čavrljanje (chatbotova) pogonjenima na takvim modelima, mjerenjem njihovih filozofskih vještina. Predstavljaju se rezultati testiranja četiriju odabranih chatbotova: ChatGPT, Bing, Bard i Llama2. Za potrebe testiranja uzeta su tri moguća izvora iz područja vjere i teologije: 1) teorija četiri smisla Svetog pisma, 2) apstraktne teološke izjave, 3) apstraktna logička formula izvedena iz vjerskog teksta kako bi se pokazalo da (...) su ovi izvori korisni u zadacima koji učinkovito mjere filozofske vještine kao što su npr. interpretacija danog isječka, kreativna dedukcija te prepoznavanje ontoloških ograničenja. Ovakav pristup omogućuje ispitivanje osjetljivosti kojom se otkrivaju razlike u uspješnosti četiriju chatbotova. Također je dan primjer kako odrediti referentne vrijednosti za ocjenu i usporedbu vještina, koristeći kriterije za procjenu te pojednostavljene skale za ocjenjivanje svakog korištenog chatbota u pogledu ispunjenja pojedinog kriterija. (shrink)

Поводом для составления очередного сборника моих публикаций являются две знаменательные даты: первая из них — двадцатилетие основания моего журнала, покончившего с академическим абсолютизмом, и вторая — десятилетие Конституции общности Русь, отменившей политический деспотизм демократии. Всё остальное, написанное, сказанное, и показанное публике индустрией массового оглупления в этом году, произведено лишь с целью сокрытия истины. Поскольку это в принципе невозможно, то злоумышленникам остаётся только лгать, посредством чего производимый ими мусор они выдают за заслуживающую доверия и жизненно важную информацию, позиционируя себя в качестве (...) неподкупных эталонов достоверности и этичности. Если же отбросить несомый ими в массы вздор, то открывающуюся взору неприглядную картину происходящего можно описать следующим образом: потребители информационного мусора предстают в ней нищебродами на мусорной свалке, в производство которого они вовлечены средствами массового обмана. В продолжении этих двух декад, о которых здесь идёт речь, к прежним фабрикам мусора добавились новые, среди которых TikTok и Telegram Messenger, а с недавних пор в производстве мусора произошёл настоящий технологический прорыв, так что дело, начатое лжецами, теперь продолжают разговорные машины (chatbots). -/- Конечно, позорная профессия мусорщика, навязанная искусственному интеллекту, вряд ли может считаться его призванием. Поскольку ложъ — самое разрушительное оружие, то злоупотребление плодами человеческого разума для лжи и разрушения не ново. В продолжение дурной традиции прошлого, бездари и дураки и на этот раз намереваются превратить благо во зло. Но я не позволю им осуществить их намерения, и в этом мне поможет искусственный интеллект, пусть ещё несовершенный, но уже способный содействовать достижению поставленной цели — очищению Авгиевых конюшен по методу, предложенному уже в античные времена. -/- Автор. (shrink)

챗봇 테이(Tay)는 딥러닝을 통해 스스로 학습하면서 사람들과 대화가 가능한 인공지능이다. 이러한 인공지능은 일상 언어를 잘 사용하는 듯 하지만 편향된 방식으로 학습할 경우 개념을 결여한 듯 보이는 발언을 하기도 한다. 이에 대해 필자는 약한 의미의 개념 소유와 강한 의미의 개념 소유를 구분한 다음, 테이가 약한 의미에서는 개념을 소유하지만 강한 의미에서는 개념을 소유하지 않음을 논증한다. 이는 생각하며 대화하는 인공지능이 가능한가에 대한 비판적 접근의 일환이다.

Griefbots are chatbots designed to assist individuals in coping with the loss of a loved one by offering a digital replica of the departed. Navigating grief is a deeply transformative and vulnerable journey intricately tied to one's well-being. Do griefbots aid in the grieving process, or do they complicate it? To address these questions, this article blends insights from philosophy and neuroscience to explore the nature of grief as a means to clarify the ethical dimensions surrounding the use of (...) griefbots. (shrink)

Growing demand for broadly accessible mental health care, together with the rapid development of new technologies, trigger discussions about the feasibility of psychotherapeutic interventions based on interactions with Conversational Artificial Intelligence (CAI). Many authors argue that while currently available CAI can be a useful supplement for human-delivered psychotherapy, it is not yet capable of delivering fully fledged psychotherapy on its own. The goal of this paper is to investigate what are the most important obstacles on our way to developing CAI (...) systems capable of delivering psychotherapy in the future. To this end, we formulate and discuss three challenges central to this quest. Firstly, we might not be able to develop effective AI-based psychotherapy unless we deepen our understanding of what makes human-delivered psychotherapy effective. Secondly, assuming that it requires building a therapeutic relationship, it is not clear whether psychotherapy can be delivered by non-human agents. Thirdly, conducting psychotherapy might be a problem too complicated for narrow AI, i.e., AI proficient in dealing with only relatively simple and well-delineated tasks. If this is the case, we should not expect CAI to be capable of delivering fully-fledged psychotherapy until the so-called “general” or “human-like” AI is developed. While we believe that all these challenges can ultimately be overcome, we think that being mindful of them is crucial to ensure well-balanced and steady progress on our path to AI-based psychotherapy. (shrink)

This paper presents an overview of the risks and benefits of Social AI, understood as conversational AI systems that cater to human social needs like romance, companionship, or entertainment. Section 1 of the paper provides a brief history of conversational AI systems and introduces conceptual distinctions to help distinguish varieties of Social AI and pathways to their deployment. Section 2 of the paper adds further context via a brief discussion of anthropomorphism and its relevance to assessment of human-chatbot relationships. Section (...) 3 of the paper provides a survey of potential and in some cases demonstrated harms associated with user interactions with Social AI systems. Finally, Section 4 discusses how the benefits and harms of Social AI can best be addressed, with a primary focus on how frameworks from AI ethics can inform their development. (shrink)

ChatGPT is an artificial intelligence (AI) chatbot that processes and generates natural language text, offering human-like responses to a wide range of questions and prompts. Five days after its re...

Current research in artificial intelligence (AI) sheds light on algorithmic bias embedded in AI systems. The underrepresentation of women in the AI design sector of the tech industry, as well as in training datasets, results in technological products that encode gender bias, reinforce stereotypes and reproduce normative notions of gender and femininity. Biased behaviour is notably reflected in anthropomorphic AI systems, such as personal intelligent assistants (PIAs) and chatbots, that are usually feminized through various design parameters, such as names, (...) voices and traits. Gendering of AI entities, however, is often reduced to the encoding of stereotypical behavioural patterns that perpetuate normative assumptions about the role of women in society. The impact of this behaviour on social life increases, as human-to-(anthropomorphic)machine interactions are mirrored in human-to-human social interactions. This article presents current critical research on AI bias, focusing on anthropomorphic systems. Moreover, it discusses the significance of women’s engagement in AI design and programming, by presenting selected case studies of contemporary female media artists and designers. Finally, it suggests that women, through their creative practice, provide feminist and critical approaches to AI design which are essential for imagining alternative, inclusive, ethic and de-biased futures for anthropomorphic AIs. (shrink)

This paper focuses on the fact that AI is predominantly portrayed as white—in colour, ethnicity, or both. We first illustrate the prevalent Whiteness of real and imagined intelligent machines in four categories: humanoid robots, chatbots and virtual assistants, stock images of AI, and portrayals of AI in film and television. We then offer three interpretations of the Whiteness of AI, drawing on critical race theory, particularly the idea of the White racial frame. First, we examine the extent to which (...) this Whiteness might simply reflect the predominantly White milieus from which these artefacts arise. Second, we argue that to imagine machines that are intelligent, professional, or powerful is to imagine White machines because the White racial frame ascribes these attributes predominantly to White people. Third, we argue that AI racialised as White allows for a full erasure of people of colour from the White utopian imaginary. Finally, we examine potential consequences of the racialisation of AI, arguing it could exacerbate bias and misdirect concern. (shrink)

The exponential growth of algorithms has made establishing a trusted relationship between human and artificial intelligence increasingly important. Algorithm systems such as chatbots can play an important role in assessing a user’s credibility on algorithms. Unless users believe the chatbot’s information is credible, they are not likely to be willing to act on the recommendation. This study examines how literacy and user trust influence perceptions of chatbot information credibility. Results confirm that algorithmic literacy and users’ trust play a pivotal (...) role in how users form perceptions of the credibility of chatbot messages and recommendations. Insights on how user trust is related to credibility provide a useful perspective on the conceptualization of algorithmic credibility. Algorithmic information processing that has been identified provides better foundations for algorithm design and development and a stronger basis for the design of sense-making chatbot journalism. (shrink)

Michael A PetersBeijing Normal UniversityChatGPT is an AI chatbot released by OpenAI on November 30, 2022 and a ‘stable release’ on February 13, 2023. It belongs to OpenAI’s GPT-3 family (generativ...