A virtual dialogue interface for soft interaction between a system and a user is proposed. It enables the information acquisition as a sub task without hindering the user main task during the main task execution. A virtual dialogue is performed with suitable timing between the two characters used in this interface: the user avatar with a model obtained by observing the interaction of the user and the environment, and an agent having the knowledge (...) about the environment. The user is usually an indirect participant performing ``soft interaction'' as an onlooker of the system behavior (dialogue between the user avatar and the agent), and only when required he can participate through a direct interaction instead of his avatar. A car navigation interface was used to examine the applicability of the proposed technique. A task of memorizing information about one's profile while performing an operation task was given and the rate of main task execution and rate of related information memory were used as evaluation criteria. Our proposed method showed outstanding results comparing to the conventional direct interactive interface. Moreover, the degree of favorable impression for the proposed interface was higher than the conventional one and the subjectivity evaluation clearly showed that it was considered as a sociable interface. (shrink)

Soft robots promise an exciting design trajectory in the field of robotics and human–robot interaction (HRI), promising more adaptive, resilient movement within environments as well as a safer, more sensitive interface for the objects or agents the robot encounters. In particular, tactile HRI is a critical dimension for designers to consider, especially given the onrush of assistive and companion robots into our society. In this article, we propose to surface an important set of ethical challenges for the field (...) of soft robotics to meet. Tactile HRI strongly suggests that soft-bodied robots balance tactile engagement against emotional manipulation, model intimacy on the bonding with a tool not with a person, and deflect users from personally and socially destructive behavior the soft bodies and surfaces could normally entice. (shrink)

Formal dialogue games have been studied in philosophy since at least the time of Aristotle. Recently they have been applied in various contexts in computer science and artificial intelligence, particularly as the basis for interaction between autonomous software agents. We review these applications and discuss the many open research questions and challenges at this exciting interface between philosophy and computer science.

The construction of embodied conversational agents - robots as well as avatars - seem to be a new challenge in the field of both cognitive AI and human-computer-interface development. On the one hand, one aims at gaining new insights in the development of cognition and communication by constructing intelligent, physical instantiated artefacts. On the other hand people are driven by the idea, that humanlike mechanical dialog-partners will have a positive effect on human-machine-communication. In this contribution I put for discussion whether (...) the visions of scientist in this field are plausible and which problems might arise by the realization of such projects. (shrink)

Social judgment is a social inference process whereby an agent singles out individuals to blame or credit for multi-agent activities. Such inferences are a key aspect of social intelligence that underlie social planning, social learning, natural language pragmatics and computational models of emotion. With the advance of multi-agent interactive systems and the need of designing socially aware systems and interfaces to interact with people, it is increasingly important to model this human-centric form of social inference. Based on psychological attribution theory, (...) this paper presents a general computational framework to automate social inference based on an agent’s causal knowledge and observations of interaction. (shrink)

This article describes and evaluates an approach to create and/or improve tactical agents through direct human interaction in real time through a force-feedback haptic device. This concept takes advantage of a force-feedback joystick to enhance motor skill and decision-making transfer from the human to the agent in real time. Haptic devices have been shown to have high bandwidth and sensitivity. Experiments are described for this new approach, named Instructional Learning. It is used both as a way to build agents (...) from scratch as well as to improve and/or correct agents built through other means. The approach is evaluated through experiments that involve three applications of increasing complexity – chasing a fleer, shepherding a flock of sheep into a pen, and driving a virtual automobile through a simulated road network. The results indicate that in some instances, instructional learning can successfully create agents under some circumstances. However, instructional learning failed to build and/or improve agents in other instances. The Instructional Learning approach, the experiments, and their results are described and extensively discussed. (shrink)

The positive qualities of the Internet--anonymity, openness, and reproducibility have added a new ethical dimension to the privacy debate. This paper describes a new and significant way in which privacy is violated. A type of personal information, called virtual information is described and the effectiveness of techniques to protect this type of information is examined. This examination includes a discussion of technical approaches and professional standards as ways to address this violation of virtual information.

Embodied interface agents are designed to ease the use of technology. Furthermore, they present one possible solution for future interaction scenarios beyond the desktop metaphor. Trust and believability play an important role in the relationship between user and the virtual counterpart. In order to reach this goal, a high degree of anthropomorphism in appearance and behavior of the artifact is pursued. According to the notion of the Uncanny Valley, however, this actually may have quite the opposite effect. This (...) article provides an analysis of the Uncanny Valley effect from a cultural and gender studies perspective. It invites readers to take a closer look at the narratives that influence the production of anthropomorphic artifacts. The article starts with a short introduction of the idea of the Uncanny Valley and gives a brief overview of current artifacts. Following this, a semiotic view on computer science is proposed, which in a further step serves as an epistemological grounding for a gender-critical rereading of the Turing test. This perspective will be supported by analyzing a classic story of user and artifact—E.T.A. Hoffmann’s narration of Olimpia. Finally, the special character of anthropomorphic artifacts is discussed by taking Freud’s concept of “Das Unheimliche”, as well as theories of identity formation into consideration, closing with a plea for a more diverse artifact production. (shrink)

Dialogue systems, from Virtual Personal Assistants such as Siri, Cortana, and Alexa to state-of-the-art systems such as BlenderBot3 and ChatGPT, are already widely available, used in a variety of applications, and are increasingly part of many people’s lives. However, the task of enabling them to use empathetic language more convincingly is still an emerging research topic. Such systems generally make use of complex neural networks to learn the patterns of typical human language use, and the interactions in which (...) the systems participate are usually mediated either via interactive text-based or speech-based interfaces. In human–human interaction, empathy has been shown to promote prosocial behaviour and improve interaction. In the context of dialogue systems, to advance the understanding of how perceptions of empathy affect interactions, it is necessary to bring greater clarity to how empathy is measured and assessed. Assessing the way dialogue systems create perceptions of empathy brings together a range of technological, psychological, and ethical considerations that merit greater scrutiny than they have received so far. However, there is currently no widely accepted evaluation method for determining the degree of empathy that any given system possesses (or, at least, appears to possess). Currently, different research teams use a variety of automated metrics, alongside different forms of subjective human assessment such as questionnaires, self-assessment measures and narrative engagement scales. This diversity of evaluation practice means that, given two DSs, it is usually impossible to determine which of them conveys the greater degree of empathy in its dialogic exchanges with human users. Acknowledging this problem, the present article provides an overview of how empathy is measured in human–human interactions and considers some of the ways it is currently measured in human–DS interactions. Finally, it introduces a novel third-person analytical framework, called the Empathy Scale for Human–Computer Communication (ESHCC), to support greater uniformity in how perceived empathy is measured during interactions with state-of-the-art DSs. (shrink)

We describe how Intuitionistic Linear Logic can be used to provide a unified logical account for agents to find and execute plans. This account supports the modelling of agent interaction, including dialogue; allows agents to be robust to unexpected events and failures; and supports significant reuse of agent specifications. The framework has been implemented and several case studies have been considered. Further applications include human–computer interfaces as well as agent interaction in the semantic web.

This article describes research to build an embodied conversational agent as an interface to a question-and-answer system about a National Science Foundation program. We call this ECA the LifeLike Avatar, and it can interact with its users in spoken natural language to answer general as well as specific questions about specific topics. In an idealized case, the LifeLike Avatar could conceivably provide a user with a level of interaction such that he or she would not be certain as to (...) whether he or she is talking to the actual person via video teleconference. This could be considered a extended version of the seminal Turing test. Although passing such a test is still far off, our work moves the science in that direction. The Uncanny Valley notwithstanding, applications of such lifelike interfaces could include those where specific instructors/caregivers could be represented as stand-ins for the actual person in situations where personal representation is important. Possible areas that come to mind that might benefit from these lifelike ECAs include health-care support for elderly/disabled patients in extended home care, education/training, and knowledge preservation. Another more personal application would be to posthumously preserve elements of the persona of a loved one by family members. We apply this approach to a Q/a system for knowledge preservation and dissemination, where the specific individual who had this knowledge was to retire from the US National Science Foundation. The system is described in detail, and evaluations were performed to determine how well the system was perceived by users. (shrink)

We propose to expand the conversation around moral enhancement from direct brain-altering methods to include technological means of modifying the environments and media through which agents can achieve moral improvement. Virtual Reality (VR) based enhancement would not bypass a person’s agency, much less their capacity for reasoned reflection. It would allow agents to critically engage with moral insights occasioned by a technologically mediated intervention. Users would gain access to a vivid ‘experience machine’ that allows for embodied presence and immersion (...) in a virtual world that meaningfully replicates relevant aspects of real life. We explore how VR can train empathy and foster moral growth in complex ways that would be inaccessible even for traditional moral education. Virtual Reality Perspective Taking is a unique medium for making empathy more reflective. (shrink)

Computer modelling of personality and behaviour is becoming increasingly important in many fields of computer science and psychology. Personality and emotion-driven Believable Agents are needed in areas like human–machine interfaces, electronic advertising and, most notably, electronic entertainment. Computer models of personality can help explain personality by illustrating its underlying structure and dynamics. This work presents a neural network model of personality and personality change. The goals are to help understand personality and create more realistic and believable characters for interactive video (...) games. The model is based largely on trait theories of personality. Behaviour in the model results from the interaction of three components: personality-based predispositions for behaviour, moods/emotions and environmental situations. Personality develops gradually over time depending on the situations encountered. Modelling personality change produces interesting and believable virtual characters whose behaviours change in psychologically plausible ways. (shrink)

Open peer commentary on the article “Investigating Extended Embodiment Using a Computational Model and Human Experimentation” by Yuki Sato, Hiroyuki Iizuka & Takashi Ikegami. Upshot: First, we comment on a potential weakness highlighted by the use of self-reporting in the human-coupled windmill experiment as described in the target article. Second, we suggest that the authors treat their windmill models as soft-assembled dynamical systems. This would allow them to investigate extended body schemes by looking for 1/f noise in the interface (...) between the agent and the windmills. (shrink)

The virtual community under consideration is called theNigerian Village Square, ‘…a marketplace of ideas’. As an online discussion forum, NVS combines the features of listservs and newsgroups with a more elegant and user-friendly interface. While computer-mediated communication technologies augment political discourse in established democracies, new media and mobile technologies create avenues for a virtual sphere among Nigerians. Therefore, the ideal virtual sphere guarantees equal access to all connected netizens, equal right for all languages in netizens’ linguistic repertoire, (...) and it fosters democratic deliberation through policy debates, public dialogues and ‘online polylogues’. By linguistic marketing is meant discourse as a vehicle for ‘promotional acts’ and for ‘selling’ particular cultures and ideologies to multicultural and multilingual readers/audiences. One interpretation of this is in terms of asserting language rights and linguistic equality. The use of Nigerian languages with Nigerian Pidgin online is promotional and forexistential negotiation. This results in language mixture which is an instantiation of freedom of speech, freedom of switch and freedom to switch. The underlying pragmatic motivation for top-down language mixture and alternation in Nigerian virtual discourse is attention-getting with the aim of inducing an interdiscursive writer-reader cognitive as well as communicative interaction. Other pragmatic functions of code switching discussed in the paper include allusive textuality, amusing phaticity, anticipated interactivity, affective expressivity and audience affiliation or alienation, among others. Thus, intertextuality is an explanatory technique for investigating previously unexplored phenomena in digital code switching. (shrink)

Despite their potential for facilitating interaction between a user and computer, an embodied agent and voice command have not been examined enough for their matching effects. The current study proposes that an embodied agent and voice command generate positive evaluative outcomes, particularly when they are accompanied by each other. To test this prediction, we conducted a 2 (visual output: embodied agent vs. geometric figure) × 2 (input modality: voice command vs. remote controller) between-subjects experiment (N = 52), and examined (...) whether visual output and input modality jointly influence participants’ social attribution (i.e., anthropomorphism, animacy, likability, and perceived intelligence), social presence, and satisfaction. Results show that voice command does facilitate users’ social attribution and social presence, but only when an embodied agent was presented. Also, the effects of voice command on social presence and satisfaction were mediated by anthropomorphism and perceived intelligence respectively, but only when the interface displayed an embodied agent. The present study evidences the holistic nature of human-computer interaction, revealing the importance of matches in the input and output interface. (shrink)

Critics have argued that human-controlled avatar interactions fail to facilitate the kinds of expressivity and social understanding afforded by our physical bodies. We identify three claims meant to justify the supposed expressive limits of avatar interactions compared to our physical interactions. First, “The Limited Expressivity Claim”: avatars have a more limited expressive range than our physical bodies. Second, “The Inputted Expressivity Claim”: any expressive avatarial behaviour must be deliberately inputted by the user. Third, “The Decoding Claim”: users must infer or (...) figure out the expressive meaning of human-controlled avatars’ behaviour through cognitively onerous processes. With the aim of critically assessing all three claims, we analyze data collected through observations of and interviews with expert players of the avatar-based video game League of Legends. Focusing on Daniel Stern’s (2010) notion of vitality, we analyze the participants’ descriptions of seeing and interacting with other avatars during performance. Our analysis shows that the informants experience human-based avatarial interactions as qualitatively different than interactions with bots, that the informants see the movements of other players’ avatars as having different expressive styles, and that the informants actively use and manipulate this avatarial expressivity during performance. The results of our analysis, we argue, provide reasons for loosening or resisting the three claims concerning the limits of avatarial expressivity. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:Future Environmental Philosophies and Their Biocultural Conservation InterfacesRicardo Rozzi (bio)Perhaps it would be better to speak of the future of environmental philosophies, rather than of the future of environmental philosophy. Making explicit a plurality of future trends helps prevent an "Anglo-academic" bias, and emphasizes the need for further developing environmental philosophy into at least two directions: (1) a stronger dialogical interaction with the diverse international constellation of cultural, (...) ethnic, social, political, economic, and ecological dimensions of environmental problems; and (2) a greater integration into the transdisciplinary field of biological and cultural conservation, involving an enhanced actualization of environmental theoretical philosophy into environmental practical philosophy.1. Toward more multi-discursive international environmental philosophiesFurther developing international environmental philosophy can help [End Page 142] to more precisely identify agents and causes of environmental problems, as well as their effects and victims. For instance, the focus on global climate change—and more generally global change, including other processes of rapid environmental transformation such as biotic, linguistic, and cultural homogenization—should not overlook the fact that different human communities, regions, societies, and countries are not equally responsible for such change nor suffer equally from its consequences. For example, today the highest levels of UV radiation fall on areas of Patagonia and the Antarctic Peninsula. These regions are the farthest away from the centers of CFC emissions which generate the stratospheric ozone hole found over the austral portion of the Americas.1 The incorporation of these type of regional distinctions into environmental philosophy provides the opportunity for more precise diagnoses and characterizations of environmental problems than the still-frequent generalizations stated in terms of problems between "humanity and nature."2 Such a lack of specificity is deceptive because it absolves particular responsible agents of environmental problems by referring to all humans or society in general as responsible for them.Secondly, contrasting ecological, social, and political settings generate not only different environmental problems, but also offer a variety of viable options for solving those problems. This is a point that remains frequently overlooked within global environmental agendas. While working in conservation in Latin America, I am continuously surprised by the marked ecological and cultural singularities I find in different localities in which communities have evolved peculiar ways of understanding, valuing, and interacting with their environments.3 On the one hand, environmental philosophy would enrich itself by further incorporating this biocultural diversity. On the other hand, environmental philosophy could provide a valuable contribution to biocultural conservation by better articulating the understanding the reticulate diversity of ecological knowledge and practices that indigenous and non-indigenous old-resident communities have co-evolved with particular ecosystems and historic and cultural settings around the world.Finally, furthering the participation of environmental thinkers of different regions and strengthening environmental philosophy networks could contribute to an international dialogue that would generate more pertinent concepts and propositions by more deeply embracing local [End Page 143] social, historical, political, cultural, linguistic, and ecosystem realities. The dynamic diversity of human ecological worldviews and practices has been addressed by the field of environmental philosophy;4 however, this diversity has still not been sufficiently incorporated as part of a multi-discursive community.* * *2. Incorporating environmental philosophy into the theory and praxis of biocultural conservationDuring the last two decades, a main goal of ecological sciences and biological conservation has been a better integration between human and natural systems. Under currently prevailing scientific approaches, such reconnection has been developed primarily through economic valuation of "ecosystem services" (see, for example, the recent landmark Millennium Ecosystem Assessment).5 Environmental philosophy has had a weak presence as compared to ecological economics in the transdiscipline of biological conservation. This weak presence is mismatched with the numerous calls made by ecologists about the need for environmental ethics, and with the frequent reference to ethical values made by international environmental conventions. For instance, the text of the Convention on Biological Diversity begins with a reference to the intrinsic value of biodiversity but it does not develop this notion at all.6 Similarly, the Millennium Ecosystem Assessment mentions the intrinsic value of biodiversity but does not develop the notion, and ends up justifying the need for its conservation in terms of economic values... (shrink)

Constraints and dependencies among the elements of embodied cognition form patterns or microstrategies of interactive behavior. Hard constraints determine which microstrategies are possible. Soft constraints determine which of the possible microstrategies are most likely to be selected. When selection is non‐deliberate or automatic the least effort microstrategy is chosen. In calculating the effort required to execute a microstrategy each of the three types of operations, memory retrieval, perception, and action, are given equal weight; that is, perceptual‐motor activity does not (...) have a privileged status with respect to memory. Soft constraints can work contrary to the designer's intentions by making the access of perfect knowledge in‐the‐world more effortful than the access of imperfect knowledge in‐the‐head. These implications of soft constraints are tested in two experiments. In experiment 1 we varied the perceptual‐motor effort of accessing knowledge in‐the‐world as well as the effort of retrieving items from memory. In experiment 2 we replicated one of the experiment 1 conditions to collect eye movement data. The results suggest that milliseconds matter. Soft constraints lead to a reliance on knowledge in‐the‐head even when the absolute difference in perceptual‐motor versus memory retrieval effort is small, and even when relying on memory leads to a higher error rate and lower performance. We discuss the implications of soft constraints for routine interactive behavior, accounts of embodied cognition, and tool and interface design. (shrink)

Clark and Fischer argue that people see social robots as depictions of social agents. However, people's interactions with virtual assistants may change their beliefs about social robots. Children and adults with exposure to virtual assistants may view social robots not as depictions of social agents, but as social agents belonging to a unique ontological category.

Constraints and dependencies among the elements of embodied cognition form patterns or microstrategies of interactive behavior. Hard constraints determine which microstrategies are possible. Soft constraints determine which of the possible microstrategies are most likely to be selected. When selection is non-deliberate or automatic the least effort microstrategy is chosen. In calculating the effort required to execute a microstrategy each of the three types of operations, memory retrieval, perception, and action, are given equal weight; that is, perceptual-motor activity does not (...) have a privileged status with respect to memory. Soft constraints can work contrary to the designer's intentions by making the access of perfect knowledge in-the-world more effortful than the access of imperfect knowledge in-the-head. These implications of soft constraints are tested in two experiments. In experiment 1 we varied the perceptual-motor effort of accessing knowledge in-the-world as well as the effort of retrieving items from memory. In experiment 2 we replicated one of the experiment 1 conditions to collect eye movement data. The results suggest that milliseconds matter. Soft constraints lead to a reliance on knowledge in-the-head even when the absolute difference in perceptual-motor versus memory retrieval effort is small, and even when relying on memory leads to a higher error rate and lower performance. We discuss the implications of soft constraints for routine interactive behavior, accounts of embodied cognition, and tool and interface design. (shrink)

Interactions between an intelligent software agent and a human user are ubiquitous in everyday situations such as access to information, entertainment, and purchases. In such interactions, the ISA mediates the user’s access to the content, or controls some other aspect of the user experience, and is not designed to be neutral about outcomes of user choices. Like human users, ISAs are driven by goals, make autonomous decisions, and can learn from experience. Using ideas from bounded rationality, we frame these interactions (...) as instances of an ISA whose reward depends on actions performed by the user. Such agents benefit by steering the user’s behaviour towards outcomes that maximise the ISA’s utility, which may or may not be aligned with that of the user. Video games, news recommendation aggregation engines, and fitness trackers can all be instances of this general case. Our analysis facilitates distinguishing various subcases of interaction, as well as second-order effects that might include the possibility for adaptive interfaces to induce behavioural addiction, and/or change in user belief. We present these types of interaction within a conceptual framework, and review current examples of persuasive technologies and the issues that arise from their use. We argue that the nature of the feedback commonly used by learning agents to update their models and subsequent decisions could steer the behaviour of human users away from what benefits them, and in a direction that can undermine autonomy and cause further disparity between actions and goals as exemplified by addictive and compulsive behaviour. We discuss some of the ethical, social and legal implications of this technology and argue that it can sometimes exploit and reinforce weaknesses in human beings. (shrink)

Despite their potential for facilitating interaction between a user and computer, an embodied agent and voice command have not been examined enough for their matching effects. The current study proposes that an embodied agent and voice command generate positive evaluative outcomes, particularly when they are accompanied by each other. To test this prediction, we conducted a 2 (visual output: embodied agent vs. geometric figure) × 2 (input modality: voice command vs. remote controller) between-subjects experiment (N = 52), and examined (...) whether visual output and input modality jointly influence participants’ social attribution (i.e., anthropomorphism, animacy, likability, and perceived intelligence), social presence, and satisfaction. Results show that voice command does facilitate users’ social attribution and social presence, but only when an embodied agent was presented. Also, the effects of voice command on social presence and satisfaction were mediated by anthropomorphism and perceived intelligence respectively, but only when the interface displayed an embodied agent. The present study evidences the holistic nature of human-computer interaction, revealing the importance of matches in the input and output interface. (shrink)

Social interaction is both ubiquitous and central to understanding human behavior. Such interactions depend, we argue, on shared intentionality: the parties must form a common understanding of an ambiguous interaction (e.g., one person giving a present to another requires that both parties appreciate that a voluntary transfer of ownership is intended). Yet how can shared intentionality arise? Many well-known accounts of social cognition, including those involving “mind-reading,” typically fall into circularity and/or regress. For example, A’s beliefs and behavior (...) may depend on her prediction of B’s beliefs and behavior, but B’s beliefs and behavior depend in turn on her prediction of A’s beliefs and behavior. One possibility is to embrace circularity and take shared intentionality as imposing consistency conditions on beliefs and behavior, but typically there are many possible solutions and no clear criteria for choosing between them. We argue that addressing these challenges requires some form of we-reasoning, but that this raises the puzzle of how the collective agent (the “we”) arises from the individual agents. This puzzle can be solved by proposing that the will of the collective agent arises from a simulated process of bargaining: agents must infer what they would agree, were they able to communicate. This model explains how, and which, shared intentions are formed. We also propose that such “virtual bargaining” may be fundamental to understanding social interactions. (shrink)

Social interaction is both ubiquitous and central to understanding human behavior. Such interactions depend, we argue, on shared intentionality: the parties must form a common understanding of an ambiguous interaction. Yet how can shared intentionality arise? Many well-known accounts of social cognition, including those involving “mind-reading,” typically fall into circularity and/or regress. For example, A’s beliefs and behavior may depend on her prediction of B’s beliefs and behavior, but B’s beliefs and behavior depend in turn on her prediction (...) of A’s beliefs and behavior. One possibility is to embrace circularity and take shared intentionality as imposing consistency conditions on beliefs and behavior, but typically there are many possible solutions and no clear criteria for choosing between them. We argue that addressing these challenges requires some form of we-reasoning, but that this raises the puzzle of how the collective agent arises from the individual agents. This puzzle can be solved by proposing that the will of the collective agent arises from a simulated process of bargaining: agents must infer what they would agree, were they able to communicate. This model explains how, and which, shared intentions are formed. We also propose that such “virtual bargaining” may be fundamental to understanding social interactions. (shrink)

Social interaction is both ubiquitous and central to understanding human behavior. Such interactions depend, we argue, on shared intentionality: the parties must form a common understanding of an ambiguous interaction (e.g., one person giving a present to another requires that both parties appreciate that a voluntary transfer of ownership is intended). Yet how can shared intentionality arise? Many well-known accounts of social cognition, including those involving “mind-reading,” typically fall into circularity and/or regress. For example, A’s beliefs and behavior (...) may depend on her prediction of B’s beliefs and behavior, but B’s beliefs and behavior depend in turn on her prediction of A’s beliefs and behavior. One possibility is to embrace circularity and take shared intentionality as imposing consistency conditions on beliefs and behavior, but typically there are many possible solutions and no clear criteria for choosing between them. We argue that addressing these challenges requires some form of we-reasoning, but that this raises the puzzle of how the collective agent (the “we”) arises from the individual agents. This puzzle can be solved by proposing that the will of the collective agent arises from a simulated process of bargaining: agents must infer what they would agree, were they able to communicate. This model explains how, and which, shared intentions are formed. We also propose that such “virtual bargaining” may be fundamental to understanding social interactions. (shrink)

We use speech shadowing to create situations wherein people converse in person with a human whose words are determined by a conversational agent computer program. Speech shadowing involves a person (the shadower) repeating vocal stimuli originating from a separate communication source in real-time. Humans shadowing for conversational agent sources (e.g., chat bots) become hybrid agents ("echoborgs") capable of face-to-face interlocution. We report three studies that investigated people’s experiences interacting with echoborgs and the extent to which echoborgs pass as autonomous humans. (...) First, participants in a Turing Test spoke with a chat bot via either a text interface or an echoborg. Human shadowing did not improve the chat bot’s chance of passing but did increase interrogators’ ratings of how human-like the chat bot seemed. In our second study, participants had to decide whether their interlocutor produced words generated by a chat bot or simply pretended to be one. Compared to those who engaged a text interface, participants who engaged an echoborg were more likely to perceive their interlocutor as pretending to be a chat bot. In our third study, participants were naïve to the fact that their interlocutor produced words generated by a chat bot. Unlike those who engaged a text interface, the vast majority of participants who engaged an echoborg neither sensed nor suspected a robotic interaction. These findings have implications for android science, the Turing Test paradigm, and human-computer interaction. The human body, as the delivery mechanism of communication, fundamentally alters the social psychological dynamics of interactions with machine intelligence. (shrink)

What is an avatar -- More than just another pretty face : the avatar effect -- Interview with the virtual cannibal -- Virtual presence -- X-reality, a conclusion.

Numerous research groups around the world are attempting to build realistic and believable autonomous embodied agents that attempt to have natural interactions with users. Research into these entities has primarily focused on their potential to enhance human–computer interaction. As a result, there is little understanding of the potential for embodied entities to abuse and manipulate users for questionable purposes. We highlight the potential opportunities for abuse when interacting with embodied agents in virtual worlds and discuss how our social (...) interactions with such entities can contribute to abusive behaviour. Suggestions for reducing such risks are also provided, along with suggestions for important future research areas. (shrink)

Numerous research groups around the world are attempting to build realistic and believable autonomous embodied agents that attempt to have natural interactions with users. Research into these entities has primarily focused on their potential to enhance human–computer interaction. As a result, there is little understanding of the potential for embodied entities to abuse and manipulate users for questionable purposes. We highlight the potential opportunities for abuse when interacting with embodied agents in virtual worlds and discuss how our social (...) interactions with such entities can contribute to abusive behaviour. Suggestions for reducing such risks are also provided, along with suggestions for important future research areas. (shrink)

Anthropomorphic agents used in online-shopping need to be trusted by users so that users feel comfortable buying products. In this paper, we propose a model for designing trustworthy agents by assuming two factors of trust, that is, emotion and knowledgeableness perceived. Our hypothesis is that when a user feels happy and perceives an agent as being highly knowledgeable, a high level of trust results between the user and agent. We conducted four experiments with participants to verify this hypothesis by preparing (...) transition operators utilizing emotional contagion and knowledgeable utterances. As a result, we verified that users' internal states transitioned as expected and that the two factors significantly influenced their trust states. (shrink)

Natural dialogue does not proceed haphazardly; it has an easily recognized “episodic” structure and coherence which conform to a well developed set of conventions. This paper represents these conventions formally in terms related to speech act theory and to a theory of action.The major formal unit, the dialogue game, specifies aspects of the communication of both participants in a dialogue. We define the formal notion of dialogue games, and describe some of the important games of English. (...) Dialogue games are conventions of interactive goal pursuit. Using them, each participant pursues his own goals in a way which sometimes serves the goals of the other. The idea of dialogue games can thus be seen as a part of a broader theoretical perspective which characterizes virtually all communication as goal pursuit activity.We also define and exemplify the property of Motivational Coherence of dialogues. Motivational Coherence can be used as an interpretive principle in explaining language comprehension.Actual dialogue games have a kind of causal connectedness which is not a consequence of their formal properties. This is explained in terms of a theory of action, which is also seen to explain a similar attribute of speech acts. (shrink)

This paper presents a gamified motor imagery brain-computer interface (MI-BCI) training in immersive virtual reality. Aim of the proposed training method is to increase engagement, attention, and motivation in co-adaptive event-driven MI-BCI training. This was achieved using gamification, progressive increase of the training pace, and virtual reality design reinforcing the body ownership transfer (embodiment) into the avatar. From the 20 healthy participants performing 6 runs of 2-class MI-BCI training (left/right hand), 19 were trained for a basic level of (...) MI-BCI operation, with average peak accuracy in the session equal to 75.84\%. This confirms the proposed training method succeeded in improvement of the MI-BCI skills; moreover, participants were leaving the session in high positive affect. Although the performance was not directly correlated to the degree of embodiment, subjective magnitude of the body ownership transfer illusion correlated with the abilities to modulate the sensorimotor rhythm. (shrink)

Advances in artificial intelligence (AI) create an increasing similarity between the performance of AI systems or AI-based robots and human communication. They raise the questions: whether it is possible to communicate with, understand, and even empathically perceive artificial agents; whether we should ascribe actual subjectivity and thus quasi-personal status to them beyond a certain level of simulation; what will be the impact of an increasing dissolution of the distinction between simulated and real encounters. (1) To answer these questions, the paper (...) argues that the precondition for actually understanding others consists in the implicit assumption of the subjectivity of our counterpart, which makes shared feelings and a „we-intentionality” possible. This assumption is ultimately based on the presupposition of a shared form of life, conceived here as „conviviality.” (2) The possibility that future artificial agents could meet these preconditions is refuted on the basis of embodied and enactive cognition, which links subjectivity and consciousness to the aliveness of an organism. (3) Even if subjectivity is in principle impossible for artificial agents, the distinction between simulated and real subjectivity might nevertheless become increasingly blurred. Here, possible consequences are discussed, especially using the example of virtual psychotherapy. Finally, the paper makes case for a mindful appproach to the language we use to talk about artificial systems and pleads for preventing a systematic pretense of subjectivity. (shrink)

‘SWAMPLAB’ is a strong case for intuitive insights through arts, sciences, and technologies to engage the self and establish meaningful social interactions including humans and non-humans. While zigzagging through processes of privatization, globalization, ecological, economic, social and political challenges, the power of such residencies or labs stems from the interplay with the local context and its habitants, in this case, nature reserve De Zegge, a 111 hectares swamp in the Northern part of Belgium. Mediation and participation are a core condition (...) for the design of knowledge and engagement since without informed consent and participants understanding the nature of the process, no change is possible. The more individuals express and explore their knowledge through social encounters, narratives, and dialogs, the more crucial tacit knowledge can be shared. Making things disputable is another responsibility. In society at large, there are very few examples where people feel interconnected and yet at the same time can disagree. The notion of Swamplab is rather a call for wonderment, for not using each other as a stepping stone but setting up open dialogs, listening and reflecting together, playing around, tinkering, since messiness is allowed. Including non-humans, be they wolves, moles or avatars, and virtual agents, is key to cracking the individual resistance to change understandings, opinions, and behavior. The result may lead to deeper engagement and Buckminster Fuller’s “comprehensive anticipatory design science” or what Bruno Latour calls a “progressive composition of the good common world”. (shrink)

This paper addresses the problem of human–computer interactions when the computer can interpret and express a kind of human-like behavior, offering natural communication. A conceptual framework for incorporating emotions with rationality is proposed. A model of affective social interactions is described. The model utilizes the SAIBA framework, which distinguishes among several stages of processing of information. The SAIBA framework is extended, and a model is realized in human behavior detection, human behavior interpretation, intention planning, attention tracking behavior planning, and behavior (...) realization components. Two models of incorporating emotions with rationality into a virtual artifact are presented. The first one uses an implicit implementation of emotions. The second one has an explicit realization of a three-layered model of emotions, which is highly interconnected with other components of the system. Details of the model with implicit implementation of emotional behavior are shown as well as evaluation methodology and results. Discussions about the extended model of an agent are given in the final part of the paper. (shrink)

Roxanne Kurtz has argued that the "virtual rape" of a character in a computer-generated world (an avatar) shares many (though obviously not all) of the wrong-making features of physical rape in the real world. I agree in part, but argue that, due to the typical features of virtual worlds, its wrongfulness is dominated by the harm it does to the avatar user's capacity for social interaction and self-representation. In the course of the argument I hope to shed (...) more light upon the nature of avatars, and their relationship to "offline" avatars in, e.g., role-playing and children's games. (shrink)

This research paper explores the implications of emotional intelligence and the Big Five personality model on virtual team effectiveness. It illustrates how emotional intelligence and Big Five personality traits help team members better understand interpersonal relationships and develop constructive virtual teams. The widespread use of virtual team meetings for collaborative work over in-person interaction with diverse personalities creates discord and trust among team members, limiting overall productivity. A quantitative analysis approach is used, with hypotheses tested and (...) a series of multiple linear regression analyses performed on data collected from relevant industries using convenient sampling. The findings show that the Big Five personality affects the virtual team's trust and collaboration parameters. However, the relationship between personality traits and team effectiveness is mediated by emotional intelligence. Also, it is explored that having control over emotional intelligence or developing emotional intelligence would improve team performance while managing and working with a diverse group of people. (shrink)

A new, expanded, and reorganized edition of a collection of texts that present a fuller scope to Guattari's thinking from 1977 to 1985. This new edition of Soft Subversions expands, reorganizes, and develops the original 1996 publication, offering a carefully organized arrangement of essays, interviews, and short texts that present a fuller scope to Guattari's thinking from 1977 to 1985. This period encompasses what Guattari himself called the “Winter Years” of the early 1980s—the ascent of the Right, the spread (...) of environmental catastrophe, the rise of a disillusioned youth with diminished prospects for career and future, and the establishment of a postmodernist ideology that offered solutions toward adaptation rather than change—a period with discernible echoes twenty years later. Following Semiotext's release last season of the new, expanded edition of Chaosophy: Texts and Interviews 1972–1977, this book makes Guattari's central ideas and concepts fully available in the format that had been best suited to Guattari's temperament: the guerrilla-styled intervention of the short essay and interactive dialogue. This edition includes such previously unpublished, substantive texts as “Institutional Intervention” and “About Schools,” along with new translations of “War, Crisis, or Life” and “The Nuclear State,” interviews and essays on a range of topics including adolescence and Italy, dream analysis and schizo-analysis, Marcel Proust and Jimmy Carter, as well as invaluable autobiographical documents such as “I Am an Idea-Thief” and “So What.”. (shrink)

Today, avatars often represent users in digital worlds such as in video games or workplace applications. Avatars embody the user and perform their actions in these artificial environments. As a result, users sometimes develop the feeling that their self merges with their avatar. The user realizes that they are the avatar, but the avatar is also the user—meaning that avatar’s appearance, character, and actions also affect their self. In the present paper, we first introduce the event-coding approach of the self (...) and then argue based on the reviewed literature on human-avatar interaction that a self-controlled avatar can lead to avatar-self merging: the user sets their own goals in the virtual environment, plans and executes the avatar’s actions, and compares the predicted with the actual motion outcomes of the avatar. This makes the user feel body ownership and agency over the avatar’s action. Following the event-coding account, avatar-self merging should not be seen as an all-or-nothing process, but rather as a continuous process to which various factors contribute, including successfully taking the perspective of the avatar. Against this background, we discuss affective, cognitive, and visuo-spatial perspective taking of the avatar. As evidence for avatar-self merging, we present findings showing that when users take the avatar’s perspective, they can show spontaneous behavioral tendencies that run counter to their own. (shrink)

Most philosophers appear to have ignored the distinction between the broad concept of Virtual Machine Functionalism (VMF) described in Sloman&Chrisley (2003) and the better known version of functionalism referred to there as Atomic State Functionalism (ASF), which is often given as an explanation of what Functionalism is, e.g. in Block (1995). -/- One of the main differences is that ASF encourages talk of supervenience of states and properties, whereas VMF requires supervenience of machines that are arbitrarily complex networks of (...) causally interacting (virtual, but real) processes, possibly operating on different time-scales, examples of which include many different procesess usually running concurrently on a modern computer performing various tasks concerned with handling interfaces to physical devices, managing the file system, dealing with security, providing tools, entertainments, and games, and possibly processing research data. Another example of VMF would be the kind of functionalism involved in a large collection of possibly changing socio-economic structures and processes interacting in a complex community, and yet another is illustrated by the kind of virtual machinery involved in the many levels of visual processing of information about spatial structures, processes, and relationships (including percepts of moving shadows, reflections, highlights, optical-flow patterns and changing affordances) as you walk through a crowded car-park on a sunny day: generating a whole zoo of interacting qualia. (Forget solitary red patches, or experiences thereof.) -/- Perhaps VMF should be re-labelled "Virtual MachinERY Functionalism" because the word 'machinery' more readily suggests something complex with interacting parts. VMF is concerned with virtual machines that are made up of interacting concurrently active (but not necessarily synchronised) chunks of virtual machinery which not only interact with one another and with their physical substrates (which may be partly shared, and also frequently modified by garbage collection, metabolism, or whatever) but can also concurrently interact with and refer to various things in the immediate and remote environment (via sensory/motor channels, and possible future technologies also). I.e. virtual machinery can include mechanisms that create and manipulate semantic content, not only syntactic structures or bit patterns as digital virtual machines do. -/- Please note: Click on the title above or the link below to read the paper. I prefer to keep all my papers freely accessible on my web site so that I can correct mistakes and add improvements. -/- http://www.cs.bham.ac.uk/research/projects/cogaff/misc/vm-functionalism.html -/- This is now part of the Meta-Morphogenesis project: http://www.cs.bham.ac.uk/research/projects/cogaff/misc/meta-morphogenesis.html. (shrink)

This new edition of Soft Subversions expands, reorganizes, and develops the original 1996 publication, offering a carefully organized arrangement of essays, interviews, and short texts that present a fuller scope to Guattari's thinking from 1977 to 1985. This period encompasses what Guattari himself called the "Winter Years" of the early 1980s--the ascent of the Right, the spread of environmental catastrophe, the rise of a disillusioned youth with diminished prospects for career and future, and the establishment of a postmodernist ideology (...) that offered solutions toward adaptation rather than change--a period with discernible echoes twenty years later. Following Semiotext's release last season of the new, expanded edition of Chaosophy: Texts and Interviews 1972--1977, this book makes Guattari's central ideas and concepts fully available in the format that had been best suited to Guattari's temperament: the guerrilla-styled intervention of the short essay and interactive dialogue. This edition includes such previously unpublished, substantive texts as "Institutional Intervention" and "About Schools," along with new translations of "War, Crisis, or Life" and "The Nuclear State," interviews and essays on a range of topics including adolescence and Italy, dream analysis and schizo-analysis, Marcel Proust and Jimmy Carter, as well as invaluable autobiographical documents such as "I Am an Idea-Thief" and "So What.". (shrink)

The use of virtual humans holds the potential for interactive, automated interaction in domains such as remote communication, customer service, or public announcements. For signed language users, signing avatars could potentially provide accessible content by sharing information in the signer's preferred or native language. As the development of signing avatars has gained traction in recent years, researchers have come up with many different methods of creating signing avatars. The resulting avatars vary widely in their appearance, the naturalness of (...) their movements, and facial expressions—all of which may potentially impact users' acceptance of the avatars. We designed a study to test the effects of these intrinsic properties of different signing avatars while also examining the extent to which people's own language experiences change their responses to signing avatars. We created video stimuli showing individual signs produced by a live human signer, an avatar made using computer-synthesized animation, and an avatar made using high-fidelity motion capture. We surveyed 191 American Sign Language users, including Deaf, Hard-of-Hearing, and Hearing groups. Participants rated the three signers on multiple dimensions, which were then combined to form ratings of Attitudes, Impressions, Comprehension, and Naturalness. Analyses demonstrated that the Mocap avatar was rated significantly more positively than the CS avatar on all primary variables. Correlations revealed that signers who acquire sign language later in life are more accepting of and likely to have positive impressions of signing avatars. Finally, those who learned ASL earlier were more likely to give lower, more negative ratings to the CS avatar, but we did not see this association for the Mocap avatar or the Human signer. Together, these findings suggest that movement quality and appearance significantly impact users' ratings of signing avatars and show that signed language users with earlier age of ASL acquisition are the most sensitive to movement quality issues seen in computer-generated avatars. We suggest that future efforts to develop signing avatars consider retaining the fluid movement qualities integral to signed languages. (shrink)

The article investigates how the use of extended reality technologies and interactive digital interfaces have affected the design of exhibition spaces. Its main objective is to shed light on how these technologies have influenced the ways in which immersive art installations are conceived and experienced. Particular emphasis is placed on the impact of interactive technologies on how visitors experience exhibition spaces. The article examines an ensemble of immersive art cases, paying special attention to the distinction between immersion and interactivity. Two (...) concepts that are pivotal for understanding the transformations concerning the subjectivity of the exhibition visitor those of the “imagineer” and the “ultra-technologist”, which are analysed in the article. The intention is to render explicit how extended reality technologies have contributed to the design of immersive experiences, significantly influencing the interrelations between the technical, aesthetic and institutional aspects concerning exhibition design and the methods of dissemination of art. (shrink)

Buildings are solid, monolithic, static structures of steel, stone and glass. Buildings are at their most dynamic during the phases of construction and ossify from the point of completion. They occupy a different timescale to the rest of us, unlike the mayfly that enacts its lifespan in the space of a day, or our three score and ten, buildings emerge from a long gestation to face the elements for periods that can span a thousand years. Or they used to - (...) increasingly the contemporary built environment ebbs and flows, generating a dynamically changing landscape as buildings are designed, constructed and demolished in the time it used to take to construct a model. This state of flux is enhanced by the addition of surveillance systems, telematic communication networks and environmental monitoring and control technologies. All these factors provide a new tangible dimensionality to contemporary architecture. Arch-OS is an ‘operating system’ that harnesses these new architectural, technological and social dimensions. Arch-OS, ‘software for buildings’, has been developed to manifest the social, technological and environmental life of a building and provide a living laboratory for cultivating transdisciplinary knowledge. Arch-OS buildings will be permanently in a state of flux. By feeding on the diverse forms of dynamic data that are generated by a building, its environment and its occupants, Arch-OS transforms the architect’s drawings, the brick, steel, glass and fibre-optic infrastructure into a living, breathing environment. Arch- OS provides users of buildings with a spatial and temporal consciousness, essentially re-programming human activity through a heightened social, architectural awareness. Arch-OS combines a rich mix of the physical and virtual into a new dynamic architecture, an ‘intelligent’ entity, that interacts, responds and anticipates: Arch-OS is a nervous system for multidimensional buildings. ‘Soft Buildings’ explores some of the ‘dimensions’ made manifest by Arch-OS. Specifically the generation of new kinds of space, a new kind of model, generated by a soft building. (shrink)

Can trust evolve on the Internet between virtual strangers? Recently, Pettit answered this question in the negative. Focusing on trust in the sense of ‘dynamic, interactive, and trusting’ reliance on other people, he distinguishes between two forms of trust: primary trust rests on the belief that the other is trustworthy, while the more subtle secondary kind of trust is premised on the belief that the other cherishes one’s esteem, and will, therefore, reply to an act of trust in kind (...) (‘trust-responsiveness’). Based on this theory Pettit argues that trust between virtual strangers is impossible: they lack all evidence about one another, which prevents the imputation of trustworthiness and renders the reliance on trust-responsiveness ridiculous. I argue that this argument is flawed, both empirically and theoretically. In several virtual communities amazing acts of trust between pure virtuals have been observed. I propose that these can be explained as follows. On the one hand, social cues, reputation, reliance on third parties, and participation in (quasi-) institutions allow imputing trustworthiness to varying degrees. On the other, precisely trust-responsiveness is also relied upon, as a necessary supplement to primary trust. In virtual markets, esteem as a fair trader is coveted while it contributes to building up one’s reputation. In task groups, a hyperactive style of action may be adopted which amounts to assuming (not: inferring) trust. Trustors expect that their virtual co-workers will reply in kind while such an approach is to be considered the most appropriate in cyberspace. In non-task groups, finally, members often display intimacies while they are confident someone else ‘out there’ will return them. This is facilitated by the one-to-many, asynchronous mode of communication within mailing lists. (shrink)

Movement abnormalities are prevalent across all stages of schizophrenia contributing to poor social functioning and reduced quality of life. To date, treatments are scarce, often involving pharmacological agents, but none have been shown to improve movement abnormalities effectively. Virtual reality (VR) is a tool used to simulate virtual environments where behavioral performance can be quantified safely across different tasks while exerting control over stimulus delivery, feedback and measurement in real time. Sensory information is transmittedviaa head mounted display allowing (...) users to directly interact with virtual objects and bodies using gestures and body movements in the real world to perform different actions, permitting a sense of immersion in the simulated virtual environment. Although, VR has been widely used for successful motor rehabilitation in a variety of different neurological domains, none have been exploited for motor rehabilitation in schizophrenia. The objectives of this article are to review movement abnormalities specific to schizophrenia, and how VR can be utilized to restore and improve motor functioning in patients with schizophrenia. Constructing VR-mediated motor-cognitive interventions that can help in retaining and transferring the learned outcomes to real life are also discussed. (shrink)

A pattern of interaction that arises again and again in programming is a 'handshake', in which two agents exchange data. The exchange is thought of as provision of a service. Each interaction is initiated by a specific agent--the client or Angel--and concluded by the other--the server or Demon. We present a category in which the objects--called interaction structures in the paper--serve as descriptions of services provided across such handshaken interfaces. The morphisms--called (general) simulations--model components that provide one (...) such service, relying on another. The morphisms are relations between the underlying sets of the interaction structures. The proof that a relation is a simulation can serve (in principle) as an executable program, whose specification is that it provides the service described by its domain, given an implementation of the service described by its codomain. This category is then shown to coincide with the subcategory of 'generated' basic topologies in Sambin's terminology, where a basic topology is given by a closure operator whose induced sup-lattice structure need not be distributive; and moreover, this operator is inductively generated from a basic cover relation. This coincidence provides topologists with a natural source of examples for non-distributive formal topology. It raises a number of questions of interest both for formal topology and programming. The extra structure needed to make such a basic topology into a real formal topology is then interpreted in the context of interaction structures. (shrink)