This sweeping introduction to the science of virtual environment technology masterfully integrates research and practical applications culled from a range of disciplines, including psychology, engineering, and computer science.

The growing critical and economic success of Virtual Reality technologies is generating renewed scholarly interest in virtual environments. One of the most long-lasting and influential perspectives on the topic has been labelled «virtual realism» (Heim [1998]), and it has passed throughout the entire history of virtual environments studies up to recent days (Chalmers [2022]). Virtual Realism frames virtual environments in terms of realism, and precisely of perceptive soundness and isomorphism between physical (...) environments and virtual ones, producing a convincing illusion of being physically present in the digital space. This article develops a critical counter-argument to this account. By employing James J. Gibson’s ecology of perception and Deleuze’s and Lévy’s philosophy of the virtual, the article aims at demonstrating that the ontology of virtual environments is rooted in a domain of predetermined possibilities, and that the resulting aesthetics can not be fully immersive. Instead, the latter should embrace the «emersive» and anti-realistic qualities of the medium as an expressive device. (shrink)

Virtual environments engage millions of people and billions of dollars each year. What is the ontological status of the virtual objects that populate those environments? An adequate answer to that question requires a developed semantics for virtual environments. The truth-conditions must be identified for “tree”-sentences when uttered by speakers immersed in a virtual environment (VE). It will be argued that statements about virtual objects have truth-conditions roughly comparable to the verificationist conditions popular (...) amongst some contemporary antirealists. This does not mean that the virtual objects lack ontological standing. There is an important sense in which virtual objects are no less real for being mind-dependent. (shrink)

People with neurodevelopmental disorders are often considered unsuitable or incapable of working in open employment. When employment is available, tasks are often limited, and opportunities for career development are restricted. Policy and funding constraints leave people with disabilities without an opportunity to develop skills due to the additional time and costs for employers. To overcome these barriers, virtual environments have been proposed as a safe and reliable solution for training. An important prerequisite for a wider uptake of training (...) in virtual environments are demonstrations that the training leads to improved performance in the real world. This is particularly true for people with neurodevelopmental disorders, as transferring learnings from one context to another can be challenging. A systematic review was conducted to assess whether training in virtual environments can be used to improve real-world vocational skills in people with neurodevelopmental disorders. After a systematic search in six databases, eight out of the initially identified 1,806 articles met the inclusion criteria. The findings from these eight studies demonstrate that people with neurodevelopmental disorders can transfer vocational skills from virtual environments to real-world settings. With substantial technological improvements, a surge in accessibility, and improved affordability, there is a need to build upon the promising results identified in this review. (shrink)

Los estudios de ciencia, tecnología y sociedad revelan las interrelaciones entre la ciencia y la tecnología como procesos sociales. Este artículo persigue como objetivo: valorar la significación social de un entorno virtual en la enseñanza aprendizaje de la Estadística descriptiva en la carrera de Medicina. El diagnóstico preliminar mediante de la observación, la encuesta y el análisis documental, mostró que existen insuficiencias en el uso de las tecnologías de la información y las comunicaciones en el proceso de enseñanza aprendizaje (...) de la Estadística. Se diseñó un entorno virtual constituido por cinco módulos que incluyen contenidos de Estadística descriptiva, ejercicios, bibliografía y ayuda. Con la validación a partir del criterio de especialistas y la sistematización con la introducción en la práctica, se evaluó el mismo como muy adecuado, fue considerado útil, necesario y aplicable al contexto objeto de estudio, lo que contribuye a la formación científica de los estudiantes desde una posición materialista. Science, technology and society studies reveal the interrelations between science and technology as social processes. This article pursues the following objectives: to assess the social significance of a virtual environment in the teaching and learning of descriptive Statistics in Medicine degree course. The preliminary diagnosis through the observation, opinion poll and documentary analysis, showed that there are insufficiencies in the use of Information and Communication technologies in teaching and learning Statistics. It was designed a virtual environment with five modules that include contents of descriptive Statistics, exercises, bibliography and help. With the validation of specialists and the systematization after putting it in practice, the virtual environment was assessed as adequate, useful, necessary and applicable to the context being studied, which contributes to the scientific training of students from a materialistic position. (shrink)

In this paper I explored three well-known cases that seem to cast doubt on the notion that a speaker is always at the place of the utterance when the utterance occurs. I gave a few examples produced in Second Life environment, which cannot be handled correctly by evaluating the expression at issue with respect to the traditional view, i.e., the kaplanian framework—where the agent and the utterer will always be identical, and the referent of “I” will always be the utterer. (...) The same happens to “here” and “now”; in each case the character of the indexical is a function from a contextual parameter to the referent of the expression. An example of logical truth peculiar to indexicals is the sentence “I am here now”, since, according to that view, no utterance can take place in a context whose agent is not in its location in its time. Finally I concluded by claiming that particular kinds of utterances produced in virtual environments (VE) break with the logical truth status of “I am here now”. (shrink)

What is encoded in working memory may be a content-addressable pointer, but a critical portion of the information that is addressed includes the motor information to achieve deictic reference in the environment. Additionally, the same strategy that is used to access environment information just in time for its use may also be used to access long-term memory via the pre-frontal cortex.

This article explores whether and under which circumstances it is ethically viable to include artificial beings worthy of moral consideration in virtual environments. In particular, the article focuses on virtual environments such as those in digital games and training simulations – interactive and persistent digital artifacts designed to fulfill specific purposes, such as entertainment, education, training, or persuasion. The article introduces the criteria for moral consideration that serve as a framework for this analysis. Adopting this framework, (...) the article tackles the question of whether including artificial intelligences that are entitled to moral consideration in virtual environments constitutes an immoral action on the part of human creators. To address this problem, the article draws on three conceptual lenses from the philosophical branch of ethics: the problem of parenthood and procreation, the question concerning the moral status of animals, and the classical problem of evil. Using a thought experiment, the concluding section proposes a contractualist answer to the question posed in this article. The same section also emphasizes the potential need to reframe our understanding of the design of virtual environments and their future stakeholders. (shrink)

Beyond the observation that both speakers and listeners rapidly inspect the visual targets of referring expressions, it has been argued that such gaze may constitute part of the communicative signal. In this study, we investigate whether a speaker may, in principle, exploit listener gaze to improve communicative success. In the context of a virtual environment where listeners follow computer-generated instructions, we provide two kinds of support for this claim. First, we show that listener gaze provides a reliable real-time index (...) of understanding even in dynamic and complex environments, and on a per-utterance basis. Second, we show that a language generation system that uses listener gaze to provide rapid feedback improves overall task performance in comparison with two systems that do not use gaze. Aside from demonstrating the utility of listener gaze in situated communication, our findings open the door to new methods for developing and evaluating multi-modal models of situated interaction. (shrink)

In this paper, I deal with a striking phenomenon that often occurs when we explore the virtual environment of, for example, a video game. Suppose a friend sees me playing a video game and asks ‘Where are you?’ There are two possible answers to this question. I can either refer to my actual location (‘I am in my room’), but I can also refer to my location in the virtual world (‘I am in a space-ship’). Although my friend (...) is probably after this second reply, the first one is not false. At first sight, this gives rise to a tension. On the one hand both claims – ‘I am in my room’ and ‘I am in a space-ship’ – seem true. But on the other hand they also seem mutually exclusive as bilocation, i.e. being in two places at the same time, is impossible. I am either in London or in Paris, in the bathroom or in the kitchen, in a space-ship or in my room. How can I claim to be in two places at once? In the following, I discuss two ways to dissolve this tension:. (shrink)

As part of the Dutch national science program “Professional Games for Professional Skills” we developed a stress-exposure biofeedback training in virtual reality for the Dutch police. We aim to reduce the acute negative impact of stress on performance, as well as long-term consequences for mental health by facilitating physiological stress regulation during a demanding decision task. Conventional biofeedback applications mainly train physiological regulation at rest. This might limit the transfer of the regulation skills to stressful situations. In contrast, we (...) provide the user with the opportunity to practice breathing regulation while they carry out a complex task in VR. This setting poses challenges from a technical – as well as from a user-experience perspective. We illustrate how we approach these challenges in our training and hope to contribute a useful reference for researchers and developers in academia or industry who are interested in using biosignals to control elements in a dynamic virtual environment. (shrink)

Virtual environment landmarks are essential in wayfinding: they anchor routes through a region and provide memorable destinations to return to later. Current virtual environment browsers provide user interface menus that characterize available travel destinations via landmark textual descriptions or thumbnail images. Such characterizations lack the depth cues and context needed to reliably recognize 3D landmarks. This paper introduces a new user interface affordance that captures a 3D representation of a virtual environment landmark into a 3D thumbnail, called (...) a worldlet. Each worldlet is a miniature virtual world fragment that may be interactively viewed in 3D, enabling a traveler to gain first-person experience with a travel destination. In a pilot student conducted to compare textual, image, and worldlet landmark representations within a wayfinding task, worldlet use significantly reduced the overall travel time and distance traversed, virtually eliminating unnecessary backtracking. (shrink)

Atypical sensorimotor developmental trajectories greatly contribute to the profound heterogeneity that characterizes Autism Spectrum Disorders. Individuals with ASD manifest deviations in sensorimotor processing with early markers in the use of sensory information coming from both the external world and the body, as well as motor difficulties. The cascading effect of these impairments on the later development of higher-order abilities underlines the need for interventions that focus on the remediation of sensorimotor integration skills. One of the promising technologies for such stimulation (...) is Immersive Virtual Reality. In particular, head-mounted displays have unique features that fully immerse the user in virtual realities which disintegrate and otherwise manipulate multimodal information. The contribution of each individual sensory input and of multisensory integration to perception and motion can be evaluated and addressed according to a user’s clinical needs. HMDs can therefore be used to create virtual environments aimed at improving people’s sensorimotor functioning, with strong potential for individualization for users. Here we provide a narrative review of the sensorimotor atypicalities evidenced by children and adults with ASD, alongside some specific relevant features of IVR technology. We discuss how individuals with ASD may interact differently with IVR versus real environments on the basis of their specific atypical sensorimotor profiles and describe the unique potential of HMD-delivered immersive virtual environments to this end. (shrink)

Many of the psychological studies carried out within virtual environments are motivated by the idea that virtual research findings are generalizable to the non-virtual world. This idea is vulnerable to the paradox of fiction, which questions whether it is possible to express genuine emotion toward a character (or event) known to be fictitious. As many of these virtual studies are designed to elicit, broadly speaking, emotional responses through interactions with fictional characters (avatars) or objects/places, the (...) issue raised by the paradox seems particularly apt. This paper assesses the extent to which the paradox of fiction constitutes a legitimate challenge to psychological research within virtual environments, and argues that any alleged conflict is in fact a product of an overly simplistic view of emotions which a more complete understanding resolves. Moreover, through a more detailed analysis of why the paradox cannot be sustained, one finds justification for the claim that emotions elicited through interactions with virtual (fictitious) objects/events are valid. However, their generalizability to the non-virtual world must still be treated with caution. (shrink)

This study explored the effect of kinesthetic motor imagery training on reaching-to-grasp movement supplemented by a virtual environment in a patient with congenital bilateral transverse upper-limb deficiency. Based on a theoretical assumption, it is possible to conduct such training in this patient. The aim of this study was to evaluate whether cortical activity related to motor imagery of reaching and motor imagery of grasping of the right upper limb was changed by computer-aided imagery training in a patient who was (...) born without upper limbs compared to a healthy control subject, as characterized by multi-channel electroencephalography signals recorded before and 4, 8, and 12 weeks after CAIT. The main task during CAIT was to kinesthetically imagine the execution of reaching-to-grasp movements without any muscle activation, supplemented by computer visualization of movements provided by a special headset. Our experiment showed that CAIT can be conducted in the patient with higher vividness of imagery for reaching than grasping tasks. Our results confirm that CAIT can change brain activation patterns in areas related to motor planning and the execution of reaching and grasping movements, and that the effect was more pronounced in the patient than in the healthy control subject. The results show that CAIT has a different effect on the cortical activity related to the motor imagery of a reaching task than on the cortical activity related to the motor imagery of a grasping task. The change observed in the activation patterns could indicate CAIT-induced neuroplasticity, which could potentially be useful in rehabilitation or brain-computer interface purposes for such patients, especially before and after transplantation. This study was part of a registered experiment. (shrink)

The efficient coding hypothesis posits that sensory systems are tuned to the regularities of their natural input. The statistics of natural image databases have been the topic of many studies, which have revealed biases in the distribution of orientations that are related to neural representations as well as behavior in psychophysical tasks. However, commonly used natural image databases contain images taken with a camera with a planar image sensor and limited field of view. Thus, these images do not incorporate the (...) physical properties of the visual system and its active use reflecting body and eye movements. Here, we investigate quantitatively, whether the active use of the visual system influences image statistics across the visual field by simulating visual behaviors in an avatar in a naturalistic virtual environment. Images with a field of view of 120° were generated during exploration of a virtual forest environment both for a human and cat avatar. The physical properties of the visual system were taken into account by projecting the images onto idealized retinas according to models of the eyes' geometrical optics. Crucially, different active gaze behaviors were simulated to obtain image ensembles that allow investigating the consequences of active visual behaviors on the statistics of the input to the visual system. In the central visual field, the statistics of the virtual images matched photographic images regarding their power spectra and a bias in edge orientations toward cardinal directions. At larger eccentricities, the cardinal bias was superimposed with a gradually increasing radial bias. The strength of this effect depends on the active visual behavior and the physical properties of the eye. There were also significant differences between the upper and lower visual field, which became stronger depending on how the environment was actively sampled. Taken together, the results show that quantitatively relating natural image statistics to neural representations and psychophysical behavior requires not only to take the structure of the environment into account, but also the physical properties of the visual system, and its active use in behavior. (shrink)

Women are still underrepresented in engineering courses although some German universities offer separate women’s engineering courses which include virtual STEM learning environments. To outline information about fundamental aspects relevant for virtual STEM learning, one has to reveal which similarities both genders in virtual learning show. Moreover, the question arises as to whether there are in fact differences in the virtual science learning of female and male learners. Working with virtual STEM learning environments requires (...) strategic and arithmetic-operative competences. Even if we assume that female and male learners have similar competences levels, their correlational pattern of competences, motivational variables, and invested effort during virtual STEM learning might differ. If such gender differences in the correlations between cognitive and motivational variables and learning behavior were revealed, it would be possible to finetune study conditions for female students in a separate engineering course and shape virtual STEM learning in a more gender-appropriate manner. That might support an increase in the number of women in engineering courses. To reveal the differences and similarities between female and male learners, a field study was conducted with 56 students (female = 27, male = 29) as part of the Open MINT Labs project (the German term for Open STEM Labs, OML). The participants had to complete a virtual STEM learning environment during their regular scie... (shrink)

Higher education in the 21st century faces the challenge of changing the way in which knowledge is conveyed and how teachers and students interact in the teaching-learning process. The current pandemic caused by SARS-CoV-2 has hastened the need to face up to this challenge and has furthered the need to approach the issue from the perspective of digitalisation. To achieve this, it is necessary to design training programmes geared towards teaching staff and which address both the use of technology and (...) instructional design aimed at promoting the development of self-regulated learning and automatic feedback systems. In this study, work was carried out with 23 teachers in a training programme conducted through Moodle. The aims were: to test whether there were any significant differences between the behaviour patterns of new teachers compared to experienced teachers, to determine whether clusters of behaviour patterns corresponded to the type of teacher and to ascertain whether the level of teacher satisfaction with the training activity in digital teaching will depend on the type of teacher. A quantitative as well as a qualitative design was applied. Differences were found in the behaviour patterns in the training activities for the development of rubrics and use of learning analytics systems in virtual learning environments. It was also found that the type of teacher did not correspond exactly to the behaviour cluster in the learning platform. In addition, no significant differences were found in the level of satisfaction between the two kinds of teacher. The main contribution this study makes is to provide a detailed description of the training stage as well as the materials required for its repetition. Further analytical studies are required on teacher perception of training programmes in digital teaching in order to provide personalised training proposals that lead to an effective use of teaching in digital environments. (shrink)

Salient landmarks enhance route learning. We hypothesised that semantically salient nostalgic landmarks would improve route learning compared to non-nostalgic landmarks. In two experiments, participants learned a route through a computer-generated maze using directional arrows and wall-mounted pictures. On the test trial, the arrows were removed, and participants completed the maze using only the pictures. In the nostalgia condition, pictures were of popular music artists and TV characters from 5 to 10 years ago. In the control condition, they were recent pictures (...) of these same artists and characters. In Experiment 1, in the test trial, participants in the nostalgia condition completed the maze faster than controls. Experiment 2 conceptually replicated these findings and extended them by exploring boundary conditions. Participants had to learn two mazes sequentially. In Maze 1, we placed nostalgic/control landmarks only at non-decision points (whereas we placed them at decision points in Experiment 1). In Maze 2, we placed nostalgic/control landmarks at decision points during acquisition but removed them in the test trial (whereas they were present in the test trial in Experiment 1). In both mazes, participants in the nostalgia (compared to control) condition completed the test trial faster. (shrink)

ABSTRACTThis study aimed to investigate the emotional impact of sarcasm. Previous research in this area has mainly required participants to answer questions based on written materials, and results have been mixed. With the aim of instead examining the emotional impact of sarcasm when used in a more conversational setting, the current study utilized animated video clips as stimuli. In each clip, one individual answered general knowledge questions while the other provided feedback that could be delivered either literally or sarcastically, and (...) either complimented or criticized the question answerer’s performance. Participants rated the feedback based on the anticipated emotional impact on the recipient, how the speaker intended the recipient to feel, and whether the speaker intended to be humorous. Results overall supported the Tinge Hypothesis, showing that sarcastic criticism was rated as less negative than literal criticism, and sarcastic compliments were rated as... (shrink)

Immersive virtual environments can produce a state of behaviour referred to as ‘presence’, during which the individual responds to the virtual environment as if it were real. Presence can be arranged to scientifically evaluate and affect our consciousness within a controlled virtual environment. This phenomenon makes the use of virtual environments amenable to existing and in-development forms of therapy for various conditions. Delirium in the intensive care unit (ICU) is one such condition for which (...) virtual reality (VR) technology has not been evaluated to date. We are currently assessing the feasibility and utility of a delirium prevention and treatment system, which implements VR to improve quality of sleep, reduce pain, lower usage of sedatives, and stimulate cognition. The proposed system will consist of 3-axis wearable accelerometers, 6-DOF position trackers, a VR system and apps designed to promote sleep quality and mindfulness. Our a priori hypothesis is that our VR therapy system would lower the occurrence of delirium in patients admitted to ICUs. (shrink)

Virtual reality constitutes an alternative, effective, and increasingly utilized treatment option for people suffering from psychiatric and neurological illnesses. However, the currently available VR simulations provide a predetermined simulative framework that does not take into account the unique personality traits of each individual; this could result in inaccurate, extreme, or unpredictable responses driven by patients who may be overly exposed and in an abrupt manner to the predetermined stimuli, or result in indifferent, almost non-existing, reactions when the stimuli do (...) not affect the patients adequately and thus stronger stimuli are recommended. In this study, we present a VR system that can recognize the individual differences and readjust the VR scenarios during the simulation according to the treatment aims. To investigate and present this dynamically adaptive VR system we employ an Anxiety Disorder condition as a case study, namely arachnophobia. This system consists of distinct anxiety states, aiming to dynamically modify the VR environment in such a way that it can keep the individual within a controlled, and appropriate for the therapy needs, anxiety state, which will be called “desired states” for the study. This happens by adjusting the VR stimulus, in real-time, according to the electrophysiological responses of each individual. These electrophysiological responses are collected by an external electrodermal activity biosensor that serves as a tracker of physiological changes. Thirty-six diagnosed arachnophobic individuals participated in a one-session trial. Participants were divided into two groups, the Experimental Group which was exposed to the proposed real-time adaptive virtual simulation, and the Control Group which was exposed to a pre-recorded static virtual simulation as proposed in the literature. These results demonstrate the proposed system’s ability to continuously construct an updated and adapted virtual environment that keeps the users within the appropriately chosen state for approximately twice the time compared to the pre-recorded static virtual simulation. Thus, such a system can increase the efficiency of VR stimulations for the treatment of central nervous system dysfunctions, as it provides numerically more controlled sessions without unexpected variations. (shrink)

A common understanding of the role of a game developer includes establishing (or at least partially establishing) what is interactively and perceptually available in (video)game environments: what elements and behaviors those worlds include and allow, and what is – instead – left out of their ‘possibility horizon’. The term ‘possibility horizon’ references the Ancient Greek origin of the term ‘horizon’, ὄρος (oros), which denotes a frontier – a spatial limit. On this etymological foundation, ‘horizon’ is used here to indicate (...) the spatial and operational boundaries that a (video)game environment affords its players. This book chapter discusses a particular feeling that emerge in relation to playful encounters with the ‘possibility horizons’ of videogames. I am referring here to the realization, as a player, that a game environment can be experientially exhausted and is, as such, ultimately banal. In other words, I will examine how our deliberate engagement with the interactive environments of digital games can trigger sensations that are analogous to what Romantic authors referred to as Weltschmerz (‘world-weariness’). (shrink)