Advances in artificial intelligence and computer graphics digital technologies have contributed to a relative increase in realism in virtual characters. Preserving virtual characters’ communicative realism, in particular, joined the ranks of the improvements in natural language technology, and animation algorithms. This paper focuses on culturally relevant paralinguistic cues in nonverbal communication. We model the effects of an English-speaking digital character with different accents on human interactants (i.e., users). Our cultural influence model proposes that paralinguistic realism, in the form of accented (...) speech, is effective in promoting culturally congruent cognition only when it is self-relevant to users. For example, a Chinese or Middle Eastern English accent may be perceived as foreign to individuals who do not share the same ethnic cultural background with members of those cultures. However, for individuals who are familiar and affiliate with those cultures (i.e., in-group members who are bicultural), accent not only serves as a motif of shared social identity, it also primes them to adopt culturally appropriate interpretive frames that influence their decision making. (shrink)

Three experiments examined the effects of interactive visualizations and spatial abilities on a task requiring participants to infer and draw cross sections of a three‐dimensional (3D) object. The experiments manipulated whether participants could interactively control a virtual 3D visualization of the object while performing the task, and compared participants who were allowed interactive control of the visualization to those who were not allowed control. In Experiment 1, interactivity produced better performance than passive viewing, but the advantage of interactivity disappeared in (...) Experiment 2 when visual input for the two conditions in a yoked design was equalized. In Experiments 2 and 3, differences in how interactive participants manipulated the visualization were large and related to performance. In Experiment 3, non‐interactive participants who watched optimal movements of the display performed as well as interactive participants who manipulated the visualization effectively and better than interactive participants who manipulated the visualization ineffectively. Spatial ability made an independent contribution to performance on the spatial reasoning task, but did not predict patterns of interactive behavior. These experiments indicate that providing participants with active control of a computer visualization does not necessarily enhance task performance, whereas seeing the most task‐relevant information does, and this is true regardless of whether the task‐relevant information is obtained actively or passively. (shrink)

Adaptive training adjusts a training task with the goal of improving learning outcomes. Adaptive training has been shown to improve human performance in attention, working memory capacity, and motor control tasks. Additionally, correlations have been observed between neural EEG spectral features and the performance of some cognitive tasks. This relationship suggests some EEG features may be useful in adaptive training regimens. Here, we anticipated that adding a neural measure into a behavioral-based adaptive training system would improve human performance on a (...) subsequent transfer task. We designed, developed, and conducted a between-subjects study of 44 participants comparing three training regimens: Single Item Fixed Difficulty, Behaviorally Adaptive Training, and Combined Adaptive Training using both behavioral and EEG measures. Results showed a statistically significant transfer task performance advantage of the CAT-based system relative to SIFD and BAT systems of 6 and 9 percentage points, respectively. Our research shows a promising pathway for designing closed-loop BCI systems based on both users' behavioral performance and neural signals for augmenting human performance. (shrink)