The visual system is a source of sensory information that perceives environmental stimuli and interacts with other sensory systems to generate visual and postural responses to maintain postural stability. Although the three sensory systems; the visual, vestibular, and somatosensory systems work concurrently to maintain postural control, the visual and vestibular system interaction is vital to differentiate self-motion from external motion to maintain postural stability. The visual system influences postural control playing a key role (...) in perceiving information required for this differentiation. The visual system’s main afferent information consists of optic flow and retinal slip that lead to the generation of visual and postural responses. Visual fixations generated by the visual system interact with the afferent information and the vestibular system to maintain visual and postural stability. This review synthesizes the roles of the visual system and their interaction with the vestibular system, to maintain postural stability. (shrink)

Artificial stimulation of the peripheral vestibular system has been shown to improve ownership of body parts in neurological patients, suggesting vestibular contributions to bodily self-consciousness. Here, we investigated whether galvanic vestibular stimulation interferes with the mechanisms underlying ownership, touch, and the localization of one’s own hand in healthy participants by using the “rubber hand illusion” paradigm. Our results show that left anodal GVS increases illusory ownership of the fake hand and illusory location of touch. We propose that (...) these changes are due to vestibular interference with spatial and/or temporal mechanisms of visual-tactile integration leading to an enhancement of visual capture. As only left anodal GVS lead to such changes, and based on neurological data on body part ownership, we suggest that this vestibular interference is mediated by the right temporo-parietal junction and the posterior insula. (shrink)

According to the traditional inferential theory of perception, percepts of object motion or stationarity stem from an evaluation of afferent retinal signals (which encode image motion) with the help of extraretinal signals (which encode eye movements). According to direct perception theory, on the other hand, the percepts derive from retinally conveyed information only. Neither view is compatible with a perceptual phenomenon that occurs during visually induced sensations of ego motion (vection). A modified version of inferential theory yields a model in (...) which the concept of extraretinal signals is replaced by that of reference signals, which do not encode how the eyes move in their orbits but how they move in space. Hence reference signals are produced not only during eye movements but also during ego motion (i.e., in response to vestibular stimulation and to retinal image flow, which may induce vection). The present theory describes the interface between self-motion and object-motion percepts. An experimental paradigm that allows quantitative measurement of the magnitude and gain of reference signals and the size of the just noticeable difference (JND) between retinal and reference signals reveals that the distinction between direct and inferential theories largely depends on: (1) a mistaken belief that perceptual veridicality is evidence that extraretinal information is not involved, and (2) a failure to distinguish between (the perception of) absolute object motion in space and relative motion of objects with respect to each other. The model corrects these errors, and provides a new, unified framework for interpreting many phenomena in the field of motion perception. (shrink)

There is a task-specificity in the visual-tactile interaction for perception: The polymodal posterior parietal cortex is related to the comparison of the shapes coded by different sensory modalities, whereas the lateral occipital complex is the part of the network for multimodal shape identification. These interactions may be mediated by some latent pathways potentiated by sensory deprivation or learning.

This article starts with the environmental changes in human cognition, analyzes the virtual as the main feature of visual perception under digital technology, and explores the transition from passive to active human cognitive activities. With the diversified understanding of visual information, human contradiction of memory also began to become prominent. Aiming at the problem that the existing multimodal TV media recognition methods have low recognition rate of unknown application layer protocols, an adaptive clustering method for identifying unknown application (...) layer protocols is proposed. This method clusters application layer protocols based on similarity of the load characteristics of network stream application layer protocol data. The method divides the similarity calculation in the clustering algorithm to improve the clustering efficiency of the algorithm. Experimental results show that the proposed method can efficiently and accurately recognize unknown visual communication. This article proposes that, in the interactive multimodal visual information transmission, human visual perception experience has changed, the diversity of visual information content expression makes the aesthetic subject more personalized and stylized. (shrink)

In this study, we use a conversation analysis framework to understand the systematic organization of interactions in Periscope live video streams, and its crucial features: the talking heads orientation for the video stream, in common with video-mediated communication; the expectation that the streamer should attend to all messages as much as possible; the ‘loose’ organization of viewers’ responses to streamers’ turn-at-talk, as in multi-party chats. We also identify a distinctive design for streamers’ responses to messages, the ‘read-aloud and respond’ (...) practice. These distinctive features are oriented to the highly asymmetrical communicative affordances of Periscope streams. Without precluding other forms of Periscope-based activities, this systematic organization of talk and messages, coupled with the affordances of the application, favors a basic mode of topic initiation resting on a typical and minimal adjacent pair: viewer’s noticing/streamers’ reading and responding. We argue that the particular salience of this organization of topic initiation may account for the emergence of the dominant kind of use for Periscope streams, that is, the online public exposure of youth to strangers in order to elicit some conversation. (shrink)

Background Despite the bourgeoning of digital tools for bioethics research, education, and engagement, little research has empirically investigated the impact of interactive visualizations as a way to translate ethical frameworks and guidelines. To date, most frameworks take the format of text-only documents that outline and offer ethical guidance on specific contexts. This study’s goal was to determine whether an interactive-visual format supports frameworks in transferring ethical knowledge by improving learning, deliberation, and user experience.Methods An experimental comparative study was conducted (...) with a pre-, mid-, and post-test design using the online survey platform Qualtrics. Participants were university based early-stage health researchers who were randomly assigned to either the control condition (text-only document) or the experimental condition (interactive-visual). The primary outcome variables were learning, (measured using a questionnaire), deliberation (using cases studies) and user experience (measured using the SED/UD Scale). Analysis was conducted using descriptive statistics and mixed-effects linear regression.Results Of the 80 participants, 44 (55%) used the text-only document and 36 (45%) used the interactive-visual. Results of the knowledge-test scores showed a statistically significant difference between participants’ post-test scores, indicating that the interactive-visual format better supported understanding, acquisition, and application of the framework’s knowledge. Findings from the case studies showed both formats supported ethical deliberation. Results further indicated the interactive-visual provided an overall better episodic and remembered user experience compared with the text-only document.Conclusions Our findings show that ethical frameworks formatted with interactive and visual qualities provide a more pleasing user experience and are effective formats for ethics learning and deliberation. These findings have implications for practitioners developing and deploying ethical frameworks and guidelines (e.g., in educational or employee-onboarding settings), in that the knowledge generated can lead to more effective dissemination practices of normative guidelines and health data ethics concepts. (shrink)

Norman's aim to reconcile two longstanding and seemingly opposed philosophies of perception, the constructivist and the ecological, by casting them as approaches to complementary subsystems within the visual brain is laudable. Unfortunately, Norman overreaches in attempting to equate direct perception with dorsal/unconscious visual processing and indirect perception with ventral/conscious visual processing. Even a cursory review suggests that the functional and neural segregation of direct and indirect perception is not as clear as the target article would suggest.

In lectures and writings in the decades following the publication of Studies in Ethnomethodology [1967], Harold Garfinkel, the founder of ethnomethodology, developed what he called a “misreading” of the phenomenological writings of Aron Gurwitsch, Maurice Merleau-Ponty and others. Garfinkel’s “misreading” included a selective and creative treatment of themes that Gurwitsch drew from Gestalt psychology, such as figure-ground, Gestalt contexture, and the phenomenal field. Rather than identifying these themes with visual perception demonstrated with picture-puzzles (for example, of animals hidden in (...) foliage) and line drawings of reversible figures, Garfinkel used them to demonstrate praxeological and interactional phenomena: organizations of embodied activity that constitute fields of collective action. Phenomenal fields, for Garfinkel, are formed through embodied work performed in concert with the actions of others. Although Harvey Sacks, the founder of Conversation Analysis, did not explicitly mention Gurwitsch, phenomenology or Gestalt psychology in his writings and transcribed lectures, some of his writings on the sequential organization of conversation seem informed, if only indirectly through his relationship with Garfinkel, by Gurwitsch’s treatment of visual and auditory phenomena. Both Garfinkel and Sacks devised innovative ways to transpose Gestalt phenomena from perceptual psychology to social formations. (shrink)

A modified visual search task demonstrates that humans are very good at resuming a search after it has been momentarily interrupted. This is shown by exceptionally rapid response time to a display that reappears after a brief interruption, even when an entirely different visual display is seen during the interruption and two different visual searches are performed simultaneously. This rapid resumption depends on the stability of the visual scene and is not due to display or response (...) anticipations. These results are consistent with the existence of an iterative hypothesis-testing mechanism that compares information stored in short-term memory (the perceptual hypothesis) with information about the display (the sensory pattern). In this view, rapid resumption occurs because a hypothesis based on a previous glance of the scene can be tested very rapidly in a subsequent glance, given that the initial hypothesis-generation step has already been performed. (shrink)

Previous research with speech and non-speech stimuli suggested that in audiovisual perception, visual information starting prior to the onset of corresponding sound can provide visual cues, and form a prediction about the upcoming auditory sound. This prediction leads to audiovisual interaction. Auditory and visual perception interact and induce suppression and speeding up of the early auditory event-related potentials such as N1 and P2. To investigate AV interaction, previous research examined N1 and P2 amplitudes and latencies in response (...) to audio only, video only, audiovisual, and control stimuli, and compared AV with auditory perception based on four AV interaction models. The current study addresses how different models of AV interaction express N1 and P2 suppression in music perception. Furthermore, the current study took one step further and examined whether previous musical experience, which can potentially lead to higher N1 and P2 amplitudes in auditory perception, influenced AV interaction in different models. Musicians and non-musicians were presented the recordings of a keyboard /C4/ key being played, as well as CO stimuli. Results showed that AV interaction models differ in their expression of N1 and P2 amplitude and latency suppression. The calculation of model and has consequences for the resulting N1 and P2 difference waves. Furthermore, while musicians, compared to non-musicians, showed higher N1 amplitude in auditory perception, suppression of amplitudes and latencies for N1 and P2 was similar for the two groups across the AV models. Collectively, these results suggest that when visual cues from finger and hand movements predict the upcoming sound in AV music perception, suppression of early ERPs is similar for musicians and non-musicians. Notably, the calculation differences across models do not lead to the same pattern of results for N1 and P2, demonstrating that the four models are not interchangeable and are not directly comparable. (shrink)

Three experiments examined the effects of interactive visualizations and spatial abilities on a task requiring participants to infer and draw cross sections of a three‐dimensional (3D) object. The experiments manipulated whether participants could interactively control a virtual 3D visualization of the object while performing the task, and compared participants who were allowed interactive control of the visualization to those who were not allowed control. In Experiment 1, interactivity produced better performance than passive viewing, but the advantage of interactivity disappeared in (...) Experiment 2 when visual input for the two conditions in a yoked design was equalized. In Experiments 2 and 3, differences in how interactive participants manipulated the visualization were large and related to performance. In Experiment 3, non‐interactive participants who watched optimal movements of the display performed as well as interactive participants who manipulated the visualization effectively and better than interactive participants who manipulated the visualization ineffectively. Spatial ability made an independent contribution to performance on the spatial reasoning task, but did not predict patterns of interactive behavior. These experiments indicate that providing participants with active control of a computer visualization does not necessarily enhance task performance, whereas seeing the most task‐relevant information does, and this is true regardless of whether the task‐relevant information is obtained actively or passively. (shrink)