Human interaction has two principle functions: building and maintaining relationships with others and exchanging information. The function of building and maintaining relationships with others relates to interpersonal coordination; this behavior pattern is expected to predict the outcome of social relationships, such as between therapists and patients. It is unclear, however, whether the exchange of information is associated with interpersonal coordination. In the present study, we tested a hypothesis of whether body movement synchrony occurs in a natural conversation and whether this (...) synchrony has a positive correlation with the degree of information exchange. Fifty participants were engaged in a conversation task; each had different roles in the conversation. We measured their body movements during this conversation using an optical motion capture system. Similar to methods that can be found in previous research, we calculated body movements and quantified their synchrony applying the methods previously reported that automatically quantified their body movements. Moreover, we determined the participants’ degree of information exchange concerning the conversation using a questionnaire. We observed that the body movement synchrony of pairs who talked with each other was significantly higher than that of pairs who did not talk with each other, and that this synchrony was positively associated with the degree of information exchange. These results suggest that body movement synchrony predicted information exchange. (shrink)

Virtuosity in music performance is often associated with fast, precise, and efficient sound-producing movements. The generation of such highly skilled movements involves complex joint and muscle control by the central nervous system, and depends on the ability to anticipate, segment, and coarticulate motor elements, all within the biomechanical constraints of the human body. When successful, such motor skill should lead to what we characterize as fluency in musical performance. Detecting typical features of fluency could be very useful for technology-enhanced (...) learning systems, assisting and supporting students during their individual practice sessions by giving feedback and helping them to adopt sustainable movement patterns. In this study, we propose to assess fluency in musical performance as the ability to smoothly and efficiently coordinate while accurately performing slow, transitionary, and rapid movements. To this end, the movements of three cello players and three drummers at different levels of skill were recorded with an optical motion capture system, while a wireless electromyogrphy (EMG) system recorded the corresponding muscle activity from relevant landmarks. We analyze the kinematic and coarticulation characteristics of these recordings separately and then propose a combined model of fluency in musical performance predicting music sophistication. Results suggest movements from expert performers' are characterized by consistently smooth strokes and scaling of muscle phasic coactivation. The explored model of fluency as function of movement smoothness and coarticulation patterns was shown to be limited by the sample size but serves as a proof of concept. Results from this study show the potential of a technology-enhanced objective measure of fluency in musical performance, which could lead to improved practices for aspiring musicians, instructors, and researchers. (shrink)

Motion pose capture technology can effectively solve the problem of difficulty in defining character motion in the process of 3D animation production and greatly reduce the workload of character motion control, thereby improving the efficiency of animation development and the fidelity of character motion. Motion gesture capture technology is widely used in virtual reality systems, virtual training grounds, and real-time tracking of the motion trajectories of general objects. This paper proposes an attitude (...) estimation algorithm adapted to be embedded. The previous centralized Kalman filter is divided into two-step Kalman filtering. According to the different characteristics of the sensors, they are processed separately to isolate the cross-influence between sensors. An adaptive adjustment method based on fuzzy logic is proposed. The acceleration, angular velocity, and geomagnetic field strength of the environment are used as the input of fuzzy logic to judge the motion state of the carrier and then adjust the covariance matrix of the filter. The adaptive adjustment of the sensor is converted to the recognition of the motion state. For the study of human motion posture capture, this paper designs a verification experiment based on the existing robotic arm in the laboratory. The experiment shows that the studied motion posture capture method has better performance. The human body motion gesture is designed for capturing experiments, and the capture results show that the obtained pose angle information can better restore the human body motion. A visual model of human motion posture capture was established, and after comparing and analyzing with the real situation, it was found that the simulation approach reproduced the motion process of human motion well. For the research of human motion recognition, this paper designs a two-classification model and human daily behaviors for experiments. Experiments show that the accuracy of the two-category human motion gesture capture and recognition has achieved good results. The experimental effect of SVC on the recognition of two classifications is excellent. In the case of using all optimization algorithms, the accuracy rate is higher than 90%, and the final recognition accuracy rate is also higher than 90%. In terms of recognition time, the time required for human motion gesture capture and recognition is less than 2 s. (shrink)

• In this paper we combine motion captured data with linguistic notions in a game-like intelligent tutoring system, in order to help elementary school students to better differentiate literal from metaphorical uses of motion verbs, based on embodied information. In addition to the thematic goal, we intend to improve young students’ attention and spatiotemporal memory, by presenting sensorimotor data experimentally collected from thirty two participants in our motion capturing labs. Furthermore, we examine the accomplishment of game’s (...) goals and compare them to curriculum’s approach. Sixty nine elementary school students were randomly divided in two experimental groups (game and traditional) and one control group, which did not undergo any intervention. All groups were tested in pre and posttests. Even though the diagnostic pretests present a uniform picture, two way analysis of variance suggests that the experimental groups showed progress in posttests and, more specifically, game group remarkably progressed in the verbs/actions presented during the intervention. Furthermore, in the game condition the participants needed gradually shorter period of time to identify the avatar’s actions. This finding was considered as a first indication of attentional and spatiotemporal memory’s improvement, while the game’s assistance features cultivated students’ metacognitive perception. (shrink)

We consider the motion of small bodies in general relativity. The key result captures a sense in which such bodies follow timelike geodesics. This result clarifies the relationship between approaches that model such bodies as distributions supported on a curve, and those that employ smooth fields supported in small neighborhoods of a curve. This result also applies to "bodies" constructed from wave packets of Maxwell or Klein-Gordon fields. There follows a simple and precise formulation of the optical limit (...) for Maxwell fields. (shrink)

Optic neuropathies are conditions that cause disease to the optic nerve, and can result in loss of visual acuity and/or visual field defects. An improved understanding of how these conditions affect the entire visual system is warranted, to better predict and/or restore the visual loss. In this article, we review visually-driven functional magnetic resonance imaging (fMRI) studies of optic neuropathies, including glaucoma and optic neuritis (ON); we also discuss traumatic optic neuropathy (TON). Optic neuropathy-related vision loss results in fMRI (...) deficit within the visual cortex, and is often strongly correlated with clinical severity measures. Using predominantly flickering checkerboard stimuli, glaucoma studies indicated retinotopic-specific cortical alteration with more prominent deficits in advanced than in early glaucoma. Some glaucoma studies indicate a reorganized visual cortex. ON studies have indicated that the impacted cortical areas are briefly hyperactive. For ON, brain deficits are greater in the acute stages of the disease, followed by (near) normalization of responses of the LGN, visual cortex, and the dorsal visual stream, but not the ventral extrastriate cortex. Visually-driven fMRI is sensitive, at least in ON, in discriminating patients from controls, as well as the affected eye from the fellow eye within patients. The use of a greater variety of stimuli beyond checkerboards (e.g., visual motion and object recognition) in recent ON studies is encouraging, and needs to continue to disentangle the results in terms of change over time. Finally, visually-driven fMRI has not yet been applied in TON, although preliminary efforts suggest it may be feasible. Future fMRI studies of optic neuropathies should consider using more complex visual stimuli, and inter-regional analysis methods including functional connectivity. We suggest that a more systematic longitudinal comparison of optic neuropathies with advanced fMRI would provide improved diagnostic and prognostic information. (shrink)

In Marx’s analysis of capitalism, time and motion are central to the dynamics of the system. In the twenty-first century, capital deployed new forms of technology and logistical planning to increase profits and reduce the circulation phase of the turnover time of capital. The introduction of fibre optic cable, data centres, the transformation of the warehouse into a site of movement, the rise of third-party logistics (3PL) firms, and improvements in infrastructure all promoted ‘the annihilation of space by (...) time’ in the effort to increase profitability. As increased velocity of value became central to capital, the system in turn became more vulnerable to disruption by labour. (shrink)

This richly detailed biography captures both the personal life and the scientific career of Isaac Newton, presenting a fully rounded picture of Newton the man, the scientist, the philosopher, the theologian, and the public figure. Professor Westall treats all aspects of Newton's career, but his account centers on a full description of Newton's achievements in science. Thus the core of the work describes the development of the calculus, the experimentation that altered the direction of the science of optics, and especially (...) the investigations in celestial dynamics that led to the law of universal gravitation. (shrink)

The visual system is a source of sensory information that perceives environmental stimuli and interacts with other sensory systems to generate visual and postural responses to maintain postural stability. Although the three sensory systems; the visual, vestibular, and somatosensory systems work concurrently to maintain postural control, the visual and vestibular system interaction is vital to differentiate self-motion from external motion to maintain postural stability. The visual system influences postural control playing a key role in perceiving (...) information required for this differentiation. The visual system’s main afferent information consists of optic flow and retinal slip that lead to the generation of visual and postural responses. Visual fixations generated by the visual system interact with the afferent information and the vestibular system to maintain visual and postural stability. This review synthesizes the roles of the visual system and their interaction with the vestibular system, to maintain postural stability. (shrink)

One of the chief concerns of the young Descartes was with what he, and others, termed “physico-mathematics”. This signalled a questioning of the Scholastic Aristotelian view of the mixed mathematical sciences as subordinate to natural philosophy, non explanatory, and merely instrumental. Somehow, the mixed mathematical disciplines were now to become intimately related to natural philosophical issues of matter and cause. That is, they were to become more ’physicalised’, more closely intertwined with natural philosophising, regardless of which species of natural philosophy (...) one advocated. A curious, short-lived yet portentous epistemological conceit lay at the core of Descartes’ physico-mathematics—the belief that solid geometrical results in the mixed mathematical sciences literally offered windows into the realm of natural philosophical causation—that in such cases one could literally “see the causes”. Optics took pride of place within Descartes’ physico-mathematics project, because he believed it offered unique possibilities for the successful vision of causes. This paper traces Descartes’ early physico-mathematical program in optics, its origins, pitfalls and its successes, which were crucial in providing Descartes resources for his later work in systematic natural philosophy. It explores how Descartes exploited his discovery of the law of refraction of light—an achievement well within the bounds of traditional mixed mathematical optics—in order to derive—in the manner of physico-mathematics—causal knowledge about light, and indeed insight about the principles of a “dynamics” that would provide the laws of corpuscular motion and tendency to motion in his natural philosophical system. (shrink)

Motion-sound synesthesia is characterized by illusory auditory sensations linked to the pattern and rhythms of motion of visually experienced but soundless object, like an optical flow array, a ball bouncing or a horse galloping. In an MRI study with a group of three synesthetes and a group of eighteen control participants, we found structural changes in the brains of synesthetes in the subcortical multisensory areas of the superior and inferior colliculi. In addition, functional magnetic resonance imaging data (...) showed activity in motion-sensitive regions, as well as temporal and occipital areas, and the cerebellum. However, the synesthetes had a higher activation within the left and right cuneus, with stronger activations when viewing optical flow stimuli. There was also a general difference in connectivity of the colliculi with the above mentioned regions between the two groups. These findings implicate low-level mechanisms within the human neuroaxis as a substrate for local connectivity and cross activity between perceptual processes that are “distant” in terms of cortical topography. The present findings underline the importance of considering the role of subcortical systems and their connectivity to multimodal regions of the cortex and they strengthen a parsimonious account of synesthesia, at the least of the visual-auditory type. (shrink)

Body movement is a primary nonverbal communication channel in humans. Coordinated social behaviors, such as dancing together, encourage multifarious rhythmic and interpersonally coupled movements from which observers can extract socially and contextually relevant information. The investigation of relations between visual social perception and kinematic motor coupling is important for social cognition. Perceived coupling of dyads spontaneously dancing to pop music has been shown to be highly driven by the degree of frontal orientation between dancers. The perceptual salience of other aspects, (...) including postural congruence, movement frequencies, time‐delayed relations, and horizontal mirroring remains, however, uncertain. In a motion capture study, 90 participant dyads moved freely to 16 musical excerpts from eight musical genres, while their movements were recorded using optical motion capture. A total from 128 recordings from 8 dyads maximally facing each other were selected to generate silent 8‐s animations. Three kinematic features describing simultaneous and sequential full body coupling were extracted from the dyads. In an online experiment, the animations were presented to 432 observers, who were asked to rate perceived similarity and interaction between dancers. We found dyadic kinematic coupling estimates to be higher than those obtained from surrogate estimates, providing evidence for a social dimension of entrainment in dance. Further, we observed links between perceived similarity and coupling of both slower simultaneous horizontal gestures and posture bounding volumes. Perceived interaction, on the other hand, was more related to coupling of faster simultaneous gestures and to sequential coupling. Also, dyads who were perceived as more coupled tended to mirror their pair's movements. (shrink)

Principles of Laser Spectroscopy and Quantum Optics is an essential textbook for graduate students studying the interaction of optical fields with atoms. It also serves as an ideal reference text for researchers working in the fields of laser spectroscopy and quantum optics. The book provides a rigorous introduction to the prototypical problems of radiation fields interacting with two- and three-level atomic systems. It examines the interaction of radiation with both atomic vapors and condensed matter systems, the density matrix and (...) the Bloch vector, and applications involving linear absorption and saturation spectroscopy. Other topics include hole burning, dark states, slow light, and coherent transient spectroscopy, as well as atom optics and atom interferometry. In the second half of the text, the authors consider applications in which the radiation field is quantized. Topics include spontaneous decay, optical pumping, sub-Doppler laser cooling, the Heisenberg equations of motion for atomic and field operators, and light scattering by atoms in both weak and strong external fields. The concluding chapter offers methods for creating entangled and spin-squeezed states of matter. Instructors can create a one-semester course based on this book by combining the introductory chapters with a selection of the more advanced material. A solutions manual is available to teachers. Rigorous introduction to the interaction of optical fields with atoms Applications include linear and nonlinear spectroscopy, dark states, and slow light Extensive chapter on atom optics and atom interferometry Conclusion explores entangled and spin-squeezed states of matter Solutions manual. (shrink)

Although we frequently acquire knowledge and skills through social interactions, the focus of most research on learning is on individual learning. Here we characterize Interaction Based Learning, which represents the acquisition of knowledge or skill through social interactions, and compare it to Observational Learning —learning by observation. To that end, we designed a movement synchronization paradigm whereby participants learned Tai-Chi inspired movement sequences from trained teachers in two separated sessions. We used a motion capture system to track (...) the movement of 40 dyads comprised of a teacher and learner, who were randomly divided into OL or IBL groups, and calculated time-varying synchrony of three-dimensional movement velocity. While in the IBL group both the learner and the teacher could see each other through a transparent glass, in the OL group dyads interacted through a one-way mirror, such that the learners observed the teacher, but the teacher could not see the learners. Results show that although the number of movements recalled was not different between groups, we found improved movement smoothness in the IBL compared to the OL group, indicating movement acquisition was better in the IBL group. In addition, we found that motor synchronization levels in dyads improved over time, indicating that movement synchronization can be learned and retained. In the first session, the IBL group, but not the OL group, showed a significant improvement in synchronization. This suggests that dyadic interaction is important for learning movement sequences, and that bidirectional communication of signals and mutual feedback are essential for the consolidation of motor learning. (shrink)

The processes underlying motor decision-making have recently caught considerable amount of scientific attention, focusing on the integration of empirical evidence from sensorimotor control research with psychological theories and computational models on decision-making. Empirical studies on motor decision-making suggest that the kinematics of goal-directed reaching movements are sensitive to the level of target uncertainty during movement planning. However, the source of uncertainty as a relevant factor influencing the process of motor decision-making has not been sufficiently considered, yet. In this study, we (...) test the assumption that the source of target uncertainty has an effect on motor decision-making, which can be proven by analyzing movement variability during the time course of movement execution. Ten healthy young adults performed three blocks with 66 trials of goal-directed reaching movements in each block, across which the source and level of reach target uncertainty at movement onset were manipulated (“no uncertainty”, “extrinsic uncertainty”, “intrinsic uncertainty”). Fingertip position of the right index finger was recorded using an optical motion tracking system. Standard kinematic measures (i.e. path length and movement duration) as well as variability of fingertip position across the time course of movement execution and at movement end were analyzed. In line with previous studies, we found that a high level of extrinsic target uncertainty leads to increased overall movement duration, which could be attributed to increased path length in this condition, as compared to intrinsic and no target uncertainty (all p <.001). Movement duration and path length did not show any differences between the latter two conditions. However, the time course analysis of movement variability revealed significant differences between these two conditions, with increased variability of fingertip position in the presence of intrinsic target uncertainty (Condition × Sampling point: p =.01), though considerably less than under high extrinsic target uncertainty (p ≤.001). These findings suggest that both the level and source of uncertainty have a significant effect on the processing of potential action plans during motor decision-making, which can be revealed through the analysis of the time course of movement variability at the end-effector level. (shrink)

During the Nineties, the diffusion of information and communication technologies allowed a dramatic transformation in art practices. Radically new aesthetic experiences, such as tele-presence, immersivity, responsivity, hyper-mediacy and multimediality, emerge in the framework of the digital arts and call into question not only the traditional status of the work of art but also the fundamental relation with the beholder. The aim of this paper is to define a conceptual framework for the ontology of digital arts by identifying some ontological features (...) that are distinctive to digital idioms. Such an analysis tries to outline how aesthetic and technical innovations affect our cognitive and sensorial relationship with technological artifacts. In the first part, the relation between technogenesis and ontology, as well as the key topics of the ontology of digital arts are discussed. The second part deals with the notion of presence. Despite traditional understandings of digital arts, mainly focused on immateriality, simulation and mediation, my analysis demonstrate how the notion of presence can provide an original perspective in order to understand the ontological status of the mediatized artistic practices. In the last three decades the generalisation of information and telecommunication technologies has played a major role in the transformation of the arts, opening the field to important experiments in the domain of computer graphics, digital audio, robotics and motion capture systems… (Dixon 2007). Peculiar forms of aesthetic experience such as tele-presence, immersivity, responsivity, hyper-mediation and multimediality, progressively arise from digital arts and question not only the status of artwork but also, more generally, the foundational relationship between this latter and the recipient. (shrink)

In the performing arts, such as music and dance performances, people actively interact with each other and show their exciting performances. Some studies have proposed that this interaction is a social origin of the performing arts. Some have further investigated this phenomenon based on the synchronization and coordination theory. Though the majority of these studies have focused on the collaborative context, several genres of the performing arts, such as jazz sessions and breakdance battles, have a competitive context. Several studies have (...) suggested that, in this competitive context, performers actively interact with each other and construct some correspondence. Moreover, a few recent studies focusing on competitive conversations, such as debates, have shown that, compared to people's interactions in collaborative conversations, people in competitive contexts frequently coordinate their behaviors in complicated ways. However, the interaction and coordination among performers in these competitive contexts have not been sufficiently investigated. Therefore, we investigated the coordination of expert breakdancers in battle scenes and measured their rhythmic movements using a motion capture system. We calculated the relative phase of the rhythmic movements between two dancers to investigate their coordination. The results showed that the dancers' rhythmic movements tended to synchronize in an anti-phase fashion, which means that there were similarities as well as differences between the two dancers' rhythmic movements. Furthermore, this pattern of coordination changed dynamically as time elapsed, from an in-phase synchronization or leader-follower relationships to an anti-phase synchronization and then leader-follower relationships. (shrink)

Theories of embodied cognition hypothesize interdependencies between psychological well-being and physical posture. The purpose of this study was to assess the feasibility of objectively measuring posture, and to explore the relationship between posture and affect and other patient centered outcomes in breast cancer survivors with persistent postsurgical pain over a 12-week course of therapeutic Qigong mind-body training. Twenty-one BCS with PPSP attended group Qigong training. Clinical outcomes were pain, fatigue, self-esteem, anxiety, depression, stress and exercise self-efficacy. Posture outcomes were vertical (...) spine and vertical head angles in the sagittal plane, measured with a 3D motion capture system in three conditions: eyes open, eyes open relaxed and eyes closed. Assessments were made before and after the Qigong training. The association between categorical variables was measured by Cramer’s V. In the EO condition, most participants who improved in fatigue and anxiety scales also had better vertical head values. For the EOR condition, a moderate correlation was observed between changes in vertical head angle and changes in fatigue scale. In the EC condition, most of the participants who improved in measures of fatigue also improved vertical head angle. Additionally, pain severity decreased while vertical spine angle improved. These preliminary findings support that emotion and other patient centered outcomes should be considered within an embodied framework, and that Qigong may be a promising intervention for addressing biopsychosocially complex interventions such as PPSP in BCSs. (shrink)

The vestibulo-ocular reflex plays an important role in controlling the gaze at a visual target. Although patients with vestibular hypofunction aim to improve their VOR function, some retain dysfunction for a long time. Previous studies have explored the effects of direct current stimulation on vestibular function; however, the effects of random noise stimulation on eye–head coordination have not previously been tested. Therefore, we aimed to clarify the effects of high frequency noisy vestibular stimulation on eye–head coordination related to VOR function. (...) Thirteen healthy young adult participants with no serious disease took part in our study. The current amplitude and density used were 0.4 mA and 0.2 mA/cm2, respectively, with a random noise frequency of 100–640 Hz. The electrodes were located on both mastoid processes. The stimulus duration and fade in/out duration were 600 and 10 s, respectively. Subjects oscillated their head horizontally, gazing at the fixation point, at 1 Hz for 30 repetitions. The coordination of eye–head movements was measured by eye-tracking and a motion capture system. Peak-to-peak angles for eye and head movement and deviation of the visual line from the fixation target revealed no significant differences between HF-nVS and sham. The lag time between the eye and head movement with HF-nVS post-stimulation was significantly shorter than that of the sham. We found that HF-nVS can reduce the lag time between eye and head movement and improve coordination, contributing to a clear retinal image. This technique could be applied as a form of VOR training for patients with vestibular hypofunction. (shrink)

The Gait Deviation Index is a multivariate measure of overall gait pathology based on 15 gait features derived from three-dimensional kinematic data. GDI aims at providing a comprehensive, easy to interpret, and clinically meaningful metric of overall gait function. It has been used as an outcome measure to study gait in several conditions: cerebral palsy, post-stroke hemiparetic gait, Duchenne muscular dystrophy, and Parkinson’s disease, among others. Nevertheless, its use in population with Spinal Cord Injury has not been studied yet. The (...) aim of the present study was to investigate the applicability of the GDI to SCI through the assessment of the relationship of the GDI with the Walking Index for Spinal Cord Injury II. 3D gait kinematics of 34 patients with incomplete SCI was obtained. Besides, 3D gait kinematics of a sample of 50 healthy volunteers was also gathered with Codamotion motion capture system. A total of 302 and 446 strides were collected. GDI was calculated for each stride and grouped for each WISCI II level. HV data were analyzed as an additional set. Normal distribution for each group was assessed with Kolmogorov-Smirnov tests. Afterward, ANOVA tests were performed between each pair of WISCI II levels to identify differences among groups. The results showed that the GDI was normally distributed across all WISCI II levels in both iSCI and HV groups. Furthermore, our results showed an increasing relationship between the GDI values and WISCI II levels in subjects with iSCI, but only discriminative in WISCI II levels 13, 19, and 20. The index successfully distinguished HV group from all the individuals with iSCI. Findings of this study indicated that the GDI is not an appropriate multivariate walking metric to represent the deviation of gait pattern in adult population with iSCI from a normal gait profile when it is compared with the levels of walking impairment described by the WISCI II. Future work should aim at defining and validating an overall gait index derived from 3D kinematic gait variables appropriate for SCI, additionally taking into account other walking ability outcome measures. (shrink)

The vestibular system is critical for human locomotion. Any deteriorated vestibular system leads to gait instability. In the past decades, these alternations in gait patterns have been majorly measured by the spatial-temporal gait parameters and respective variabilities. However, measuring gait characteristics cannot capture the full aspect of motor controls. Thus, to further understand the effects of deteriorated vestibular system on gait performance, additional measurement needs to be taken into consideration. This study proposed using the margin of (...) stability to identify the patterns of dynamic control under different types of mastoid vibrations in walking. This study hypothesized that using the MOS method could facilitate the understanding of another aspect of motor control induced by different types of mastoid vibrations, and applying the mastoid vibrations could induce the asymmetric MOS. Twenty healthy young adults were recruited. Two electromechanical vibrotactile transducers were placed on the bilateral mastoid process to apply different types of vestibular vibrations. A motion capture system with eight cameras was used to measure the MOSap, MOSml, and respective variabilities. The results were in line with the hypotheses that both bilateral and unilateral mastoid vibrations significantly increased MOSap, MOSml, and respective variabilities p = 0.001, p < 0.001; p = 0.001, p < 0.01 when compared to the no vibration condition. Also, significantly larger MOSml, MOSml variability, MOSap, and MOSap variability were observed under the unilateral vibration condition than that observed under the bilateral vibration condition. The above-mentioned result found that different types of mastoid vibrations affected the MOS differently, suggesting different patterns of control mechanisms under different sensory-conflicted situations. Besides, a significant difference between the dominant and non-dominant legs was observed in MOSml. Moreover, applying the unilateral mastoid vibrations induced a greater symmetric index of MOSml, suggesting that more active control in balance was needed in the medial-lateral than in the anterior-posterior direction. (shrink)

Multiple sensory signals from visual, somatosensory and vestibular systems are used for human postural control. To maintain postural stability, the central nervous system keeps the center of mass (CoM) within the base of support. The influence of the stomatognathic motor system on postural control has been established under static conditions, but it has not yet been investigated during dynamic steady-state balance. The purpose of the study was to investigate the effects of controlled stomatognathic motor activity on the control (...) and stability of the CoM during dynamic steady-state balance. A total of 48 physically active and healthy adults were assigned to three groups with different stomatognathic motor conditions: jaw clenching, tongue pressing and habitual stomatognathic behavior. Dynamic steady-state balance was assessed using an oscillating platform and the kinematic data were collected with a 3D motion capturing system. The path length (PL) of the 3D CoM trajectory was used for quantifying CoM sway. Temporal dynamics of the CoM movement was assessed with a detrended fluctuation analysis (DFA). An uncontrolled manifold (UCM) analysis was applied to assess the stability and control of the CoM with a subject-specific anthropometric 3D model. The statistical analysis revealed that the groups did not differ significantly in PL, DFA scaling exponents or UCM parameters. The results indicated that deliberate jaw clenching or tongue pressing did not seem to affect the sway, control or stability of the CoM on an oscillating platform significantly. Because of the task-specificity of balance, further research investigating the effects of stomatognathic motor activities on dynamic steady-state balance with different movement tasks are needed. Additionally, further analysis by use of muscle synergies or co-contractions may reveal effects on the level of muscles, which were not visible on the level of kinematics. This study can contribute to the understanding of postural control mechanisms, particularly in relation to stomatognathic motor activities and under dynamic conditions. (shrink)

Systems with human-centered artificial intelligence are always as good as their ability to consider their users’ context when making decisions. Research on identifying people’s everyday activities has evolved rapidly, but little attention has been paid to recognizing both the activities themselves and the motions they make during those tasks. Automated monitoring, human-to-computer interaction, and sports analysis all benefit from Web 4.0. Every sport has gotten its move, and every move is not known to everyone. In ice hockey, every move cannot (...) be monitored by the referee. Here, Convolution Neural Network-based Real-Time Image Processing Framework (CNN-RTIPF) is introduced to classify every move in Ice Hockey. CNN-RTIPF can reduce the challenges in monitoring the player’s move individually. The image of every move is captured and compared with the trained data in CNN. These real-time captured images are processed using a human-centered artificial intelligence system. They compared images predicted by probability calculation of the trained set of images for effective classification. Simulation analysis shows that the proposed CNN-RTIPF can classify real-time images with improved classification ratio, sensitivity, and error rate. The proposed CNN-RTIPF has been validated based on the optimization parameter for reliability. To improve the algorithm for movement identification and train the system for many other everyday activities, human-centered artificial intelligence-based Web 4.0 will continue to develop. (shrink)

We present a novel, sophisticated intention‐based control system for a mobile robot built from an extremely inexpensive webcam and radio‐controlled toy vehicle. The system visually observes humans participating in various playground games and infers their goals and intentions through analyzing their spatiotemporal activity in relation to itself and each other, and then builds a coherent narrative out of the succession of these intentional states. Starting from zero information about the room, the rules of the games, or even which (...) vehicle it controls, it learns rich relationships between players, their goals and intentions, probing uncertain situations with its own behavior. The robot is able to watch people playing various playground games, learn the roles and rules that apply to specific games, and participate in the play. The narratives it constructs capture essential information about the observed social roles and types of activity. After watching play for a short while, the system is able to participate appropriately in the games. We demonstrate how the system acts appropriately in scenarios such as chasing, follow‐the‐leader, and variants of tag. (shrink)

Spatial region concepts such as “front,” “back,” “left,” and “right” reflect our typical interaction with space, and the corresponding surrounding regions have different statuses in memory. We examined the representation of spatial directions in the auditory space, specifically in how far natural response actions, such as orientation movements toward a sound source, would affect the categorization of egocentric auditory space. While standing in the middle of a circle with 16 loudspeakers, participants were presented acoustic stimuli coming from the loudspeakers in (...) randomized order, and verbally described their directions by using the concept labels “front,” “back,” “left,” “right,” “front-right,” “front-left,” “back-right,” and “back-left.” Response actions varied in three blocked conditions: (1) facing front, (2) turning the head and upper body to face the stimulus, and (3) turning the head and upper body plus pointing with the hand and outstretched arm toward the stimulus. In addition to a protocol of the verbal utterances, motion capture and video recording generated a detailed corpus for subsequent analysis of the participants’ behavior. Chi-square tests revealed an effect of response condition for directions within the left and right sides. We conclude that movement-based response actions influence the representation of auditory space, especially within the sides’ regions. Moreover, the representation of auditory space favors the front and the back regions in terms of resolution, which is possibly related to the physiological characteristics of the human auditory system, as well as to the ecological requirements of action control in the different regions. (shrink)

Broken Theory is a jettisoned collection of fragmentary writing, collected and collaged by new media artist, writer, musician, and theorist Alan Sondheim. Folding theoretical musings, text experiments, and personal confessions into a single textual flow, it examines the somatic foundations of philosophical theory and theorizing, discussing their relationships to the writer and body, and to the phenomenology of failure and fragility of philosophy's production. Writing remains writing, undercuts and corrects itself, is always superseded, always produced within an untoward and bespoke (...) silo - not as an inconceivable last word, but instead a broken contribution to philosophical thinking. The book is based on fragmentation and collapse, displacing annihilation and wandering towards a form of "roiling" within which the text teeters on the verge of disintegration. In other words, the writing develops momentary scaffoldings - writing shored up by the very mechanisms that threaten its disappearance. Broken Theory is prefaced by a text from Maria Damon and followed by an extensive interview with art historian Ryan Whyte. Alan Sondheim is a new media artist, theorist, and writer concerned with the phenomenology of the virtual. He has collaborated with motion capture and virtual environment labs. His work is concerned with the inhabitation of the body in the virtual; with the textuality of the body; with the problematic of mixed reality and codework. His writing is known for its "somatic grit" and skeletal codes that partially appear within and determine the surface. This style embeds interferences among syntax, semantics, and formal systems. The textual body, body of text and writer, are deeply entangled. His current work is based on the psychogeography of real and virtual worlds and their modeling. Most recently he has focused on "semantic ghosting" - the body behind the virtual/symbolic body - and modes of viral dispersion in a series of videos and texts. Sondheim was born in Wilkes-Barre, Pennsylvania, attended Brown University, and has exhibited, taught, and lectured at a number of venues in the United States and abroad. (shrink)

This article examines the relationship between technology and aesthetics in contemporary Hollywood, using experiments with frame rates and shutter speeds to show how deep, systemic changes in cinematic technologies can alter our relation to the image’s referential functions. For eighty years, cinema’s registration of movement relied upon a standardized frame rate and shutter speed, meaning that cinema’s sense of motion was constant. With the proliferation of ever more powerful digital capture systems, however, these formerly inflexible options are made (...) variable and put into question. By changing the registration of movement, the high frame rate experiments in The Hobbit and the open-shutter cinematography of Miami Vice offer an estranged relation to cinema’s presentation of worldly motion. I argue here that this altered sense of the image’s referentiality is well suited to depictions of our contemporary reality, which, being profoundly bound up in digital technologies, seems similarly disorienting, estranging, and aesthetic. In the first section of the article, I trace out the origins of this style of movement in the logics of the corporate tech industry, which rolls out continual upgrades in audio-visual technologies in order to justify new product lines. According to industry rhetoric, these upgrades ostensibly lead to a heightened sense of realism, but viewer response has been torn over whether this new sense of motion is realistic or unrealistic. In the second section, I closely analyze The Hobbit and the recent work of Michael Mann to show how established film form shifts in relation to this problem in digital cinema’s representation of worldly movement. In The Hobbit’s case, film form is altered in order to assimilate the HFR’s unfamiliar sense of motion, but the cinematography in Miami Vice embraces a productive aesthetic estrangement which is both realistic and hyperaestheticized, leaving the divide between immanent experience and technologized disorientation an open question. (shrink)

Optical distortions as a visual disturbance are inherent in many optical devices such as spectacles or virtual reality headsets. In such devices, distortions vary spatially across the visual field. In progressive addition lenses, for example, the left and right regions of the lens skew the peripheral parts of the wearers visual field in opposing directions. The human visual system adapts to homogeneous distortions and the respective aftereffects are transferred to non-retinotopic locations. This study investigates simultaneous adaptation to (...) two opposing distortions at different retinotopic locations. Two oppositely skewed natural image sequences were presented to 10 subjects as adaptation stimuli at two distinct locations in the visual field. To do so, subjects were instructed to keep fixation on a target. Eye tracking was used for gaze control. Change of perceived motion direction was measured in a direction identification task. The point of subjective equality, that is, the angle at which a group of coherently moving dots was perceived as moving horizontal, was determined for both retinal locations. The shift of perceived motion direction was evaluated by comparing PSE before and after adaptation. A significant shift at both retinal locations in the direction of the skew distortion of the corresponding adaptation stimulus is demonstrated. Consequently, parallel adaptation to two opposing distortions in a retinotopic reference frame was confirmed by this study. (shrink)

Analogue Gravity Phenomenology is a collection of contributions that cover a vast range of areas in physics, ranging from surface wave propagation in fluids to nonlinear optics. The underlying common aspect of all these topics, and hence the main focus and perspective from which they are explained here, is the attempt to develop analogue models for gravitational systems. The original and main motivation of the field is the verification and study of Hawking radiation from a horizon: the enabling feature is (...) the possibility to generate horizons in the laboratory with a wide range of physical systems that involve a flow of one kind or another. The years around 2010 and onwards witnessed a sudden surge of experimental activity in this expanding field of research. However, building an expertise in analogue gravity requires the researcher to be equipped with a rather broad range of knowledge and interests. The aim of this book is to bring the reader up to date with the latest developments and provide the basic background required in order to appreciate the goals, difficulties and success stories in the field of analogue gravity. Each chapter of the book treats a different topic explained in detail by the major experts for each specific discipline. The first chapters give an overview of black hole spacetimes and Hawking radiation before moving on to describe the large variety of analogue spacetimes that have been proposed and are currently under investigation. This introductory part is then followed by an in-depth description of what are currently the three most promising analogue spacetime settings, namely surface waves in flowing fluids, acoustic oscillations in Bose-Einstein condensates and electromagnetic waves in nonlinear optics. Both theory and experimental endeavours are explained in detail. The final chapters refer to other aspects of analogue gravity beyond the study of Hawking radiation, such as Lorentz invariance violations and Brownian motion in curved spacetimes, before concluding with a return to the origins of the field and a description of the available observational evidence for horizons in astrophysical black holes. (shrink)

The ability to quickly and accurately recognise emotional states is adaptive for numerous social functions. Although body movements are a potentially crucial cue for inferring emotions, few studies have studied the perception of body movements made in naturalistic emotional states. The current research focuses on the use of body movement information in the perception of fear expressed by targets in a virtual heights paradigm. Across three studies, participants made judgments about the emotional states of others based on motion-capture (...) body movement recordings of those individuals actively engaged in walking a virtual plank at ground-level or 80 stories above a city street. Results indicated that participants were reliably able to differentiate between height and non-height conditions (Studies 1 & 2), were more likely to spontaneously describe target behaviour in the height condition as fearful (Study 2) and their fear estimates were highly calibrated with the fear ratings from the targets (Studies 1-3). Findings show that VR height scenarios can induce fearful behaviour and that people can perceive fear in minimal representations of body movement. (shrink)

In this target article we question the assumption that perception is divided into separate domains of vision, hearing, touch, taste, and smell. We review implications of this assumption for theories of perception and for our understanding of ambient energy arrays (e.g., the optic and acoustic arrays) that are available to perceptual systems. We analyze three hypotheses about relations between ambient arrays and physical reality: (1) that there is an ambiguous relation between ambient energy arrays and physical reality, (2) that there (...) is a unique relation between individual energy arrays and physical reality, and (3) that there is a redundant but unambiguous relation, within or across arrays, between energy arrays and physical reality. This is followed by a review of the physics of motion, focusing on the existence and status of referents for physical motion. Our review indicates that it is not possible, in principle, for there to be a unique relation between physical motion and the structure of individual energy arrays. We argue that physical motion relative to different referents is specified only in the global array, which consists of higher-order relations across different forms of energy. The existence of specificity in the global array is consistent with the idea of direct perception, and so poses a challenge to traditional, inference-based theories of perception and cognition. However, it also presents a challenge to much of the ecological approach to perception and action, which has accepted the assumption of separate senses. (shrink)

Experiential and behavioural aspects of emotions can be measured readily but developing a contactless measure of emotions’ physiological aspects has been a major challenge. We hypothesised that different emotion-evoking films can produce distinctive facial blood flow patterns that can serve as physiological signatures of discrete emotions. To test this hypothesis, we created a new Transdermal Optical Imaging system that uses a conventional video camera to capture facial blood flows in a contactless manner. Using this and deep machine (...) learning, we analysed videos of the faces of people as they viewed film clips that elicited joy, sadness, disgust, fear or a neutral state. We found that each of these elicited a distinct blood flow pattern in the facial epidermis, and that Transdermal Optical Imaging is an effective contactless and inexpensive tool to the reveal physiological correlates of discrete emotions. (shrink)

A unique guide to creative shutter speed techniques, illustrated with striking full-color examples Along with available light and aperture, shutter speed is one of the variables that determine exposure–the amount of light that reaches the camera's sensor. Set on automatic modes, cameras typically attempt to reduce or eliminate blur in a picture. But by manipulating shutter speed creatively, photographers can achieve a range of striking motion blur or stop-action effects. Using an array of inspiring photographs depicting people, wildlife, and (...) landscapes, Creative Power of Shutter Speed explains how to "read" the light and movement in a potential photograph and identify the best shutter speed for the desired effect. (shrink)

Autism has been defined as a disorder of social cognition, interaction and communication where ritualistic, repetitive behaviors are commonly observed. But how should we understand the behavioral and cognitive differences that have been the main focus of so much autism research? Can high-level cognitive processes and behaviors be identified as the core issues people with autism face, or do these characteristics perhaps often rather reflect individual attempts to cope with underlying physiological issues? Much research presented in this volume will point (...) to the latter possibility, i.e. that people on the autism spectrum cope with issues at much lower physiological levels pertaining not only to Central Nervous Systems (CNS) function, but also to peripheral and autonomic systems (PNS, ANS) (Torres, Brincker, et al. 2013). The question that we pursue in this chapter is what might be fruitful ways of gaining objective measures of the large-scale systemic and heterogeneous effects of early atypical neurodevelopment; how to track their evolution over time and how to identify critical changes along the continuum of human development and aging. We suggest that the study of movement variability—very broadly conceived as including all minute fluctuations in bodily rhythms and their rates of change over time (coined micro-movements (Figure 1A-B) (Torres, Brincker, et al. 2013))—offers a uniquely valuable and entirely objectively quantifiable lens to better assess, understand and track not only autism but cognitive development and degeneration in general. This chapter presents the rationale firstly behind this focus on micro-movements and secondly behind the choice of specific kinds of data collection and statistical metrics as tools of analysis (Figure 1C). In brief the proposal is that the micro-movements (defined in Part I – Chapter 1), obtained using various time scales applied to different physiological data-types (Figure 1), contain information about layered influences and temporal adaptations, transformations and integrations across anatomically semi-independent subsystems that crosstalk and interact. Further, the notion of sensorimotor re-afference is used to highlight the fact that these layered micro-motions are sensed and that this sensory feedback plays a crucial role in the generation and control of movements in the first place. In other words, the measurements of various motoric and rhythmic variations provide an access point not only to the “motor systems”, but also access to much broader central and peripheral sensorimotor and regulatory systems. Lastly, we posit that this new lens can also be used to capture influences from systems of multiple entry points or collaborative control and regulation, such as those that emerge during dyadic social interactions. (shrink)

The main objective of this work was to produce a scientifically reasonable definition of God. The rationale was to generate a definition for filling a small part of the spiritual vacuum of the 21st century and thus initiate a new understanding of the Intelligence that permeates the cosmos with mystery, love, order, direction and morals. This resulted in the following definition: “God may be a-humanly incomprehensible-eternal cosmic existence, intimately related to the endlessness of space, to the nature of the deepest (...) common substance of matter and energy, to this common substance’s unceasing motion responsible for time, and to the basic laws of their allness, letting love transform this allness to an ordered Multiverse with a Soul: the—scientifically approachable—Soul of Multiverse inspired to guard these laws and equip their order with direction and morals while imbuing the cosmos with the potential of lives evolving, at the right spatial and temporal distances, to embrace the sense of the divine, thus justifying the existence of God.” The likely neural circuitry for sensing God in the human brain was identified as a network for spiritual data flow across the conscious and subconscious layers of the association cortical cognitive system exchanging data with the prefrontal cortical Self-Ken and modulated by inputs from the emotional and motivational systems of the brain. To study this mental process, the design of a God-Experience Monitor was also developed: a comfortably wearable combination of EEG and audiovisual-recorders tailored to at least partially capture the individual experiences of God anytime and at the very “genius loci” of such experiences. (shrink)

The law-governed world-picture -- A remarkable idea about the way the universe is cosmos and compulsion -- The laws as the cosmic order : the best-system approach -- The three ways : no-laws, non-governing-laws, governing-laws -- Work that laws do in science -- An important difference between the laws of nature and the cosmic order -- The picture in four theses -- The strategy of this book -- The meta-theoretic conception of laws -- The measurability approach to laws -- (...) What comes where -- In defense of some received views -- Some assumptions that will be in play -- The laws are propositions -- The laws are true -- The logically contingent consequences of the laws are laws themselves -- At least some laws are metaphysically contingent -- The meta-theoretic conception of laws -- Laws of nature, laws of science, laws of theories -- The first-order conception versus the meta-theoretic conception -- What is a law of nature? -- Some examples of meta-theoretic accounts -- The virtues of the meta-theoretic conception -- Weighing the virtues and shortcomings of the meta-theoretic conception -- An epistemological argument for the meta-theoretic conception of laws -- The discoverability thesis, the governing thesis, and the first-order conception -- The main argument -- The objection from bad company -- The objection from inference to the best explanation -- The objection from bayesianism -- The objection from contextualist epistemology -- The objection from the threat of inductive skepticism -- Laws, governing, and counterfactuals -- Where we are now -- What would things have to be like in order for the laws of nature to govern the universe? -- Lawhood, inevitability, counterfactuals -- What is it for a proposition to be inevitably true? -- What is it for a whole class of propositions to be inevitably true? -- What is it for lawhood to confer inevitability? -- NP and supporting counterfactuals -- The worry about context-variability -- A solution and a look ahead -- When would the laws have been different? -- Where we are now -- The God cases -- Other counterexamples to NP -- A moral-theoretic counterexample to NP -- Scientific contexts and non-scientific contexts -- Scientific God cases? -- Lewisian non-backtracking counterexamples -- Where things stand now -- How could science show that the laws govern? -- Why the law-governed world-picture must include the science-says-so thesis -- What is extra-scientific? -- How can the science-says-so thesis be true? -- NP as a consequence of the presuppositions in any scientific context -- Np as true in all possible scientific contexts -- But how could it be so? -- Attack of the actual-factualists -- Measurement and counterfactuals -- Where we are now -- Measurements, reliability, counterfactuals -- A general principle that captures the relation between measurement and counterfactuals -- What we can learn about lawhood from what we have learned about the counterfactual commitments of science -- A first-order account of laws or a meta-theoretic account of laws? -- What methods are presupposed to be legitimate measurement procedures? -- Why we must adopt a meta-theoretic account of laws -- What lawhood is -- Where we are now -- The measurability account of laws -- Brief review of the case for the mal -- A note about hedged laws -- How plausible is the mal? -- What if we don't care about the law-governed world-picture? -- Newton's God and Laplace's demon -- Beyond humean and non-humean -- Two views of laws -- Humean supervenience and the meta-theoretic conception -- Alleged counterexamples to humean supervenience -- Governing and non-trivial necessity -- How the mal lets us have it all -- Humeanism? non-humeanism? -- What is the significance of the idea of the law-governed universe? -- Where in the world are the laws of nature? -- Appendix: The mal in action : a few examples -- Of scientific theories and their laws -- Newton's theory as a paradigm example -- Classical special-force laws -- Geometrical optics and one of its laws -- Local deterministic field theories. (shrink)

In the research of motion video, the existing target detection methods are susceptible to changes in the motion video scene and cannot accurately detect the motion state of the target. Moving target detection technology is an important branch of computer vision technology. Its function is to implement real-time monitoring, real-time video capture, and detection of objects in the target area and store information that users are interested in as an important basis for exercise. This article focuses (...) on how to efficiently perform motion detection on real-time video. By introducing the mathematical model of image processing, the traditional motion detection algorithm is improved and the improved motion detection algorithm is implemented in the system. This article combines the advantages of the widely used frame difference method, target detection algorithm, and background difference method and introduces the moving object detection method combining these two algorithms. When using Gaussian mixture model for modeling, improve the parts with differences, and keep the unmatched Gaussian distribution so that the modeling effect is similar to the actual background; the binary image is obtained through the difference between frames and the threshold, and the motion change domain is extracted through mathematical morphological filtering, and finally, the moving target is detected. The experiment proved the following: when there are more motion states, the recall rate is slightly better than that of the VIBE algorithm. It decreased about 0.05 or so, but the relative accuracy rate increased by about 0.12, and the increase ratio is significantly higher than the decrease ratio. Departments need to adopt effective target extraction methods. In order to improve the accuracy of moving target detection, this paper studies the method of background model establishment and target extraction and proposes its own improvement. (shrink)

In this paper, we use motion tracking technology to document the birth of a brand new language: Nicaraguan Sign Language. Languages are dynamic entities that undergo change and growth through use, transmission, and learning, but the earliest stages of this process are generally difficult to observe as most languages have been used and passed down for many generations. Here, we observe a rare case of language emergence: the earliest stages of the new sign language in Nicaragua. By comparing the (...) signing of the oldest and youngest signers of Nicaraguan Sign Language, we can track how the language itself is changing. Using motion tracking technology, we document a decrease in the size of articulatory space of Nicaraguan Sign Language signers over time. The reduction in articulatory space in Nicaraguan Sign appears to be the joint product of several decades of use and repeated transmission of this new language. (shrink)

Although George Berkeley himself made no major scientific discoveries, nor formulated any novel theories, he was nonetheless actively concerned with the rapidly evolving science of the early eighteenth century. Berkeley's works display his keen interest in natural philosophy and mathematics from his earliest writings (Arithmetica, 1707) to his latest (Siris, 1744). Moreover, much of his philosophy is fundamentally shaped by his engagement with the science of his time. In Berkeley's best-known philosophical works, the Principles and Dialogues, he sets up his (...) idealistic system in opposition to the materialist mechanism he finds in Descartes and Locke. In De Motu, Berkeley refines and extends his philosophy of science in the context of a critique of the dynamic accounts of motion offered by Newton and Leibniz. And in Siris, Berkeley's flirtation with neo-Platonism draws inspiration from the fire theory of Boerhaave as well as Newton's aetherial speculations in the Queries of the Optics. In examining Berkeley's critical engagement with the natural philosophy of his time, we will thus improve our understanding of not just his philosophy of science, but of his philosophical corpus as a whole. (shrink)

Action is a means of acquiring perceptual information about the environment. Turning around, for example, alters your spatial relations to surrounding objects and, hence, which of their properties you visually perceive. Moving your hand over an object’s surface enables you to feel its shape, temperature, and texture. Sniffing and walking around a room enables you to track down the source of an unpleasant smell. Active or passive movements of the body can also generate useful sources of perceptual information (Gibson 1966, (...) 1979). The pattern of optic flow in the retinal image produced by forward locomotion, for example, contains information about the direction in which you are heading, while motion parallax is a “cue” used by the visual system to estimate the relative distances of objects in your field of view. In these uncontroversial ways and others, perception is instrumentally dependent on action. According to an explanatory framework that Susan Hurley (1998) dubs the “Input-Output Picture”, the dependence of perception on action is purely instrumental: "Movement can alter sensory inputs and so result in different perceptions… changes in output are merely a means to changes in input, on which perception depends directly" (1998: 342). -/- The action-based theories of perception, reviewed in this entry, challenge the Input-Output Picture. They maintain that perception can also depend in a noninstrumental or constitutive way on action (or, more generally, on capacities for object-directed motor control). This position has taken many different forms in the history of philosophy and psychology. Most action-based theories of perception in the last 300 years, however, have looked to action in order to explain how vision, in particular, acquires either all or some of its spatial representational content. Accordingly, these are the theories on which we shall focus here. -/- We begin in Section 1 by discussing George Berkeley’s Towards a New Theory of Vision (1709), the historical locus classicus of action-based theories of perception, and one of the most influential texts on vision ever written. Berkeley argues that the basic or “proper” deliverance of vision is not an arrangement of voluminous objects in three-dimensional space, but rather a two-dimensional manifold of light and color. We then turn to a discussion of Lotze, Helmholtz, and the local sign doctrine. The “local signs” were felt cues for the mind to know what sort of spatial content to imbue visual experience with. For Lotze, these cues were “inflowing” kinaesthetic feelings that result from actually moving the eyes, while, for Helmholtz, they were “outflowing” motor commands sent to move the eyes. -/- In Section 2, we discuss sensorimotor contingency theories, which became prominent in the 20thcentury. These views maintain that an ability to predict the sensory consequences of self-initiated actions is necessary for perception. Among the motivations for this family of theories is the problem of visual direction constancy—why do objects appear to be stationary even though the locations on the retina to which they reflect light change with every eye movement?—as well as experiments on adaptation to optical rearrangement devices (ORDs) and sensory substitution. -/- Section 3 examines two other important 20th century theories. According to what we shall call the motor component theory, efference copies generated in the oculomotor system and/or proprioceptive feedback from eye-movements are used together with incoming sensory inputs to determine the spatial attributes of perceived objects. Efferent readiness theories, by contrast, look to the particular ways in which perceptual states prepare the observer to move and act in relation to the environment. The modest readiness theory, as we shall call it, claims that the way an object’s spatial attributes are represented in visual experience can be modulated by one or another form of covert action planning. The bold readiness theory argues for the stronger claim that perception just is covert readiness for action. -/- In Section 4, we move to the disposition theory, most influentially articulated by Gareth Evans (1982, 1985), but more recently defended by Rick Grush (2000, 2007). Evans’ theory is, at its core, very similar to the bold efferent readiness theory. There are some notable differences, though. Evans’ account is more finely articulated in some philosophical respects. It also does not posit a reduction of perception to behavioral dispositions, but rather posits that certain complicated relations between perceptual input and behavioral provide spatial content. Grush proposes a very specific theory that is like Evans’ in that it does not posit a reduction, but unlike Evans’ view, does not put behavioral dispositions and sensory input on an undifferentiated footing. (shrink)

Graphic pattern (e.g. geometric design) and number-based code (e.g. digital sequencing) can store and transmit complex information more efficiently than referential modes of representation. The analysis of the two genres and their relation to one another has not advanced significantly beyond a general classification based on motion-centred geometries of symmetry. This article examines an intriguing example of patchwork coverlets from the maritime societies of Oceania, where information referencing a complex genealogical system is lodged in geometric designs. By drawing (...) attention to the interplay of graphic pattern and number-based code and its role in the knowledge economies of maritime societies, the article offers new insight into possible ways of designing a digital informational surface that captures the behaviour of an operational system, allowing both for differentiation and integration. (shrink)

This paper focuses on whether static images can depict motion. It is natural to say that pictures depicting objects caught in the middle of a dynamic action—such as Henri Cartier-Bresson’s (1932) Behind the Gare St. Lazare—are pictures of movement, but, given that pictures themselves do not move, can we make sense of such an idea? Drawing on results from experimental psychology and cognitive sciences, I show that we can. Psychological studies on implicit motion and representational momentum indicate that (...) motion is really perceived in some static images: our visual system is built in order to detect motion, even where it is only implied, and to anticipate the probable outcomes of others’ actions—even when the ‘others’ are only the subject matters of pictures’. I argue that, consequently, a range of popular depiction theories—perceptualist theories of depiction—can accommodate depicted motion. (shrink)