Conversation is supported by the beliefs that people have in common and the perceptual experience that they share. The visual context of a conversation has two aspects: the information that is available to each conversant, and their beliefs about what is present for each other. In our experiment, we separated these factors for the first time and examined their impact on a spontaneous conversation. We manipulated the fact that a visual scene was shared or not and the belief that a (...) visual scene was shared or not. Participants watched videos of actors talking about a controversial topic, then discussed their own views while looking at either a blank screen or the actors. Each believed (correctly or not) that their partner was either looking at a blank screen or the same images. We recorded conversants’ eye movements, quantified how they were coordinated, and analyzed their speech patterns. Gaze coordination has been shown to be causally related to the knowledge people share before a conversation, and the information they later recall. Here, we found that both the presence of the visual scene, and beliefs about its presence for another, influenced language use and gaze coordination. (shrink)

The performance and the success of a group working as a team on a common goal depends on the individuals’ skills and the collective coordination of their abilities. On a perceptual level, individual gaze behavior is reasonably well investigated. However, the coordination of visual skills in a team has been investigated only in laboratory studies and the practical examination and knowledge transfer to field studies or the applicability in real-life situations have so far been neglected. This is (...) mainly due to the fact that a methodological approach along with a suitable evaluation procedure to analyze the gaze coordination within a team in highly dynamic events outside the lab, is still missing. Thus, this study was conducted to develop a tool to investigate the coordinated gaze behavior within a team of three human beings acting with a common goal in a dynamic real-world scenario. This team was a basketball referee team adjudicating a game. Using mobile eye-tracking devices and an indigenously designed software tool for the simultaneous analysis of the gaze data of three participants, allowed, for the first time, the simultaneous investigation of the coordinated gaze behavior of three people in a highly dynamic setting. Overall, the study provides a new and innovative method to investigate the coordinated gaze behavior of a three-person team in specific tasks. This method is also applicable to investigate research questions about teams in dynamic real-world scenarios and get a deeper look at interactions and behavior patterns of human beings in group settings. (shrink)

첨예하고 중대한 사안으로 떠오른 디지털 성범죄 사진 · 영상파일의 불법적 생산과 유포 · 무한공유 시스템은 현실세계의 여성들의 일상 속 시공간을 얽어매고 재구축하는 조건으로 강력히 작동하고 있다. 필자는 이러한 디지털성범죄 시스템을 남성 시선-주체의 특권적 인식 좌표계의 창출로 분석해내고자 하며 이 시스템의 메커니즘을 떠받히고 있는 형이상학적 기반들을 분쇄하고자 한다. 필자는 여성의 위치와 이동반경, 일거수일투족을 파악, 포착해내는 이러한 인식지표 틀의 초월성을 다음과 같은 두가지 측면에서 분석해내고자 한다. 첫째, 수직적 초월성(transcendent)의 측면에서 여성의 몸이 구획되고 차등적으로 배치되는 기원을 데카르트의 『성찰』을 통해 고찰할 것이다. 둘째, 칸트적 (...) 의미에서의 초월론적(transcendental) 측면에 입각하여 여기저기 파인 남근 다발체들의 시선-구멍이 일으키는 시공간의 왜곡과 변형에 대해 논의하겠다. 더 나아가 필자는 환상의 일상화된 무대로서 기능하게 된 현실에 대한 분석으로서 판타지가 작동하는 방식에 대한 지젝의 논의를 분석할 것이다. 판타지의 재현물들이 어떠한 방식으로 위계적으로 욕망의 대상들을 배치하고 있으며 현실 속으로 난입하고 있는지를 고찰할 것이다. (shrink)

From playing basketball to ordering at a food counter, we frequently and effortlessly coordinate our attention with others towards a common focus: we look at the ball, or point at a piece of cake. This non-verbal coordination of attention plays a fundamental role in our social lives: it ensures that we refer to the same object, develop a shared language, understand each other’s mental states, and coordinate our actions. Models of joint attention generally attribute this accomplishment to gaze (...) coordination. But are visual attentional mechanisms sufficient to achieve joint attention, in all cases? Besides cases where visual information is missing, we show how combining it with other senses can be helpful, and even necessary to certain uses of joint attention. We explain the two ways in which non-visual cues contribute to joint attention: either as enhancers, when they complement gaze and pointing gestures in order to coordinate joint attention on visible objects, or as modality pointers, when joint attention needs to be shifted away from the whole object to one of its properties, say weight or texture. This multisensory approach to joint attention has important implications for social robotics, clinical diagnostics, pedagogy and theoretical debates on the construction of a shared world. (shrink)

People coordinate body postures and gaze patterns during conversation. We review literature showing that (1) action embodies cognition, (2) postural coordination emerges spontaneously when two people converse, (3) gaze patterns influence postural coordination, (4) gaze coordination is a function of common ground knowledge and visual information that conversants believe they share, and (5) gaze coordination is causally related to mutual understanding. We then consider how coordination, generally, can be understood as temporarily (...) coupled neuromuscular components that function as a collective unit known as a coordinative structure in the motor control literature. We speculate that the coordination of gaze and body sway found in conversation may be understood as a cross‐person coordinative structure that embodies the goals of the joint action system. (shrink)

When humans are addressing multiple robots with informative speech acts, their cognitive resources are shared between all the participating robot agents. For each moment, the user’s behavior is not only determined by the actions of the robot that they are directly gazing at, but also shaped by the behaviors from all the other robots in the shared environment. We define cooperative behavior as the action performed by the robots that are not capturing the user’s direct attention. In this paper, we (...) are interested in how the human participants adjust and coordinate their own behavioral cues when the robot agents are performing different cooperative gaze behaviors. A novel gaze-contingent platform was designed and implemented. The robots’ behaviors were triggered by the participant’s attentional shifts in real time. Results showed that the human participants were highly sensitive when the robot agents were performing different cooperative gazing behaviors. Keywords: human-robot interaction; multi-robot interaction; multiparty interaction; eye gaze cue; embodied conversational agent. (shrink)

This article analyses the orientation of gaze as a significant communicative resource in televised political interviews. The study explores how interviewees use their gaze, in coordination with talk, in receiving and answering adversarial questions. It is guided by conversation analysis, Goffman’s work on gaze in interaction, and the approach on embodied actions developed primarily by Goodwin. Gaze is described as a flexible recipient and speaker resource available for stance-taking, the downgrading and upgrading of actions, and (...) the claiming of the floor. The study is based on taped and transcribed data from two formats of election campaign interviews on Swedish television, including 350 question and response sequences. (shrink)

In normal observers, gazing at one’s own face in the mirror for a few minutes, at a low illumination level, triggers the perception of strange faces, a new visual illusion that has been named ‘strange-face in the mirror’. Individuals see huge distortions of their own faces, but they often see monstrous beings, archetypal faces, faces of relatives and deceased, and animals. In the experiment described here, strange-face illusions were perceived when two individuals, in a dimly lit room, gazed at each (...) other in the face. Inter-subjective gazing compared to mirror-gazing produced a higher number of different strange-faces. Inter-subjective strange-face illusions were always dissociative of the subject’s self and supported moderate feeling of their reality, indicating a temporary lost of self-agency. Unconscious synchronization of event-related responses to illusions was found between members in some pairs. Synchrony of illusions may indicate that unconscious response–coordination is caused by the illusion–conjunction of crossed dissociative strange-faces, which are perceived as projections into each other’s visual face of reciprocal embodied representations within the pair. Inter-subjective strange-face illusions may be explained by the subject’s embodied representations and the other’s visual face binding. Unconscious facial mimicry may promote inter-subjective illusion–conjunction, then unconscious joint-action and response–coordination. (shrink)

Safe stair negotiation is an everyday task that children with developmental coordination disorder are commonly thought to struggle with. Yet, there is currently a paucity of research supporting these claims. We investigated the visuomotor control strategies underpinning stair negotiation in children with and without DCD by measuring kinematics, gaze behavior and state anxiety as they ascended and descended a staircase. A questionnaire was administered to determine parents' confidence in their child's ability to safely navigate stairs and their child's (...) fall history. Kinematics were measured using three-dimensional motion capture, whilst gaze was measured using mobile eye-tracking equipment. The parents of DCD children reported significantly lower confidence in their child's ability to maintain balance on the stairs and significantly more stair-related falls in the previous year compared to the parents of typically developing children. During both stair ascent and stair descent, the children with DCD took longer to ascend/descend the staircase and displayed greater handrail use, reflecting a more cautious stair negotiation strategy. No differences were observed between groups in their margin of stability, but the DCD children exhibited significantly greater variability in their foot-clearances over the step edge, which may increase the risk of a fall. For stair descent only, the DCD children reported significantly higher levels of state anxiety than the TD children and looked significantly further along the staircase during the initial entry phase, suggesting an anxiety-related response that may bias gaze toward the planning of future stepping actions over the accurate execution of an ongoing step. Taken together, our findings provide the first quantifiable evidence that safe stair negotiation is a significant challenge for children with DCD, and that this challenge is reflected by marked differences in their visuomotor control strategies and state anxiety levels. Whilst it is currently unclear whether these differences are contributing to the frequency of stair-related falls in children with DCD, our findings pave the way for future research to answer these important questions. (shrink)

The vestibulo-ocular reflex plays an important role in controlling the gaze at a visual target. Although patients with vestibular hypofunction aim to improve their VOR function, some retain dysfunction for a long time. Previous studies have explored the effects of direct current stimulation on vestibular function; however, the effects of random noise stimulation on eye–head coordination have not previously been tested. Therefore, we aimed to clarify the effects of high frequency noisy vestibular stimulation on eye–head coordination related (...) to VOR function. Thirteen healthy young adult participants with no serious disease took part in our study. The current amplitude and density used were 0.4 mA and 0.2 mA/cm2, respectively, with a random noise frequency of 100–640 Hz. The electrodes were located on both mastoid processes. The stimulus duration and fade in/out duration were 600 and 10 s, respectively. Subjects oscillated their head horizontally, gazing at the fixation point, at 1 Hz for 30 repetitions. The coordination of eye–head movements was measured by eye-tracking and a motion capture system. Peak-to-peak angles for eye and head movement and deviation of the visual line from the fixation target revealed no significant differences between HF-nVS and sham. The lag time between the eye and head movement with HF-nVS post-stimulation was significantly shorter than that of the sham. We found that HF-nVS can reduce the lag time between eye and head movement and improve coordination, contributing to a clear retinal image. This technique could be applied as a form of VOR training for patients with vestibular hypofunction. (shrink)

Cycling in traffic requires a combination of motor and perceptual skills while interacting with a dynamic and fast-changing environment. The inferior perceptual-motor skills in individuals with developmental coordination disorder may put them at a higher risk for accidents. A key skill to navigate in traffic is to quickly detect hazardous situations. This perceptual-cognitive skill was investigated in young adults with DCD using simulated traffic situations in a hazard perception test in cycling. Nine individuals with DCD and nine typically developing (...) individuals participated in the study and completed the test while their gaze was tracked using a remote eye tracking device. A questionnaire was used to determine cycling experience and the perception of cycling and anticipation skill in traffic. Despite a longer period to master the motor skill of cycling, individuals with DCD reported to be able to safely cycle in traffic around the same age as TD young adults. In the hazard perception test, individuals with DCD fixated the hazards later, less frequently and for a shorter duration than the TD participants, however, the participants with DCD did not wait longer to react to the hazard than the TD participants. Interestingly, individuals with DCD rated the traffic situations in the test as significantly more dangerous than the TD participants. In conclusion, the differences exposed in the hazard perception test may imply an increased risk of accidents in individuals with DCD. In further research and practice it is recommended that both the motor and the perceptual aspects of cycling are addressed. (shrink)

Gaze is a central mechanism for the entry into and coordination of face-to-face interaction. As such, persistent and sustained gaze withdrawal may indicate significant troubles in an interaction. This article examines how two police officers, in seeking to calm a hysterical woman whose grandson has been shot, treat her refusal to gaze at them as a central component of her persisting hysteria. Toward the end of getting the woman to calm down, one officer seeks her return (...) gaze using embedded and exposed methods of gaze pursuit. These methods work on a continuum in which, at one end, a turn at talk can be preserved as the main activity, while at the other end, the main activity becomes remedying the interactional trouble. These methods address different interactional relevancies having to do with 1) being a listener to a speaker, 2) being a recipient of a directive action, and 3) a basic obligation to comport oneself as at least minimally aware and responsive when targeted by the actions of co-present others. (shrink)

This paper reports on an investigation of gaze patterns and other non-verbal behavior in dyadic, problem-solving based interactions. In a planning activity, participants are given an instruction sheet and a physical map of a zoo. Both participants must coordinate their actions to find a common solution to the problem. This paper aims at examining how activity-based interactions vary from other interactions, such as everyday conversation and story-telling. The findings of this paper suggest that participants’ non-verbal behavior, such as smiling, (...) nodding and in particular gaze, varies according to the interactional organization. In egalitarian interactions gaze directed at the other person occurs together with meta-task utterances, for example personal and humorous remarks. This paper highlights the role of gaze in task-based interactions to show that gaze is an integral part of stance taking, as it enables participants to position themselves in a joint activity. (shrink)

Based on a small research project conducted in Kuala Lumpur (KL) in July - August 2017, the paper discusses places and practices of young heterosexual Malaysian Muslims dating in KL. In Malaysia, the law (Khalwat law) does not allow for two unrelated people (where at least one of them is Muslim) of opposite sexes to be within ‘suspicious proximity’ of one another in public. This law significantly influences behaviours and activities in urban spaces in KL. However, apart from the legal (...) framework, the faith of urban users seems to influence significantly the way they perceive space and how they behave in the city. The paper questions the analytical usefulness of the notion of public space (as the Western construct) in an attempt to formulate new intellectual coordinates to discuss urban space in a context of the Islamic, post-colonial, tropical, and global city. The ultimate aim of this paper is to start discussing how religious imagination and narratives could lead to formulating a new typology of urban spaces. (shrink)

AimThe neurocognitive basis of Developmental Coordination Disorder remains an issue of continued debate. This combined systematic review and meta-analysis provides a synthesis of recent experimental studies on the motor control, cognitive, and neural underpinnings of DCD.MethodsThe review included all published work conducted since September 2016 and up to April 2021. One-hundred papers with a DCD-Control comparison were included, with 1,374 effect sizes entered into a multi-level meta-analysis.ResultsThe most profound deficits were shown in: voluntary gaze control during movement; cognitive-motor (...) integration; practice-/context-dependent motor learning; internal modeling; more variable movement kinematics/kinetics; larger safety margins when locomoting, and atypical neural structure and function across sensori-motor and prefrontal regions.InterpretationTaken together, these results on DCD suggest fundamental deficits in visual-motor mapping and cognitive-motor integration, and abnormal maturation of motor networks, but also areas of pragmatic compensation for motor control deficits. Implications for current theory, future research, and evidence-based practice are discussed.Systematic Review RegistrationPROSPERO, identifier: CRD42020185444. (shrink)

A growing number of children in the United States are exposed to multiple languages at home from birth. However, relatively little is known about the early process of word learning—how words are mapped to the referent in their child-centered learning experiences. The present study defined parental input operationally as the integrated and multimodal learning experiences as an infant engages with his/her parent in an interactive play session with objects. By using a head-mounted eye tracking device, we recorded visual scenes from (...) the infant’s point of view, along with the parent’s social input with respect to gaze, labeling, and actions of object handling. Fifty-one infants and toddlers from an English monolingual or a diverse bilingual household were recruited to observe the early multimodal learning experiences in an object play session. Despite that monolingual parents spoke more and labeled more frequently relative to bilingual parents, infants from both language groups benefit from a comparable amount of socially coordinated experiences where parents name the object while the object is looked at by the infant. Also, a sequential path analysis reveals multiple social coordinated pathways that facilitate infant object looking. Specifically, young children’s attention to the referent objects is directly influenced by parent’s object handling. These findings point to the new approach to early language input and how multimodal learning experiences are coordinated socially for young children growing up with monolingual and bilingual learning contexts. (shrink)

Cognitive Reserve, according to a recent consensus definition of the NIH-funded Reserve and Resilience collaboratory,1 is constituted by any mechanism contributing to cognitive performance beyond, or interacting with, brain structure in the widest sense. To identity multivariate activation patterns fulfilling this postulate, we investigated a verbal Sternberg fMRI task and imaged 181 people with age coverage in the ranges 20–30 and 55–70. Beyond task performance, participants were characterized in terms of demographics, and neuropsychological assessments of vocabulary, episodic memory, perceptual speed, (...) and abstract fluid reasoning. Participants studied an array of either one, three, or six upper-case letters for 3 s, then a blank fixation screen was presented for 7 s, to be probed with a lower-case letter to which they responded with a differential button press whether the letter was part of the studied array or not. We focused on identifying maintenance-related activation patterns showing memory load increases in pattern score on an individual participant level for both age groups. We found such a pattern that increased with memory load for all but one person in the young participants, and such a pattern for all participants in the older group. Both patterns showed broad topographic similarities; however, relationships to task performance and neuropsychological characteristics were markedly different and point to individual differences in Cognitive Reserve. Beyond the derivation of group-level activation patterns, we also investigated the inter-subject spatial similarity of individual working memory rehearsal patterns in the older participants’ group as a function of neuropsychological and task performance, education, and mean cortical thickness. Higher task accuracy and neuropsychological function was reliably associated with higher inter-subject similarity of individual-level activation patterns in older participants. (shrink)

Humans coordinate their focus of attention with others, either by gaze following or prior agreement. Though the effects of joint attention on perceptual and cognitive processing tend to be examined in purely visual environments, they should also show in multisensory settings. According to a prevalent hypothesis, joint attention enhances visual information encoding and processing, over and above individual attention. If two individuals jointly attend to the visual components of an audiovisual event, this should affect the weighing of visual information (...) during multisensory integration. We tested this prediction in this preregistered study, using the well-documented sound-induced flash illusions, where the integration of an incongruent number of visual flashes and auditory beeps results in a single flash being seen as two (fission illusion) and two flashes as one (fusion illusion). Participants were asked to count flashes either alone or together, and expected to be less prone to both fission and fusion illusions when they jointly attended to the visual targets. However, illusions were as frequent when people attended to the flashes alone or with someone else, even though they responded faster during joint attention. Our results reveal the limitations of the theory that joint attention enhances visual processing as it does not affect temporal audiovisual integration. (shrink)

Animate vision systems have gaze control mechanisms that can actively position the camera coordinate system in response to physical stimuli. Compared to passive systems, animate systems show that visual computation can be vastly less expensive when considered in the larger context of behavior. The most important visual behavior is the ability to control the direction of gaze. This allows the use of very low resolution imaging that has a high virtual resolution. Using such a system in a controlled (...) way provides additional constraints that dramatically simplify the computations of early vision. Another important behavior is the way the environment “behaves‘. Animate systems under real-time constraints can further reduce their computational burden by using environmental cues that are perspicuous in the local context. A third source of economy is introduced when behaviors are learned. Because errors are rarely fatal, systems using learning algorithms can amortize computational cost over extended periods. Further economies can be achieved when the learning system uses indexical reference, which is a form of dynamic variable binding. Animate vision is a natural way of implementing this dynamic binding. (shrink)

This study investigates moments in which one participant in an interaction embodies that he is “doing thinking,” a display that is commonly referred to as “thinking face. ” From an interactional perspective, it is assumed that embodied displays of “doing thinking” are a recurring social practice and serve interactive functions. While previous studies have examined thinking faces primarily in word searches and storytelling, the present study focuses on argumentative activities, in which children engage in processes of joint decision-making. The paper (...) has two interrelated aims. The first aim is to describe how multiple modalities—beyond the face—are temporally coordinated to create multimodal gestalts of “doing thinking.” It is shown that thinking displays not only involve dynamic imaginative gaze but also stylized bodily postures. The second aim is to generate knowledge about the functions of thinking displays in children's argumentative activities. The analysis describes how both speakers and recipients use thinking displays in different turn positions and align them with verbal talk or silence. The data for this study comprise video recordings of decision-making processes in groups of older children. Drawing on a multimodal approach to situated interaction, it will be proposed that embodied displays of “doing thinking” provide a resource to shape participation frameworks, mark epistemic stances and create epistemic ecologies for collaborative reasoning. By investigating thinking displays in a particular conversational activity, the study sheds light on the diversity and context-sensitive functionality of thinking displays. It also contributes to recent research on children's collaborative reasoning as an embodied discursive practice. (shrink)

Using contemporary science, the paper builds on Wittgenstein’s views of human language. Rather than ascribing reality to inscription-like entities, it links embodiment with distributed cognition. The verbal or (quasi) technological aspect of language is traced to not action, but human specific interactivity. This species-specific form of sense-making sustains, among other things, using texts, making/construing phonetic gestures and thinking. Human action is thus grounded in appraisals or sense-saturated coordination. To illustrate interactivity at work, the paper focuses on a case study. (...) Over 11 s, a crime scene investigator infers that she is probably dealing with an inside job: she uses not words, but intelligent gaze. This connects professional expertise to circumstances and the feeling of thinking. It is suggested that, as for other species, human appraisal is based in synergies. However, since the verbal aspect of language constrains action and thinking, we also develop customary ways of behaving. Humans extend embodiment by linking real-time activity to actions through which the collectivity imposes a variable degree of control over how individuals realise values. (shrink)

We present a spatial system called Specialized Egocentrically Coordinated Spaces embedded in an embodied cognitive architecture (ACT-R Embodied). We show how the spatial system works by modeling two different developmental findings: gaze-following and Level 1 perspective taking. The gaze-following model is based on an experiment by Corkum and Moore (1998), whereas the Level 1 visual perspective-taking model is based on an experiment by Moll and Tomasello (2006). The models run on an embodied robotic system.

When people communicate, they coordinate a wide range of linguistic and non-linguistic behaviors. This process of coordination is called alignment, and it is assumed to be fundamental to successful communication. In this paper, we question this assumption and investigate whether disalignment is a more successful strategy in some cases. More specifically, we hypothesize that alignment correlates with task success only when communication is interactive. We present results from a spot-the-difference task in which dyads of interlocutors have to decide whether (...) they are viewing the same scene or not. Interactivity was manipulated in three conditions by increasing the amount of information shared between interlocutors. We use recurrence quantification analysis to measure the alignment between the scan-patterns of the interlocutors. We found that interlocutors who could not exchange feedback aligned their gaze more, and that increased gaze alignment correlated with decreased task success in this case. When feedback was possible, in contrast, interlocutors utilized it to better organize their joint search strategy by diversifying visual attention. This is evidenced by reduced overall alignment in the minimal feedback and full dialogue conditions. However, only the dyads engaged in a full dialogue increased their gaze alignment over time to achieve successful performances. These results suggest that alignment per se does not imply communicative success, as most models of dialogue assume. Rather, the effect of alignment depends on the type of alignment, on the goals of the task, and on the presence of feedback. (shrink)

Eye movements during mental imagery are not epiphenomenal but assist the process of image generation. Commands to the eyes for each fixation are stored along with the visual representation and are used as spatial index in a motor‐based coordinate system for the proper arrangement of parts of an image. In two experiments, subjects viewed an irregular checkerboard or color pictures of fish and were subsequently asked to form mental images of these stimuli while keeping their eyes open. During the perceptual (...) phase, a group of subjects was requested to maintain fixation onto the screen's center, whereas another group was free to inspect the stimuli. During the imagery phase, all of these subjects were free to move their eyes. A third group of subjects (in Experiment 2) was free to explore the pattern but was requested to maintain central fixation during imagery. For subjects free to explore the pattern, the percentage of time spent fixating a specific location during perception was highly correlated with the time spent on the same (empty) locations during imagery. The order of scanning of these locations during imagery was correlated to the original order during perception. The strength of relatedness of these scanpaths and the vividness of each image predicted performance accuracy. Subjects who fixed their gaze centrally during perception did the same spontaneously during imagery. Subjects free to explore during perception, but maintaining central fixation during imagery, showed decreased ability to recall the pattern. We conclude that the eye scanpaths during visual imagery reenact those of perception of the same visual scene and that they play a functional role. (shrink)

Located in Kleinbasel close to the Rhine, the Kaskadenkondensator is a place of mediation and experimental, research-and process-based art production with a focus on performance and performative expression. The gallery, founded in 1994, and located on the third floor of the former Sudhaus Warteck Brewery (hence cascade condenser), seeks to develop interactions between artists, theorists and audiences. Eight, maybe, nine or ten 40 litre bags of potting compost lie strewn about the floor of a high-ceilinged white washed hall. Dumped, split (...) open, the soil mixed with iridescent specks of green, blue and red glitter. On the walls hang large black and white photographic images—negative and positive prints barely clean, hardly sharp, scavenged from the world and presented half processed. On a third wall, hangs a framed golden and charcoal surface. Finally, a huge stain of black dye runs down a wall that descends into a sunken quarter of the Kaskadenkondensator gallery space. The results of a collaboration between Oliver Minder and Walter Derungs reflect on themes addressed in the recent Aesthetics in the 21st Century conference held by the department of English, University of Basel. In particular, the joint show questions how an aesthetic experience may be other than a human-world interaction, hinting at the withdrawal and veiling that objects perform, while demanding that different works engage with each other and play out this game under the non-supervisory eyes of a human audience. Things here are becoming—sometimes it’s a movement towards a more complete ontic whole in a projection of finality, other times it’s a dispersal, an atrophy to rather disarrayed entities. Yet, in the moment and place in which the objects are, we take them as here and now. Let’s get to the material of the stuff that Minder and Derungs have assembled. Oliver Minder employs organic materials—potting earth, cuttlefish ink secretion, rice, and insects; yet his works hardly seem natural in the sense of a harmonic relation between material and the form they are constrained into, the objects they are compelled to occupy. For the substrates on, through, or within which these natural materials are mediated are harshly inorganic substances—Plexiglas, safety glass, acrylic resin, boat varnish, spray paint. Minder, thus, generates a conflict within the materiality of his work between two polar opposites—from the human perspective—in the contiguity of materials engaging with each other in a thrown together formation that nonetheless appears to keep the materials and the objects they make in happy accidental relation to each other. Let me expand a little: on the one hand, the things Minder makes query our belief in substance as belonging in a particular domain, an environment suited to precisely that stuff. We are focused on thinking categorically where things belong, both in terms of natural place and natural relations they might extend to each other. Hence, we are driven to think of environment and order. On the other hand, while extracting things from their conventional place and arranging them within awkward constellations that we as observers feel isn’t quite right, Minder manages to persuade the viewer that the materials are nonetheless “doing alright.” So, simultaneous to our awareness of the appropriateness of the world according to our global notions of accord and uniformity, we are forced to accept the local discrepancies of disassociation, inappropriateness and misplacement. The tension between these two vectors generates a vacillation that intensifies Minder’s work. In the Kaskadenkondensator works, then, it is vital to first consider the material of Minder’s works: potting compost—what is it doing here in the first place?—seems to enjoy being “polluted” by sparkly glitter. Glitter has a long history, used in cosmetics by the Egyptians, and in cave paintings, too, earlier made of beetle shells and mica, nowadays glitter is made of plastic cut to minute sizes down to 50 microns. So what’s the point here? Well shiny bits of dust-like material are actually generated from ultra-thin plastic sheets and are normally cut into shapes that fit contiguously on a two-dimensional surface: squares, triangles, hexagons etc. What then appears to be totally random, chaotic decoration, is actually an array of extremely regular identifiable objects. 1 Of course scale has a role to play here. The minuteness of the dimensions means the regularity is beyond our recognition—all we see are the twinkling surfaces of the multi-coloured grains of plastic. In contrast, potting compost, which appears to be unary in its dull unresponsive lumpen disposition, is in fact an amalgam of a variety of organic and inorganic materials: peat, bark, mushroom compost, and sand and perlite, and should perhaps be more proactively exciting to the viewer because of this complexity. Yes; we can (if we care to) identify different textures, different sizes in the mixture of the medium, but I claim that we tend to treat this organic/inorganic assemblage as just a simple substance. Further and crucially important to our consideration here is that the medium is partially contained, but also partially spilling from the split plastic bags in which it is sold in garden centres. That the compost spills out gives it a movement suggesting life; that the bags are cast here and there in a random fashion by Oliver Minder, lying like discarded carcasses, hacked torsos, dismembered bodies, suggests a horrific murder scene, a Tatort. 2 The glitter flourishes in the medium, lies happy and decorative; that is simply what it does, how it is—always already broken, made-for-scattering, designed to be incomplete; the taken-to-be-natural compost, in contrast, cannot rest content but is forced to speak to us metaphorically in its abject overflowing of violence and rupture. While Oliver Minder’s elements in the installation direct our attention to material, Walter Derungs’ works raise questions around seeing and making in photography. There is a simultaneous flicker between the materials and their use in the production of a sense making representation, on the one hand, and on the other the very notion of what is worthy of picturing, framing, representing on the other. Derungs' images are of non-places. Ranging from archaic decaying monster buildings, buildings that have gone far beyond the ravages of a time that we can safely associate with the genteel preservation of a Bernd and Hill Belcher post-industrial decline, to the background “noise” of an urban world that is falling apart, and to which we most of the time seem to pay little attention, and habitually just pass by. In this respect, their non-ness differs somewhat from the conventional association of the term with Marc Augé 3 , where emphasis is on the specifics (if we do care to examine them for their non-placedness) of the spatial or place containment in which movement between multimodal coordinates occurs in supermodern late capitalist post-urban spaces. In other words, we might be in an Augéian non-place and (not) experience—be impervious to—that environment, or we might in Derungs’ manner look out from such a position at the “scenery” around us. I claim scenery, as this is what Derungs seems to do with his partial photography—construct a very purposefully articulated, symmetric, flat world of image. Mostly depopulated, his images construct a space in which the direction of time is uncertain: are these partial structures falling apart, or perhaps terminated in a never-to-be-completed state, or are they a few steps from final completion? Temporal and spatial dimensions figure large in Derungs’ image-making: his world, and perhaps this is in fact the only way for it to be registered photographically, is already image before it is photographed. A key combination of images in this show is a matrix of six black and white negative prints measuring 300 x 215 cm that form the image of a semi-derelict (or is it yet incomplete) church, and adjacent on a perpendicular wall, a single black and white positive print 150 x 250 cm of two bricked-up windows of a late-Victorian industrial building. What are we led to believe that we see here? In the negative print, the conditions of perception 4 are sufficiently reproduced for us to recognise the structure of the building, to distinguish ground and form, to relate some partial elements of narrative, and to recognize symbols such as the alter cross and figure of Christ, a looming crane, a traffic cone, and banks of tiered seating. We piece the image together both from the individual forms which we recognize despite the tonal reversal, and we piece the six prints together as a whole, the matrix of lines between them emphasizing our purview onto the world. While we recognise the forms at work in the image and might possibly relate the negative reversals to other figurations such as Vera Lutter’s camera obscura exposures, we cannot but avoid seeing the partialness of the image in the sponge marks of the developer that was spread by hand across the prints. 5 Derungs’ thus intervenes with our usual conception of photography as the mimetic realist vehicle sine qua non , by exposing the viewer to tonal reversal and incomplete or over developed areas of the print. We thus confront both the idiom of such image making and its raw (chemical) materiality at once in the simultaneity of the recognition of what the image pictures and the recognition that it is in the act of picturing. The church image, taken from the series “BW Negativs 2011,” thus orients us towards how we see things in the world via photographs. The single image of the bricked-up wall presents us with a completely different visuality that relates to a faciality 6 which we cannot easily escape from. We look, or rather try to look with no success, through the face of the windows, through the classic Albertian screen 7 which has already been given to us in the church matrix beside. Yet although we should be able to make more of these concealed windows because they are a positive print, because they are complete, because they approach us on a more realistic scale, reproduced at life size, we cannot. The objects pictured here withdraw from us; furthermore, they merely mock our blindness at not seeing how we look. Blocked up with quite a hint of paned glass behind, one window is blanked out with a white blind, the other simply blankly dark. The apertures look like eyes with teeth in them, or a Dogon mask, or even Man Ray’s Noire et Blanche (1926) if we want to get really perverse. The height of elegant modernist chauvinist beauty thrown against the vacuity of post-industrial decline. Derungs thus catapults us consciously into a world enfolded with and through images, but in such a way that the images themselves become objects that stand resistant to us, impervious to our gaze, indifferent. We—and indeed they—do not attempt to reach out to a real that is beyond, rather the images play in a world that is just theirs, and we can only enter that world if we too submit to their regime: tonal reversal, segmented, partial, inadequate, still, wrenched out of time. In contemplation, in the flood of the image “falling” off the wall, we too become image-object. Perhaps enough has now been said about the works, yet enough can never really be said, we know the image will always exceed the word—let’s accelerate the critique: Derungs’ work continues in a second space partially partitioned from this first room. Opposing three more “BW Negativs” which figure yet more quotidian aspects of the world is Minder’s gold spray paint and cuttlefish secretion mix: things that just shouldn’t work together do in the dialogue between stuff that Derungs and Minder have constructed. Minder makes things; Derungs makes images; together they make objects which inhabit their own world which we can approach and sensually engage with and come to grips with only on those objects’ own terms. This is best summarised by a final work made by Oliver Minder which on a third wall faces these two semi-partitioned spaces. A deep black stain about 100 X 200 cm with streak marks running down a further 2 metres hovers positioned to observe the whole work, and also to be part of this installation, too. This liminal flat suzerain lies in/out of the whole work. The stain of cuttlefish secretion resonates with Derungs’ sponge strokes on the church image; it mirrors the iris of an all-seeing eye; it combines material in situ with the situation itself. Where Minder’s other works have material and medium or substrate upon which the material is exercised, this single black hole is image which sucks everything up into itself. It draws the viewer, who must otherwise look away attentively at the floor work, and imagine horror, or smile at the ironic play of glitter. Look away at the image constructions that suggest how it is we too look to our world. See the play of thing and image in a third area. Or, finally return to the base of the pyramid that triangulates, to realise the stuff-image that unlocks it all for us. Black on white, organic on inorganic, material to substrate, that which in the falling out of one on the other, in its running down the wall simply gives form to both content and expression in one direction, and content and expression to form in another. NOTES In fact, glitter is used as associative forensic evidence: the 20,000 or so varieties are all uniquely identifiable. Joel Sternfeld, Tatorte: Bilder gegen das Vergessen (München: Schirmer/Mosel, 1996). Marc Augé, Non­places: Introduction to an Anthropology of Supermodernity trans. John Howe (London: Verso, 2006). An echo of the uneven paint strokes of light­sensitive chemicals in the paper preparations made by Henry Talbot some 170 years ago in the first sun drawings that also often pictured architectural forms. It was Talbot’s surprising discovery that where a weaker chemical solution was more thinly spread, greater light sensitivity was actualized, yet this virtual image had then to be chemically developed in a second step. Thus, Derungs unevenly finished spongings suggestively trace back to this originary technology (although his sweeps are the stains of uneven development and not those of the initial preparation of light–sensitive material). Umberto Eco, “Critique of the Image” in “Articulations of Cinematic Code” Cinematics 1, 1970. Gilles Deleuze and Felix Guattari, A Thousand Plateaus: Capitalism and Schizophrenia trans. Brian Massumi (Minneapolis: University of Minnesota Press, 2007). Geoffrey Batchen, Burning With Desire: the Conception of Photography (Cambridge, Mass: MIT Press, 1999). (shrink)

Discussions of _joint attention_ often focus on examples that involve multiple interacting thinkers who align their attention by triangulating upon an object (e.g., by pointing, gaze following, orienting, etc.). However, not all forms of attending together seem to involve this kind of interpersonal coordination. When an audience attends to a talk, they do not do so by engaging in the perspective-driven alignment of attention that is characteristic of joint attention. Nor do students learning in a digital environment (e.g., (...) on Zoom) triangulate a perspective in the manner typical of joint attention. One might conclude that accounts of joint attention must be _broader_ than have typically been proposed and cannot require coordinated interactions which draw upon the participant’s perspective. I argue that this argument fails because there are multiple forms of attending together, and the processes that enable _collective attention_ in conference talks and Zoom classrooms are different from those that enable the more familiar interaction-based forms of joint attention. By distinguishing joint attention and collective attention, this essay seeks to better understand both the ways in which the digital environments demand a broader concept of joint attention, as well as the place of attending together in digital environments. (shrink)

This study analyzed and explored the cognitive load of Australian energy market operators managing one of the longest inter-connected electrical networks in the world. Each operator uses a workstation with seven screens in an active control room environment, with a large coordination screen to show information and enable collaboration between different control centers. Cognitive load was assessed during both training scenarios and regular control room operations via the integration of subjective and physiological measures. Eye-tracking glasses were also used to (...) analyze the operators gaze behavior. Our results indicate that different events, different participants for the same session, and different periods of one session all have varying degrees of cognitive load. The system design was observed to be inefficient in some situations and to have an adverse affect on cognitive load. In critical situations for instance, operator collaboration was high and the coordination screen was used heavily when collaborating between two control centers, yet integration with the system could be improved. Eye tracking data analysis showed that the layout of applications across the seven screens was not optimal for many tasks. Improved layout strategies, potential combination of applications, redesigning of certain applications, and linked views are all recommended for further exploration in addition to improved integration of procedures and linking alarms to visual cues. (shrink)

The relationship between multinational corporations and nongovernmental organizations on social and environmental issues sometimes evolves from being antagonistic to cooperative. To explore how MNCs and NGOs are able to cooperate as friends rather than remain foes, this conceptual research drawing on complexity theory examines a proposed process of mutual adaptation occurring through more flexible semi-structures that support the evolution of joint strategic responses enabled by future gazing, communication systems that facilitate joint strategic responses, and coordinated, timed-based change that supports joint (...) strategic responses. The article provides illustrations from MNC–NGO collaborations. Conclusions are that mutual adaptation and cooperative resolutions are more likely when organizations either share these capabilities or compensate for each other’s shortcomings, and make trade-offs that align with joint strategic objectives. This article contributes to complexity theory and the NGO–MNC literature by exploring how interorganizational cooperative behavior incorporates mutual adaptation so that more sustainable practices are implemented and continuously improved upon by MNCs. (shrink)

The human capacity for intersubjective engagement is present, even when one is limited in speaking, pointing, and coordinating gaze. This paper examines the everyday social interactions of two differently-disposed actors—a non-speaking autistic child and his speaking, neurotypical mother—who participate in shared attention through dialogic turn-taking. In the collaborative pursuit of activities, the participants coordinate across multiple turns, producing multi-turn constructions that accomplish specific goals. The paper asks two questions about these collaborative constructions: 1) What are their linguistic and discursive (...) structures? 2) How do embodied actions contribute to these constructions? Findings show that the parent and child repeatedly co-produced multi-turn constructions that had consistent structures, implying a sophisticated ability to anticipate the completion of action trajectories. Examining the embodied actions of interactants revealed that the child often accommodated to the parent’s demands for participation. Nonetheless, the child occasionally pursued his own goals by improvising with and within multi-turn constructions. He launched constructions to redirect parental attention, and otherwise produced surprising actions within the turn-taking structure of these constructions. The paper concludes that multi-turn constructions in the midst of activities are a primordial site in which to begin observing the competencies of non-speaking autistic children for intersubjective engagement. (shrink)

This paper reports on a quiz robot experiment in which we explore similarities and differences in human participant speech, gaze, and bodily conduct in responding to a robot’s speech, gaze, and bodily conduct across two languages. Our experiment involved three-person groups of Japanese and English-speaking participants who stood facing the robot and a projection screen that displayed pictures related to the robot’s questions. The robot was programmed so that its speech was coordinated with its gaze, body position, (...) and gestures in relation to transition relevance places, key words, and deictic words and expressions in both languages. Contrary to findings on human interaction, we found that the frequency of English speakers’ head nodding was higher than that of Japanese speakers in human-robot interaction. Our findings suggest that the coordination of the robot’s verbal and non-verbal actions surrounding TRPs, key words, and deictic words and expressions is important for facilitating HRI irrespective of participants’ native language. Keywords: coordination of verbal and non-verbal actions; robot gaze comparison between English and Japanese; human-robot interaction ; transition relevance place ; conversation analysis. (shrink)

When considering external assistive systems for people with motor impairments, gaze has been shown to be a powerful tool as it is anticipatory to motor actions and is promising for understanding intentions of an individual even before the action. Up until now, the vast majority of studies investigating the coordinated eye and hand movement in a grasping task focused on single objects manipulation without placing them in a meaningful scene. Very little is known about the impact of the scene (...) context on how we manipulate objects in an interactive task. In the present study, it was investigated how the scene context affects human object manipulation in a pick-and-place task in a realistic scenario implemented in VR. During the experiment, participants were instructed to find the target object in a room, pick it up, and transport it to a predefined final location. Thereafter, the impact of the scene context on different stages of the task was examined using head and hand movement, as well as eye tracking. As the main result, the scene context had a significant effect on the search and transport phases, but not on the reach phase of the task. The present work provides insights into the development of potential supporting intention predicting systems, revealing the dynamics of the pick-and-place task behavior once it is realized in a realistic context-rich scenario. (shrink)