Understanding the very nature of the smile with an integrative approach and a novel model is a fertile ground for a new theoretical vision and insights. However, from this perspective, I challenge the authors to integrate culture and race in their model, because both factors would impact upon the embodying and decoding of facial expressions.

According to the SIMS model, mimicry and simulation contribute to perceivers' understanding of smiles. We argue that similar mechanisms are involved in comprehending the hand gestures that people produce when speaking. Viewing gestures may elicit overt mimicry, or may evoke corresponding simulations in the minds of addressees. These real or simulated actions contribute to addressees' comprehension of speakers' gestures.

This study investigates whether there is a relation between the semantics of linguistic expressions that indicate temporal distance and the spatial properties of their co-speech gestures. To this date, research on time gestures has focused on features such as gesture axis, direction, and shape. Here we focus on a gesture property that has been overlooked so far: the distance of the gesture in relation to the body. To achieve this, we investigate two types of temporal linguistic expressions are addressed: proximal (...) (e.g., near future, near past) and distal (e.g., distant past, distant future). Data was obtained through the NewsScape library, a multimodal corpus of television news. A total of 121 co-speech gestures were collected and divided into the two categories. The gestures were later annotated in terms of gesture space and classified in three categories: (i) center, (ii) periphery, and (iii) extreme periphery. Our results suggest that gesture and language are coherent in the expression of temporal distance: when speakers locate an event far from them, they tend to gesture further from their body; similarly, when locating an event close to them, they gesture closer to their body. These results thus reveal how co-speech gestures also reflect a space-time mapping in the dimension of distance. (shrink)

This article explores interpersonal functions of emotional mimicry under the absence versus the presence of visual contact between the interacting partners. We review relevant literature and stress that previous studies on the role of emotional mimicry were focused on imitative responses to facial displays. We also show that the rules explaining why people mimic facial expressions may be inapplicable when visual signals are unavailable (e.g., people attending an online meeting have their cameras off). Overall, our review suggests that emotional mimicry (...) functionally adapts to whether the perceiver and the expresser can see each other. We, therefore, argue that blocking visual contact between them may provide insight into emotional mimicry's social functions, thereby clarifying its role in fostering affiliation and emotional understanding. (shrink)

Niedenthal et al's classification of smiles erroneously conflates psychological mechanisms and adaptive functions. This confusion weakens the rationale behind the types of smiles they chose to individuate, and it obfuscates the distinction between the communicative versus denotative nature of smiles and the role of perceived-gaze direction in emotion recognition.

For some customers, the corona pandemic has turned e-shopping into a fine alternative to shopping in brick-and-mortar shops. For other customers in quarantine e-shopping is the only alternative. The long-lasting pandemic, however, has reminded us of the importance of social contacts and interactions – even if it’s just to go the supermarket to ‘mingle’. This paper investigates what ‘mingle’ means when shopping in physical self-service shops amongst unacquainted others in Denmark. It describes customers’ practice of doing self-service by organizing interaction (...) to minimize social involvement. It shows how they, as a matter of fact, co-ordinate their conduct in ways that hampers possibilities for engaging in even small ‘ritual’ exchanges of talk. The paper draws upon a corpus of video recordings of customers’ self-service practices in shops in Denmark. In addition, the customers’ gaze was recorded with the mobile Tobii Pro X3 eye tracker. The study falls within the realm of ethnomethodological and conversation analytic studies of multimodal interaction. It concludes that self-service is achieved through co-present customers’ tacit coordination of multimodal actions in social interaction and that their practices work to achieve ‘effortlessly’ and ‘spontaneously’ being, getting, and staying out of the way, which seems to be an ideal for self-service shopping. Talk and moreover having a conversation seems to be an impediment to it. (shrink)

Visual information conveyed by iconic hand gestures and visible speech can enhance speech comprehension under adverse listening conditions for both native and non‐native listeners. However, how a listener allocates visual attention to these articulators during speech comprehension is unknown. We used eye‐tracking to investigate whether and how native and highly proficient non‐native listeners of Dutch allocated overt eye gaze to visible speech and gestures during clear and degraded speech comprehension. Participants watched video clips of an actress uttering a clear or (...) degraded (6‐band noise‐vocoded) action verb while performing a gesture or not, and were asked to indicate the word they heard in a cued‐recall task. Gestural enhancement was the largest (i.e., a relative reduction in reaction time cost) when speech was degraded for all listeners, but it was stronger for native listeners. Both native and non‐native listeners mostly gazed at the face during comprehension, but non‐native listeners gazed more often at gestures than native listeners. However, only native but not non‐native listeners' gaze allocation to gestures predicted gestural benefit during degraded speech comprehension. We conclude that non‐native listeners might gaze at gesture more as it might be more challenging for non‐native listeners to resolve the degraded auditory cues and couple those cues to phonological information that is conveyed by visible speech. This diminished phonological knowledge might hinder the use of semantic information that is conveyed by gestures for non‐native compared to native listeners. Our results demonstrate that the degree of language experience impacts overt visual attention to visual articulators, resulting in different visual benefits for native versus non‐native listeners. (shrink)