Social semiotics is now widely regarded as one of the leading research areas. This study is the first attempt to present a holistic overview of social semiotics based on the data in the Web of Science core collection database from 2001 to 2020. The study investigates, among other issues, social semiotics’ publishing tendency, the most productive authors, countries, institutions, and hotspots. The results exhibit a steady rise in its publications and citations. The current analysis verifies the growing quantitative and qualitative (...) research contributions and influences of this field. Furthermore, what the journals focus on are the innovative and contemporary themes, manifested predominantly in sign, multimodality, gender, experimental semiotics, advertising, culture, and social media, which involve a wide range of methodologies to make the research more acceptable and constructive. These results are expected to offer refreshing insights that inspire scholars in formulating scientific agendas and advising their research strategies, thereby facilitating substantial contributions to the domain. (shrink)

Capacities for abstract thinking and problem‐solving are central to human cognition. Processes of abstraction allow the transfer of experiences and knowledge between contexts helping us make informed decisions in new or changing contexts. While we are often inclined to relate such reasoning capacities to individual minds and brains, they may in fact be contingent on human‐specific modes of collaboration, dialogue, and shared attention. In an experimental study, we test the hypothesis that social interaction enhances cognitive processes of rule‐induction, which in (...) turn improves problem‐solving performance. Through three sessions of increasing complexity, individuals and groups were presented with a problem‐solving task requiring them to categorize a set of visual stimuli. To assess the character of participants’ problem representations, after each training session, they were presented with a transfer task involving stimuli that differed in appearance, but shared relations among features with the training set. Besides, we compared participants’ categorization behaviors to simulated agents relying on exemplar learning. We found that groups performed superior to individuals and agents in the training sessions and were more likely to correctly generalize their observations in the transfer phase, especially in the high complexity session, suggesting that groups more effectively induced underlying categorization rules from the stimuli than individuals and agents. Crucially, variation in performance among groups was predicted by semantic diversity in members’ dialogical contributions, suggesting a link between social interaction, cognitive diversity, and abstraction. (shrink)

How is linguistic communication possible? How do we come to share the same meanings of words and utterances? One classical position holds that human beings share a transcendental “platonic” ideality independent of individual cognition and language use (Frege 1948). Another stresses immanent linguistic relations (Saussure 1959), and yet another basic embodied structures as the ground for invariant aspects of meaning (Lakoff and Johnson 1999). Here we propose an alternative account in which the possibility for sharing meaning is motivated by four (...) sources of structural stability: 1) the physical constraints and affordances of our surrounding material environment, 2) biological constraints of our human bodies, 3) social normative constraints of culture and society, and 4) the local history of social interactions. These structures and constraints interact in dynamical ways in actual language usage situations: local dialogical and social dynamics motivate and stabilize the profiling of a conceptual space already highly structured by our shared biology, culture, and environment. We will substantiate this perspective with reference to recent studies in experimental pragmatics and semiotics in which participants interact linguistically to solve cooperative tasks. Three main cases will be considered: The dynamic grounding of linguistic categories, the construction of conceptual models to relate entities in a scene, and the construction of shared conceptual scales for assessing and appraising subjective experiences. (shrink)

Research on linguistic interaction suggests that two or more individuals can sometimes form adaptive and cohesive systems. We describe an “alignment system” as a loosely interconnected set of cognitive processes that facilitate social interactions. As a dynamic, multi-component system, it is responsive to higher-level cognitive states such as shared beliefs and intentions (those involving collective intentionality) but can also give rise to such shared cognitive states via bottom-up processes. As an example of putative group cognition we turn to transactive memory (...) and suggest how further research on alignment in these cases might reveal how such systems can be genuinely described as cognitive. Finally, we address a prominent critique of collective cognitive systems, arguing that there is much empirical and explanatory benefit to be gained from considering the possibility of group cognitive systems, especially in the context of small-group human interaction. (shrink)

In the absence of pre‐established communicative conventions, people create novel communication systems to successfully coordinate their actions toward a joint goal. In this study, we address two types of such novel communication systems: sensorimotor communication, where the kinematics of instrumental actions are systematically modulated, versus symbolic communication. We ask which of the two systems co‐actors preferentially create when aiming to communicate about hidden object properties such as weight. The results of three experiments consistently show that actors who knew the weight (...) of an object transmitted this weight information to their uninformed co‐actors by systematically modulating their instrumental actions, grasping objects of particular weights at particular heights. This preference for sensorimotor communication was reduced in a fourth experiment where co‐actors could communicate with weight‐related symbols. Our findings demonstrate that the use of sensorimotor communication extends beyond the communication of spatial locations to non‐spatial, hidden object properties. (shrink)

The causes of human behavior cannot be simple. Every move we make has a nested hierarchy of causes that affect its direction, timing and form. The billiard-ball type of causality that is usually assumed to explain human action cannot give sufficient justice to this complexity. In this paper, I point to those perspectives that respect the complexity of cognitive systems and recognize that cognition involves changes on many nested time scales and in many nested systems. A brief overview of methods (...) that are suitable for dealing with such interaction-dominant complex systems is presented and used as a background for describing a specific research program with the aim of clarifying the role of language as one of the nested factors shaping cognition. I illustrate this endeavor with two studies: one concerning the development of language as interaction control and another detailing how language may shape cognitive processes on several timescales. Reconciliation with complexity leads us to ask slightly different questions and expect different answers than when using simplified componential models of cognition and helps demarcate the limits of predictability. (shrink)

In recent years, a number of approaches to social cognition research have emerged that highlight the importance of embodied interaction for social cognition (Reddy, How infants know minds, 2008; Gallagher, J Conscious Stud 8:83–108, 2001; Fuchs and Jaegher, Phenom Cogn Sci 8:465–486, 2009; Hutto, in Seemans (ed.) Joint attention: new developments in psychology, philosophy of mind and social neuroscience, 2012). Proponents of such ‘interactionist’ approaches emphasize the importance of embodied responses that are engaged in online social interaction, and which, according (...) to interactionists, present an alternative to mindreading as a source of social understanding. We agree that it is important to take embodied interaction seriously, but do not agree that this presents a fundamental challenge to mainstream mindreading approaches. Drawing upon an analogy between embodied interaction and the exercise of expert skills, we advocate a hierarchical view which claims that embodied social responses generally operate in close conjunction with higher-level cognitive processes that play a coordinative role, and which are often sensitive to mental states. Thus, investigation of embodied responses should inform rather than conflict with research on mindreading. (shrink)

In a great variety of cultures oaths, ordeals, or lie detectors are used to adjudicate in trials, even though they do not reliably discern liars from truth tellers. I suggest that these practices owe their cultural success to the triggering of cognitive mechanisms that make them more culturally attractive. Informal oaths would trigger mechanisms related to commitment in communication. Oaths used in judicial contexts, by invoking supernatural punishments, would trigger intuitions of immanent justice, linking misfortunes following an oath with perjury. (...) These intuitions would justify the infliction of costs on oath takers in a way that appears morally justified. Ordeals reflect the same logic. Intuitions about immanent justice link a worse outcome following the ordeal with a guilty verdict. This link justifies the application of the ordeal, and the fixed costs involved. Lie detectors also rely on the creation of a link between a specified outcome and a guilty verdict. However, they do not rely on intuitions about immanent justice, but on a variety of intuitions ranging from the plausibly universal to the culturally idiosyncratic. As a result, lie detectors involve lower fixed costs than ordeals, and are less cross-culturally successful than oaths or ordeals. (shrink)

Much work on intellectual humility has focused on its epistemic benefits. We suggest that displaying (or failing to display) intellectual humility also has effects on how others perceive us and that, as a result, intellectual humility can serve reputation management purposes, in at least four ways: (i) Intellectual humility can be used to signal we are a good source of information; (ii) Intellectual humility can be used to signal we are competent through countersignaling; (iii) Intellectual humility can be used to (...) make sure others do not believe we are overclaiming superiority; (iv) lack of intellectual humility (or intellectual arrogance) can be used to signal dominance. The evidence suggests that intellectual humility (or lack thereof) can have each of these effects. Seeing intellectual humility as (inter alia) a reputation management tool predicts that people will be more or less likely to display intellectual humility in some contexts. For instance, people in a position of power might stand to lose less if they fail to be intellectual humble; accordingly, evidence suggests that they tend to display less intellectual humility. In conclusion, we speculate that understanding intellectual humility as reputation management could help construct environments more conducive to displays of intellectual humility. (shrink)

A problem for natural scientific accounts, psychology in particular, is the existence of value. An ecological account of values is reviewed and illustrated in three domains of research: carrying differing loads; negotiating social dilemmas involving agreement and disagreement; and timing the exposure of various visual presentations. Then it is applied in greater depth to the nature of language. As described and illustrated, values are ontological relationships that are neither subjective nor objective, but which constrain and obligate all significant animate activity (...) physically, socially, and morally. As an embodied social activity, conversational dialogue is characterized in terms of values, pragmatics, and presence rather than in terms of syntactic and semantic rules. In particular the nature of dialogical arrays is explored, and the hypothesis that language is an action system, a perceptual system, and a caring system is explored. Language expands horizons and makes it possible for humans to realize their calling as culture makers and caretakers. (shrink)

The aim of our study is to show the ways in which family members coordinate their minds, bodies and language in a functional and goal-oriented manner when they are jointly remembering shared events that they had experienced together as a group. So far, little attention has been paid to the influence that the interplay of multiple behavioral channels have in collaborative remembering in small groups. Our goal is to specifically examine the central role that direct questions have when they act (...) as embodied reminders through the interanimation of multiple behavioral channels in family interactions. The video data for analysis comes from an ongoing project on how collaborative remembering takes places among small groups of Argentinean Spanish speakers as each group recalls a vacation taken together several years ago. (shrink)

According to the prevailing paradigm in social-cognitive neuroscience, the mental states of individuals become shared when they adapt to each other in the pursuit of a shared goal. We challenge this view by proposing an alternative approach to the cognitive foundations of social interactions. The central claim of this paper is that social cognition concerns the graded and dynamic process of alignment of individual minds, even in the absence of a shared goal. When individuals reciprocally exchange information about each other's (...) minds processes of alignment unfold over time and across space, creating a social interaction. Not all cases of joint action involve such reciprocal exchange of information. To understand the nature of social interactions, then, we propose that attention should be focused on the manner in which people align words and thoughts, bodily postures and movements, in order to take one another into account and to make full use of socially relevant information. (shrink)

This study investigates interpersonal processes underlying dialog by comparing two approaches, interactive alignment and interpersonal synergy, and assesses how they predict collective performance in a joint task. While the interactive alignment approach highlights imitative patterns between interlocutors, the synergy approach points to structural organization at the level of the interaction—such as complementary patterns straddling speech turns and interlocutors. We develop a general, quantitative method to assess lexical, prosodic, and speech/pause patterns related to the two approaches and their impact on collective (...) performance in a corpus of task-oriented conversations. The results show statistical presence of patterns relevant for both approaches. However, synergetic aspects of dialog provide the best statistical predictors of collective performance and adding aspects of the alignment approach does not improve the model. This suggests that structural organization at the level of the interaction plays a crucial role in task-oriented conversations, possibly constraining and integrating processes related to alignment. (shrink)

Focusing on political and interpersonal conflict in the U.S., particularly racial conflict, but with an eye to similar conflicts throughout the world, we argue that the enactive approach to mind as life can be elaborated to provide an exigent framework for present social-political problems. An enactive approach fills problematic lacunae in the Western philosophical ethics project by offering radically refigured notions of responsibility and language. The dual enactive, participatory insight is that interactional responsibility is not singular and language is not (...) an individual property or ability, something that someone simply and uniformly 'has' or 'controls'. These points have not been integrated into our self-understanding as moral actors, to everyone’s detriment. We first advocate for adequate appreciation of Colombetti and Torrance’s 2009 suggestion that participatory sense-making necessarily implies shared responsibility for interactional outcomes. We argue that the enactive approach presents open-ended cultivation of virtue as embodied, contextualized, and dynamic know-how and destabilizes an individualist metaphysics. Putting this framework to work, we turn to the interactional challenges of conversations that concern differences and that involve potentially oppositional parties, offering a reading of Claudia Rankine’s Just Us. Finally, we make explicit Rankine’s normative project of mindful navigation of multiple perspectives in an interaction. We abstract three interrelated spheres of participatory intervention: location, language, and labor. These also indicate routes for empirical investigation into complex perspective-taking in dynamic interactions. (shrink)

Human cognition and behavior are dominated by symbol use. This paper examines the social learning strategies that give rise to symbolic communication. Experiment 1 contrasts an individual-level account, based on observational learning and cognitive bias, with an inter-individual account, based on social coordinative learning. Participants played a referential communication game in which they tried to communicate a range of recurring meanings to a partner by drawing, but without using their conventional language. Individual-level learning, via observation and cognitive bias, was sufficient (...) to produce signs that became increasingly effective, efficient, and shared over games. However, breaking a referential precedent eliminated these benefits. The most effective, most efficient, and most shared signs arose when participants could directly interact with their partner, indicating that social coordinative learning is important to the creation of shared symbols. Experiment 2 investigated the contribution of two distinct aspects of social interaction: behavior alignment and concurrent partner feedback. Each played a complementary role in the creation of shared symbols: Behavior alignment primarily drove communication effectiveness, and partner feedback primarily drove the efficiency of the evolved signs. In conclusion, inter-individual social coordinative learning is important to the evolution of effective, efficient, and shared symbols. (shrink)

Cocreating meaning in collaboration is challenging. Success is often determined by people's abilities to coordinate their language to converge upon shared mental representations. Here we explore one set of low‐level linguistic behaviors, linguistic alignment, that both emerges from, and facilitates, outcomes of high‐level convergence. Linguistic alignment captures the ways people reuse, that is, “align to,” the lexical, syntactic, and semantic forms of others' utterances. Our focus is on the temporal change of multi‐level linguistic alignment, as well as how alignment is (...) related to communicative outcomes within a unique collaborative problem‐solving paradigm. The primary task, situated within a virtual educational video game, requires creative thinking between three people where the paths for possible solutions are highly variable. We find that over time interactions are marked by decreasing lexical and syntactic alignment, with a trade‐off of increasing semantic alignment. However, greater semantic alignment does not translate into better team performance. Overall, these findings provide greater clarity on the role of linguistic coordination within complex and dynamic collaborative problem‐solving tasks. (shrink)

Coordination is a widely employed term across recent quantitative and qualitative approaches to intersubjectivity, particularly approaches that give embodiment and enaction central explanatory roles. With a focus on linguistic and bodily coordination in conversational contexts, I review the operational meaning of coordination in recent empirical research and related theorizing of embodied intersubjectivity. This discussion articulates what must be involved in treating linguistic meaning as dynamic processes of coordination. The coordination approach presents languaging as a set of dynamic self-organizing processes and (...) actions on multiple timescales and across multiple modalities that come about and work in certain domains (those jointly constructed in social, interactive, high-order sense-making). These processes go beyond meaning at the level that is available to first-person experience. I take one crucial consequence of this to be the ubiquitously moral nature of languaging with others. Languaging coordinates experience, among other levels of behavior and event. Ethical effort is called for by the automatic autonomy-influencing forces of languaging as coordination. (shrink)

When people communicate, they coordinate a wide range of linguistic and non-linguistic behaviors. This process of coordination is called alignment, and it is assumed to be fundamental to successful communication. In this paper, we question this assumption and investigate whether disalignment is a more successful strategy in some cases. More specifically, we hypothesize that alignment correlates with task success only when communication is interactive. We present results from a spot-the-difference task in which dyads of interlocutors have to decide whether they (...) are viewing the same scene or not. Interactivity was manipulated in three conditions by increasing the amount of information shared between interlocutors. We use recurrence quantification analysis to measure the alignment between the scan-patterns of the interlocutors. We found that interlocutors who could not exchange feedback aligned their gaze more, and that increased gaze alignment correlated with decreased task success in this case. When feedback was possible, in contrast, interlocutors utilized it to better organize their joint search strategy by diversifying visual attention. This is evidenced by reduced overall alignment in the minimal feedback and full dialogue conditions. However, only the dyads engaged in a full dialogue increased their gaze alignment over time to achieve successful performances. These results suggest that alignment per se does not imply communicative success, as most models of dialogue assume. Rather, the effect of alignment depends on the type of alignment, on the goals of the task, and on the presence of feedback. (shrink)

Coordination between speakers in dialogue requires balancing repetition and change, the old and the new. Interlocutors tend to reuse established forms, relying on communicative precedents. Yet linguistic interaction also necessitates adaptation to changing contexts or dynamic tasks, which might favor abandoning existing precedents in favor of better communicative alternatives. We explored this tension using a maze game task in which individual participants and interacting pairs had to describe figures and their positions in one of two possible maze types: a regular (...) maze, in which the grid‐like structure of the maze is highlighted, and an irregular maze, in which specific parts of the maze are salient. Participants repeated this task several times. Both individuals and interacting pairs were affected by the different maze layouts, initially using more idiosyncratic description schemes for irregular mazes and more systematic schemes for regular mazes. Interacting pairs, but not individuals, abandoned their unsystematic initial descriptions in favor of a more systematic approach, which was better adapted for repeated interaction. Our results show communicative conventions are initially shaped by context, but interaction opens up the possibility for change if better alternatives are available. (shrink)

Communication involves a great deal of uncertainty. Prima facie, it is therefore surprising that biological communication systems—from cellular to human—exhibit a high degree of ambiguity and often leave its resolution to contextual cues. This puzzle deepens once we consider that contextual information may diverge between individuals. In the following we lay out a model of ambiguous communication in iterated interactions between subjectively rational agents lacking a common contextual prior. We argue ambiguity’s justification to lie in endowing interlocutors with means to (...) flexibly adapt language use to each other and the context of their interaction to serve their communicative preferences. Linguistic alignment is shown to play an important role in this process; it foments convergence of contextual expectations and thereby leads to agreeing use and interpretation of ambiguous messages. We conclude that ambiguity is ecologically rational when interlocutors’ contextual expectations are generally in line or they interact multiple times in an informative context, enabling for the alignment of their expectations. In light of these results meaning multiplicity can be understood as an opportunistic outcome enabled and shaped by linguistic adaptation and contextual information. (shrink)

Communication involves a great deal of uncertainty. Prima facie, it is therefore surprising that biological communication systems—from cellular to human—exhibit a high degree of ambiguity and often leave its resolution to contextual cues. This puzzle deepens once we consider that contextual information may diverge between individuals. In the following we lay out a model of ambiguous communication in iterated interactions between subjectively rational agents lacking a common contextual prior. We argue ambiguity’s justification to lie in endowing interlocutors with means to (...) flexibly adapt language use to each other and the context of their interaction to serve their communicative preferences. Linguistic alignment is shown to play an important role in this process; it foments convergence of contextual expectations and thereby leads to agreeing use and interpretation of ambiguous messages. We conclude that ambiguity is ecologically rational when interlocutors’ contextual expectations are generally in line or they interact multiple times in an informative context, enabling for the alignment of their expectations. In light of these results meaning multiplicity can be understood as an opportunistic outcome enabled and shaped by linguistic adaptation and contextual information. 1Meaning Multiplicity in Communication 2Ambiguous Signalling through Pragmatic Inference 2.1Preliminaries 2.2Signalling behaviour 2.3Communicative success 2.4Iterated interactions 3Predictions for Single and Iterated Interactions 3.1Simulations 3.2Exploration and past experience 3.3Preemptive adaptation 4Discussion 5Conclusion Appendix. (shrink)

In a range of contexts, individuals arrive at collective decisions by sharing confidence in their judgements. This tendency to evaluate the reliability of information by the confidence with which it is expressed has been termed the ‘confidence heuristic’. We tested two ways of implementing the confidence heuristic in the context of a collective perceptual decision-making task: either directly, by opting for the judgement made with higher confidence, or indirectly, by opting for the faster judgement, exploiting an inverse correlation between confidence (...) and reaction time. We found that the success of these heuristics depends on how similar individuals are in terms of the reliability of their judgements and, more importantly, that for dissimilar individuals such heuristics are dramatically inferior to interaction. Interaction allows individuals to alleviate, but not fully resolve, differences in the reliability of their judgements. We discuss the implications of these findings for models of confidence and collective decision-making. (shrink)

Recent studies of naturalistic face‐to‐face communication have demonstrated coordination patterns such as the temporal matching of verbal and non‐verbal behavior, which provides evidence for the proposal that verbal and non‐verbal communicative control derives from one system. In this study, we argue that the observed relationship between verbal and non‐verbal behaviors depends on the level of analysis. In a reanalysis of a corpus of naturalistic multimodal communication (Louwerse, Dale, Bard, & Jeuniaux, ), we focus on measuring the temporal patterns of specific (...) communicative behaviors in terms of their burstiness. We examined burstiness estimates across different roles of the speaker and different communicative modalities. We observed more burstiness for verbal versus non‐verbal channels, and for more versus less informative language subchannels. Using this new method for analyzing temporal patterns in communicative behaviors, we show that there is a complex relationship between verbal and non‐verbal channels. We propose a “temporal heterogeneity” hypothesis to explain how the language system adapts to the demands of dialog. (shrink)

How can we explain the intentional nature of an expert’s actions, performed without immediate and conscious control, relying instead on automatic cognitive processes? How can we account for the differences and similarities with a novice’s performance of the same actions? Can a naturalist explanation of intentional expert action be in line with a philosophical concept of intentional action? Answering these and related questions in a positive sense, this dissertation develops a three-step argument. Part I considers different methods of explanations in (...) cognitive neuroscience (Bennett & Hacker’s philosophical, conceptual analysis; Marr’s three levels of explanation; Neural Correlates of Consciousness research; mechanistic explanation), defending ‘mechanistic explanation’ as a method that provides the necessary tools for integrating interdisciplinary insights into human action. Furthermore, a dynamic, explanatory mechanism allows the assessment of the impact of learning and development on expert action in a valuable way that other methods don’t. Part II continues by scrutinizing several cognitive neuroscientific theories of learning and development (neuroconstructivism; dual-processing theories; simulation theory; extended mind/cognition hypothesis), arguing for the complex interactions between different types of processing and different action representations involved in expert action performances. Moreover, according to our discussion of a particular ‘simulation theory’ these interactions can be influenced in several ways with the use of language, allowing an agent to configure a specific action representation for performance at a later stage. The results of Parts I and II are then applied in Part III to a parallel discussion of philosophical analyses of intentional action (discussing i.a. Frankfurt, Bratman, Pacherie and Ricoeur) and cognitive neuroscientific insights in it. Both approaches are found to converge in emphasizing the importance for an expert to develop stable patterns of actions that comply maximally not only with his intentions, but also with his motor expertise and with situational conditions. Consequently, his actions – automatic, or not – rely on this ‘sculpted space of actions’. (shrink)