Experiencing a stimulus in one sensory modality is often associated with an experience in another sensory modality. For instance, seeing a lemon might produce a sensation of sourness. This might indicate some kind of cross-modal correspondence between vision and gustation. The aim of the current study was to provide explore whether such cross-modal correspondences influence cross-modal integration during perceptual learning. To that end, we conducted 2 experiments. Using a speeded classification task, Experiment 1 established a cross-modal correspondence between visual lightness (...) and the frequency of an auditory tone. Using a short-term priming procedure, Experiment 2 showed that manipulation of such cross-modal correspondences led to the creation of a crossmodal unit regardless of the nature of the correspondence (i.e., congruent, Experiment 2a or incongruent, Experiment 2b). However, a comparison of priming-effects sizes suggested that cross-modal correspondences modulate cross-modal integration during learning and thus leading to new learned units that have different stability over time. We discuss the implications of our results for the relation between cross-modal correspondence and perceptual learning in the context of a Bayesian explanation of cross-modal correspondences. (shrink)

The main goal of this paper is to present and compare two approaches to formalizing cross-world comparisons like John might have been taller than he is in quantified modal logics. One is the standard method employing degrees and graded positives, according to which the example just given is to be paraphrased as something like The height that John has is such that he might have had a height greater than it, which is amenable to familiar formalization strategies with respect to (...) quantified modal logic. The other approach, based on subjunctive modal logic, mimics the mixed indicative-subjunctive patterns typical of cross-world comparisons in many natural languages by means of explicit mood markers. This latter approach is new and should, for various reasons, appeal to linguists and philosophers. Along the way, I argue that attempts to capture cross-world comparison by means of sentential operators are either inadequate or subject to substantive logical and philosophical objections. (shrink)

For humans, the ability to communicate and use language is instantiated not only in the vocal modality but also in the visual modality. The main examples of this are sign languages and gestures. Sign languages, the natural languages of Deaf communities, use systematic and conventionalized movements of the hands, face, and body for linguistic expression. Co-speech gestures, though non-linguistic, are produced in tight semantic and temporal integration with speech and constitute an integral part of language together with speech. The articles (...) in this issue explore and document how gestures and sign languages are similar or different and how communicative expression in the visual modality can change from being gestural to grammatical in nature through processes of conventionalization. As such, this issue contributes to our understanding of how the visual modality shapes language and the emergence of linguistic structure in newly developing systems. Studying the relationship between signs and gestures provides a new window onto the human ability to recruit multiple levels of representation in the service of using or creating conventionalized communicative systems. (shrink)

Cross-linguistic comparisons serve as empirical tests generating evidence for and against lexical ambiguity in words like “good”, “know”, “the”, “can”, and “may”. Critics question such comparisons' validity. This article examines how cross-linguistic comparisons are treated as tests and shows that they have two predominant forms: one modeled on modus tollens, and another on Bayes' theorem, where the former is an enthymematic version of the latter. This analysis reveals the strengths and weaknesses of cross-linguistic comparisons, and thereby guides interpretation of their (...) results. It concludes that cross-linguistic comparisons generally yield stronger evidence against lexical ambiguity than for it. (shrink)

Multi-modal metaphor is a new perspective in metaphor research developed in modern times. Beyond the metaphor research of language, it combines text, image, sound, and other modes and provides new insights and perspectives for metaphor research. Food advertisements often combine sound, images, and other forms to promote the products and increase consumers’ desire to buy, and they often contain metaphors of multiple modes. However, under the perspective of cross-cultural research, when the same food brand is advertised in different countries, the (...) multi-modal metaphors are varied to appeal to different audiences. This article compares food advertisements in China and in the U.S. from the perspective of multi-modal metaphors, and analyzes the varied applications arising from different cultural influences. The research may act as a reference for advertising strategies on cross-cultural occasions. (shrink)

People increasingly access news through ‘new’, algorithmic intermediaries such as search engines or aggregators rather than the ‘old’ (i. e., traditional), journalistic intermediaries. As algorithmic intermediaries do not adhere to journalistic standards, their trustworthiness comes into question. With this study, we (1) summarize the differences between journalistic and algorithmic intermediaries as found in previous literature; (2) conduct a cross-media comparison of information credibility and intermediary trustworthiness; and (3) examine how key predictors (such as modality, reputation, source attribution, and prior (...) experience) affect the trustworthiness and credibility assessments. Results from a quasi-experimental online survey (n = 485) confirm that recipients assess journalistic intermediaries more positively than algorithmic intermediaries and audio more positively than text intermediaries. Furthermore, we found reputation and information credibility to be the most important predictors of intermediary trustworthiness, while general media trust is the most important predictor of information credibility. Implications and directions for future research are discussed. (shrink)

In a variety of synaesthesia, photisms result from affect-laden stimuli as emotional words, or faces of familiar people. For R, who participated in this study, the sight of a familiar person triggers a mental image of "a human silhouette filled with colour". Subjective descriptions of synaesthetic experiences induced by the visual perception of people's figures and faces show similarities with the reports of those who claim to possess the ability to see the aura. It has been proposed that the purported (...) auric perception may be easily explained by the presence of a specific subtype of cross-modal perception. We analyse the subjective reports of four synaesthetes who experience colours in response to human faces and figures. These reports are compared with descriptions of alleged auric phenomena found in the literature and with claims made by experts in esoteric spheres. The discrepancies found suggest that both phenomena are phenomenologically and behaviourally dissimilar. (shrink)

In this paper we study selected argument forms involving counterfactuals and indicative conditionals under uncertainty. We selected argument forms to explore whether people with an Eastern cultural background reason differently about conditionals compared to Westerners, because of the differences in the location of negations. In a 2x2 between-participants design, 63 Japanese university students were allocated to four groups, crossing indicative conditionals and counterfactuals, and each presented in two random task orders. The data show close agreement between the responses of Easterners (...) and Westerners. The modal responses provide strong support for the hypothesis that conditional probability is the best predictor for counterfactuals and indicative conditionals. Finally, the grand majority of the responses are probabilistically coherent, which endorses the psychological plausibility of choosing coherence-based probability logic as a rationality framework for psychological reasoning research. (shrink)

The recent ‘material turn’ focuses on materiality in two distinctive ways: one, by including nonhuman agencies, another, by mining indigenous knowledges for alternative conceptions of agency and human–thing relations. A troubling gap persists between the two endeavours. The gap insinuates an us–them dichotomy and, more importantly, curtails communication between radically different visions of thingly agency – thereby impeding the political drive of these conceptual enterprises. This article is an essay in cross-cultural transposition. Through a close reading of a story of (...) a useless tree in an ancient proto-Daoist text, Zhuangzi, the author shows how its fabulist and oneiric form illuminates a distinctive perspective on uselessness. Conversely, the trope of uselessness lets us begin from what she calls a ‘situated affectivity’ amidst more-than-human materialities. The article concludes with a brief comparison of three modalities of uselessness from different ‘cosmologies’ of thought – a foretaste of the potentials of cross-cosmological endeavours. (shrink)

IntroductionThe pelvic floor muscles are active during motor tasks that increase intra-abdominal pressure, but little is known about how the PFM respond to dynamic activities, such as gait. The purpose of this study was to characterize and compare PFM activity during walking and jogging in continent adults across the entire gait cycle.Methods17 able-bodied individuals with no history of incontinence participated in this study. We recorded electromyography from the abdominal muscles, gluteus maximus, and PFM while participants performed attempted maximum voluntary contractions (...) of all muscles and completed 60–70 strides in four gait conditions: slow walk ; regular walk ; transition walk ; jog. We quantified activity throughout the whole gait cycle and during periods of bursting for each participant, and analyzed the timing of PFM bursting periods to explore when the PFM were most active in the gait cycle. We also conducted a phase metric analysis on the PFM and GM burst timings. We performed a Spearman's rank-order correlation to examine the effect of speed on %aMVCGC, %aMVCBR, and phase metric score, and used the Wilcoxon Signed-Rank test to evaluate the effect of gait modality, matched for speed, on these variables.ResultsThe PFM were active throughout the gait cycle, with bursts typically occurring during single-leg support. The PFM and GM were in phase for 44–69% of the gait cycle, depending on condition. There was a positive correlation between gait speed and both %aMVCGC and %aMVCBR. Phase metric scores were significantly higher during jogging than transition walking, but there was no difference between gait modality on %aMVCGC or %aMVCBR. Where possible we disaggregated data by sex, although were unable to make statistical comparisons due to low sample sizes.ConclusionThe PFM are active during walking and jogging, with greater activity at faster speeds and with bursts in activity around single-leg support. The PFM and GM co-activate during gait, but are not completely in phase with each other. (shrink)

This paper provides a categorization of cross-modal experiences. There are myriad forms. Doing so allows us to think clearly about the nature of different cross-modal experiences and allows us to clearly formulate competing hypotheses about the kind of experiences involved in different cross-modal phenomena.

In spoken interactions, interlocutors carefully plan and time their utterances, minimising gaps and overlaps between consecutive turns. Cross-linguistic comparison has indicated that spoken languages vary only minimally in terms of turn-timing, and language acquisition research has shown pre-linguistic vocal turn-taking in the first half year of life. These observations suggest that the turn-taking system may provide a fundamental basis for our linguistic capacities. The question remains however to what extent our capacity for rapid turn-taking is determined by modality constraints. (...) The avoidance of overlapping turns could be motivated by the difficulty of hearing and speaking at the same time. If so, turn-taking in sign might show greater toleration for overlap. Alternatively, signed conversations may show a similar distribution of turn-timing as spoken languages, thus avoiding both gaps and overlaps. To address this question we look at turn-timing in question-answer sequences in spontaneous conversations of Sign Language of the Netherlands. The findings indicate that although there is considerable overlap in two or more signers' articulators in conversation, when proper allowance is made for onset preparation, post-utterance retraction and the intentional holding of signs for response, turn-taking latencies in sign look remarkably like those reported for spoken language. This is consistent with the possibility that, at least with regard to responses to questions, speakers and signers follow similar time courses in planning and producing their utterances in on-going conversation. This suggests that turn-taking systems may well be a shared cognitive infrastructure underlying all modern human languages, both spoken and signed. (shrink)

The thesis of this paper is that the capacity to think of one’s perceptions as cross-modally integrated is incompatible with a reductionist account of the self. In §2 I distinguish three versions of the argument from cross-modality. According to the ‘unification’ version of the argument, what needs to be explained is one’s capacity to identify an object touched as the same as an object simultaneously seen. According to the ‘recognition’ version, what needs to be explained is one’s capacity, having once (...) seen an object, to reidentify that same object by touch alone. According to the ‘objectivity’ version, what needs to be explained is one’s capacity to think of one’s perceptions in different modalities as perceptions of one and the same object. The third version seems to establish that one must conceive of oneself substantially, as the numerically identical owner of one’s experiences, a conclusion in agreement with recent work in developmental psychology claiming to show that an infant’s cross-modal capacities are essentially implicated in their development of a sense of self. There is further work to be done if this is to be tumed into an argument against reductionism: there is no swift route from the epistemology of self-consciousness to the metaphysics of the self. In the §3, I will claim that there is, nevertheless, an argument linking the two. What I propose is an argument derived, not from the token-reflexive rule for the first-person, but resting on its anaphoric behaviour spanning intensional operators. (shrink)

Cross-modal perceptual illusions occur when a stimulus to one modality impacts perceptual experience associated with another modality. Unlike synaesthesia, cross-modal illusions are intelligible as results of perceptual strategies for dealing with sensory stimulation to multiple modalities, rather than as mere quirks. I argue that understanding cross-modal illusions reveals an important flaw in a widespread conception of the senses, and of their role in perceptual experience, according to which understanding perception and perceptual experience is a matter of assembling independently viable stories (...) about vision, audition, olfaction, and the rest. (shrink)

In the present study, cross-modal (i.e., across sensory modalities such as smell and sound) iconicity (i.e., resemblance) and indexicality (i.e., contiguity) in lexical sensory and emotional signs in Finnish Sign Language will be considered from an articulatory perspective (i.e., the production of signs). Such cross-modal iconicity has not been extensively studied previously, so here, with the help of cognitive semiotics, I aim to carefully describe the cross-modal patterns observed across 118 signs, including 60 sensory signs and 58 emotional signs. The (...) analysis is framed within the theoretical model of Semiotic Hierarchy, which entails a non-reductionist view of meaning. In addition, a pheno-methodological triangulation will be applied: phenomenology (first-person method), literature of phenomenological and semiotic descriptions (second-person perspective) and experimental findings (third-person perspective). The results of this analysis show that (a) 71 of the 118 sensory and emotional signs are cross-modally indexical, (b) only 10 of the 71 signs can be regarded as cross-modally iconic, (c) cross-modal iconicity is highly diagrammatic, (d) iconicity and indexicality are highly integrated, and (e) articulatory feedback matters in the formation of semiotic patterns. This study contributes to our understanding of cross-modal iconicity in signed languages, as well as studies in semiotic systems more generally. (shrink)

The importance of learning and categorizing social objects and events has become widely acknowledged over a couple of decades. Although findings from field studies have suggested that non-human animals have sophisticated abilities to recognize social objects, there is relatively little experimental evidence on this issue. Some studies have revealed animals’ excellent skills for discriminating visual and auditory social stimuli. However, because of perceptual resemblances among stimuli, it is still not clear that they recognize these objects with conceptual mechanisms that are (...) independent of the perceptual characteristics of the stimuli. At the same time, whether their concepts have an aspect of transferring information from one modality to another has not received much attention. This paper advocates approaches to a cross-modal aspect of concepts as a new framework to solve these problems, and introduces the latest studies on cross-modal representations of social objects in non-humans. (shrink)

The thesis of this paper is that the capacity to think of one’s perceptions as cross-modally integrated is incompatible with a reductionist account of the self. In §2 I distinguish three versions of the argument from cross-modality. According to the ‘unification’ version of the argument, what needs to be explained is one’s capacity to identify an object touched as the same as an object simultaneously seen. According to the ‘recognition’ version, what needs to be explained is one’s capacity, having once (...) seen an object, to reidentify that same object by touch alone. According to the ‘objectivity’ version, what needs to be explained is one’s capacity to think of one’s perceptions in different modalities as perceptions of one and the same object. The third version seems to establish that one must conceive of oneself substantially, as the numerically identical owner of one’s experiences, a conclusion in agreement with recent work in developmental psychology claiming to show that an infant’s cross-modal capacities are essentially implicated in their development of a sense of self. There is further work to be done if this is to be tumed into an argument against reductionism: there is no swift route from the epistemology of self-consciousness to the metaphysics of the self. In the §3, I will claim that there is, nevertheless, an argument linking the two. What I propose is an argument derived, not from the token-reflexive rule for the first-person, but resting on its anaphoric behaviour spanning intensional operators. (shrink)

The article considers whether arguments involving sentences that make cross-world comparisons ("I could have been taller than I actually am") are better handled by counterpart theory than by standard modal semantics. The author describes a modal object-language in which such statements may be symbolized and gives both a Kripkean and a counterpart-theoretic semantics for it.

Three priming experiments were conducted to determine how information about the self from different sensory modalities/cognitive domains affects self-face recognition. Being exposed to your body odor, seeing your name, and hearing your name all facilitated self-face recognition in a reaction time task. No similar cross-modal facilitation was found among stimuli from familiar or novel individuals. The finding of a left-hand advantage for self-face recognition was replicated when no primes were presented. These data, along with other recent results suggest the brain (...) processes/represents information about the self in highly integrated ways. (shrink)

The article explores cross-modal iconic relations in nine diverse Western-music songs ranging from 1600 to 2015, all of them thematizing dysphoric weeping. Initial input comes from five recurrent features observed in ancient Greek texts associated with performative events, including the prominence of sound, interjections and strong self-referentiality, repetitions and refrains, the motif of endlessness, and tears associated with streams of water, dew, and libation liquids. The analysis adopts Peirce’s conceptual distinction between image, diagram, and metaphor iconicity, although the continuum reading (...) proposed by several scholars is ultimately favored. The sample turns out to offer plenty of evidence of iconic relations. Interjections, falsetto, verbal repetitions, musical repetitions, musical rendering of sighs and endlessness, ostinato patterns, downward notes, and water images (rain and rivers), all of this is shown to substantiate cross-modal iconicity encompassing weeping, lyrics, music (including musical notation), and images, in different combinations. Quantitative investigations confirming/disconfirming and adding iconicity patterns, and comparative analyses linking Western and non-Western lament traditions constitute desiderata for future work. (shrink)

Early modern humans developed mental capabilities that were immeasurably greater than those of nonhuman primates. We see this in the rapid innovation in tool making, the development of complex language, and the creation of sophisticated art forms, none of which we find in our closest relatives. While we can readily observe the results of this high-order cognitive capacity, it is difficult to see how it could have developed. We take up the topic of cave art and archeoacoustics, particularly the discovery (...) that cave art is often closely connected to the acoustic properties of the cave chambers in which it is found. Apparently, early modern humans were able to detect the way sound reverberated in these chambers, and they painted artwork on surfaces that were acoustic “hot spots,” i.e., suitable for generating echoes. We argue that cave art is a form of cross-modality information transfer, in which acoustic signals are transformed into symbolic visual representations. This form of information transfer across modalities is an instance of how the symbolic mind of early modern humans was taking shape into concrete, externalized language. We also suggest that the earliest rock art found in Africa may constitute one of the first fossilized proxies for the expression of full-fledged human linguistic behavior. (shrink)

This paper is a cross-cultural examination of the development of hunting skills and the implications for the debate on the role of learning in the evolution of human life history patterns. While life history theory has proven to be a powerful tool for understanding the evolution of the human life course, other schools, such as cultural transmission and social learning theory, also provide theoretical insights. These disparate theories are reviewed, and alternative and exclusive predictions are identified. This study of cross-cultural (...) regularities in how children learn hunting skills, based on the ethnographic literature on traditional hunters, complements existing empirical work and highlights future areas for investigation. (shrink)

In serial verb constructions (SVCs), multiple independent lexical verbs are combined in a mono-clausal construction. SVCs express a range of grammatical meanings and are attested in numerous spoken languages all around the world. Yet, to date only few studies have investigated the existence and functions of SVCs in sign languages. For the most part, these studies – including a previous study on Sign Language of the Netherlands (NGT) – relied on elicited data. In this article, we offer a cross-modal typological (...) contribution to the study of SVCs by investigating the phenomenon based on naturalistic corpus data from NGT. A search of the Corpus NGT yielded 41 mono-clausal utterances in which one of a closed set of verbs – namely GO, GIVE, TAKE, and CALL – combines with another lexical verb. While the combinations we found are in important respects reminiscent of SVCs described for spoken languages, our data also confirm the previous finding that the fixed verb in the SVC serves to express agreement (by means of spatial modulation) when the other verb cannot do so. In addition, we identified some novel uses of the verbs GO and GIVE: (i) GO functioning as a future tense marker and (ii) GIVE functioning as a light verb. We will also discuss aspects of the grammaticalization of SVCs in NGT: from lexical verb to light verb to auxiliary, again offering some comparison to grammaticalization paths described for spoken languages. (shrink)

Objective: Evidence suggests people experience an oral size illusion and commonly perceive oral size inaccurately; however, the nature of the illusion remains unclear. The objectives of the present study were to confirm the presence of an oral size illusion, determine the magnitude (amount) and direction (underestimation or overestimation) of the illusion, and determine whether immediately prior crossmodal perceptual experiences affected the magnitude and direction. Design: Participants (N = 27) orally assessed 9 sizes of stainless steel spheres (1/16 in to 1/2 (...) in) categorized as small, medium, or big, and matched them with digital and visual reference sets. Each participant completed 20 matching tasks in 3 assessments. For control assessments, 6 oral spheres were matched with reference sets of same-sized spheres. For primer-control assessments, similar to control, 6 matching tasks were preceded by cross-modal experiences of the same-sized sphere. For experimental assessments, 8 matching tasks were preceded by a cross-modal experience of a differently sized sphere. Results: For control assessments, small and medium spheres were consistently underestimated, and big spheres were consistently overestimated. For experimental assessments, magnitude and direction of the oral size illusion varied according to the size of the sphere used in the cross-modal experience. Conclusion: Results seemed to confirm an oral size illusion, but direction of the illusion depended on the size of the object. Immediately prior cross-modal experiences influenced magnitude and direction of the illusion, suggesting that aspects of oral perceptual experience are dependent upon factors outside of oral perceptual anatomy and the properties of the oral stimulus. (shrink)

I argue that a class of recently-discovered cross-modal illusions gives reason to posit a dimension of content shared across perceptual modalities and to abandon the traditional view according to which perceptual content is exclusively constituted by discrete modality-specific contents.

Maintaining and coordinating multiple task-sets is difficult and leads to costs, however task-switching training can reduce these deficits. A recent study in young adults demonstrated that this training effect occurs at an amodal processing level. Old age is associated with reduced cognitive plasticity and further increases the performance costs when mixing multiple tasks. Thus, cognitive aging might be a limiting factor for inducing cross-modal training effects in a task-switching environment. We trained participants, aged 62–83 years, with an auditory task-switching paradigm (...) over four sessions, to investigate whether training-related reductions in task-switching costs would also manifest in an untrained visual modality version of the task. Two control groups trained with single tasks or not trained allowed us to identify improvements specific to task-switching training. To make statistical evaluations of any age differences in training and cross-modal transfer, the data from the Kattner cohort were incorporated into the present analysis. Despite the tendency for older adults to respond more cautiously, task-switching training specifically led to a mixing cost reduction in both trained and untrained modalities, the magnitude of which was statistically similar regardless of age. In line with a growing body of research, we failed to observe any far transfer effects in measures of inhibition, working memory or fluid intelligence. Overall, we conclude that any apparent cognitive limitations associated with aging do not prevent cognitive control processes which support set-shifting from improving at an amodal level. (shrink)

The puzzle of cross-modal shape experience is the puzzle of reconciling the apparent differences between our visual and haptic experiences of shape with their apparent similarities. This paper proposes that we can resolve the cross-modal puzzle by reflecting on another puzzle. The puzzle of perspectival character challenges us to reconcile the variability of shape experience through shifts in perspective with its constancy. An attractive approach to the latter puzzle holds that shape experience is complex, involving both perspectival aspects and constant (...) aspects. I argue here that parallel distinctions between perspectival and constant aspects of shape experience arise in sight and touch, and that perspectival aspects are modality-specific while at least some constant aspects are constitutively multisensory. I then address a powerful challenge to the idea that aspects of spatial phenomenology are shared cross-modally. (shrink)

For more than a century now, researchers have acknowledged the existence of seemingly arbitrary crossmodal congruency effects between dimensions of sensory stimuli in the general population. Such phenomena, known by a variety of terms including 'crossmodal correspondences', involve individual stimulus properties, rely on a crossmodal mapping of unisensory features, and appear to be shared by the majority of individuals. In other words, members of the general population share underlying preferences for specific pairings across the senses. Crossmodal correspondences between complementary sensory (...) cues have often been referred to as synesthetic correspondences but, we would argue, differ from full-blown synesthetic experiences in a number of important ways, including the fact that there are no idiosyncratic concurrent sensations. Recent psychophysical evidence suggests that such crossmodal correspondences can modulate multisensory integration by helping to resolve the crossmodal binding problem. Here, we propose a model to account for the effects of crossmodal correspondences between complementary auditory and visual cues and critically review their relation to full-blown synesthesia. (shrink)

Cognitive Science, Volume 46, Issue 6, June 2022.

Recently, researchers have expanded the investigation into attentional biases toward positive stimuli; however, few studies have examined attentional biases toward positive auditory information. In three experiments, the present study employed an emotional spatial cueing task using emotional sounds as cues and auditory stimuli or visual stimuli as targets to explore whether auditory or visual spatial attention could be modulated by positive auditory cues. Experiment 3 also examined the temporal dynamics of cross-modal auditory bias toward positive natural sounds using event-related potentials. (...) The behavioral results of the three experiments consistently demonstrated that response times to targets were faster after positive auditory cues than they were after neutral auditory cues in the valid condition, indicating that healthy participants showed a selective auditory attentional bias and cross-modal attentional bias toward positive natural sounds. The results of Experiment 3 showed that N1 amplitudes were more negative after positive sounds than they were after neutral sounds, which further provided electrophysiological evidence that positive auditory information enhances attention at early stages in healthy adults. The results of the experiments performed in the present study suggest that humans exhibit an attentional bias toward positive natural sounds. (shrink)

We investigate the dynamics of sensory integration for perceiving musical performance, a complex natural behavior. Thirty musically trained participants saw, heard, or both saw and heard, performances by two clarinetists. All participants used a sliding potentiometer to make continuous judgments of tension (a measure correlated with emotional response) and continuous judgments of phrasing (a measure correlated with perceived musical structure) as performances were presented. The data analysis sought to reveal relations between the sensory modalities (vision and audition) and to quantify (...) the effect of seeing the performances on participants' overall subjective experience of the music. In addition to traditional statistics, functional data analysis techniques were employed to analyze time-varying aspects of the data. The auditory and visual channels were found to convey similar experiences of phrasing but different experiences of tension through much of the performances. We found that visual information served both to augment and to reduce the experience of tension at different points in the musical piece (as revealed by functional linear modeling and functional significance testing). In addition, the musicians' movements served to extend the sense of phrasing, to cue the beginning of new phrases, to indicate musical interpretation, and to anticipate changes in emotional content. Evidence for an interaction effect suggests that there may exist an emergent quality when musical performances are both seen and heard. The investigation augments knowledge of human communicative processes spanning language and music, and involving multiple modalities of emotion and information transfer. (shrink)

Research in the fields of complex problem solving (CPS) and dynamic decision making using microworlds has been mainly conducted in Western industrialized countries. This study analyzes the CPS process by investigating thinking‐aloud protocols in five countries. Participants were 511 students from Brazil, Germany, India, the Philippines, and the United States who worked on two microworlds. On the basis of cultural‐psychological theories, specific cross‐national differences in CPS strategies were hypothesized. Following theories of situatedness of cognition, hypotheses about the specific frequency of (...) problem‐solving strategies in the two microworlds were developed. Results of the verbal protocols showed (a) modification of the theoretical CPS model, (b) task dependence of CPS strategies, and (c) cross‐national differences in CPS strategies. Participants’ CPS processes were particularly influenced by country‐specific problem‐solving strategies. (shrink)

It is being increasingly recognized that the Saussurean dictum of “the arbitrariness of the linguistic sign” is in conflict with the pervasiveness of the phenomenon commonly known as “sound symbolism”. After first presenting a historical overview of the debate, however, we conclude that both positions have been exaggerated, and that an adequate explanation of sound symbolism is still lacking. How can there, for example, be (perceived) similarity between expressionsand contents across different sensory modalities? We offer an answer, based on the (...) Peircian notion of iconic ground, and G. Sonesson’s distinction betweenprimary and secondary iconicity. Furthermore, we describe an experimental study, in a paradigm first pioneered by W. Kohler, and recently popularized by V.Ramachandran, in which we varied vowels and consonants in fictive word-forms, and conclude that both types of sounds play a role in perceiving an iconic ground between the word-forms and visual figures. The combination of historical conceptual analysis, semiotic explication and psychological experimentationpresented in this article is characteristic of the emerging paradigm of cognitive semiotics. (shrink)

The representational theory of phenomenal experience is often stated in terms of a supervenience thesis: Byrne recently characterises it as the thesis that “there can be no difference in phenomenal character without a difference in content”, while according to Tye, “[a]t a minimum, the thesis is one of supervenience: necessarily, experiences that are alike in their representational contents are alike in their phenomenal character.” Consequently, much of the debate over whether representationalism is true centres on purported counter-examples – that is (...) to say, purported failures of supervenience. The refutation of putative counter-examples has been, it seems to me, by and large successful. But there is a certain class of these for which the representationalist response has been something less than completely convincing. These are the cross-modality cases. I will explain what I mean, and then argue that the response in question is not only unconvincing but actually undermines the representationalist position. (shrink)

A cross-cultural analysis of trust and cooperation networks in Northern Ghana (NGHA) and Oaxaca (OAX) was carried out by means of ego networks and interviews. These regions were chosen because both are inhabited by several ethnic groups, thus providing a good opportunity to test the cultural group selection hypothesis. Against the predictions of this approach, we found that in both regions cooperation is grounded in personal trust groups, and that social cohesion depends on these emotional bonds. Moreover, in agreement with (...) Fiske's notion of “evolved proclivities”, we also found two distinct kinds of trust networks, one for each region, which vary in terms of the degree of ethnic interrelation. This pattern suggests that social cohesion increases when environmental resources are scarce. (shrink)