Recently, it has been observed that the usual type-theoretic restrictions are not enough to block certain paradoxes involving two or more predicates. In particular, when we have a self-referential language containing modal predicates, new paradoxes might appear even if there are type restrictions for the principles governing those predicates. In this article we consider two type-theoretic solutions to multimodal paradoxes. The first one adds types for each of the modal predicates. We argue that there are a (...) number of problems with most versions of this approach. The second one, which we favour, represents modal notions by using the truth predicate together with the corresponding modal operator. This way of doing things is not only useful because it avoids multimodal paradoxes, but also because it preserves the expressive capacity of the language. As an example of the sort of theory we have in mind, we provide a type-theoretic axiomatization that combines truth with necessity and knowledge. (shrink)

Since Montague’s work it is well known that treating a single modality as a predicate may lead to paradox. In their paper “No Future”, Horsten and Leitgeb show that if the two temporal modalities are treated as predicates paradox might arise as well. In our paper we investigate whether paradoxes of multiple modalities, such as the No Future paradox, are genuinely new paradoxes or whether they “reduce” to the paradoxes of single modalities. In order to address this (...) question we develop a notion of reducibility based on a version of Smoryński Diagonalized Operator Logic. We show that there are reducible multimodal paradoxes as well as irreducible paradoxes of interaction. In particular, we show the No Future paradox to be an irreducible paradox according to our notion of reducibility. (shrink)

Moore’s Paradox is a test case for any formal theory of belief. In Knowledge and Belief, Hintikka developed a multimodal logic for statements that express sentences containing the epistemic notions of knowledge and belief. His account purports to offer an explanation of the paradox. In this paper I argue that Hintikka’s interpretation of one of the doxastic operators is philosophically problematic and leads to an unnecessarily strong logical system. I offer a weaker alternative that captures in a more accurate (...) way our logical intuitions about the notion of belief without sacrificing the possibility of providing an explanation for problematic cases such as Moore’s Paradox. (shrink)

In normative reasoning one typically refers to intervals of time across which norms are intended to hold, as well as to alternative possibilities representing hypothetical developments of a given scenario. Thus, deontic modalities are naturally intertwined with temporal and metaphysical ones. Furthermore, contemporary debates in philosophy suggest that a proper understanding of fundamental ethical principles, such as the Ought-Implies-Can thesis, requires a simultaneous analysis of these three families of concepts. In the present article we propose a general formal framework which (...) allows for fine-grained multimodal reasoning in the normative domain. We provide an axiomatization for a novel system of propositional logic encoding the way in which possibilities and norms arising from different sources change over intervals of time. The usefulness of our framework is illustrated by analysing an ancient and particularly challenging `cold case', the Paradox of the Court. (shrink)

My aim in this paper is to gather some evident in favor of the view that a general purge of self-reference is possible. I do this by considering a modal-epistemic version of the Liar Paradox introduced by Roy Cook. Using yabloesque techniques, I show that it is possible to transform this circular paradoxical construction (and other constructions as well) into an infinitary construction lacking any sort of circularity. Moreover, contrary to Cook’s approach, I think that this can be done without (...) using any controversial multimodal rules, i.e., the usual rules from normal epistemic and modal logic are enough to show the paradoxicality of the infinitary construction. Mi objetivo en este trabajo es ofrecer cierta evidencia a favor de la tesis según la cual una purga general de la autorreferencia es posible. Hago esto considerando una versión modal-epistémica de la Paradoja del mentiroso introducida por Roy Cook. usando técnicas yablescas, muestro que es posible transformar esta construcción paradójica circular (y también otras construcciones) en una construcción infinitaria que carece de cualquier forma de circularidad. más aún, en contra de la propuesta de Cook, muestro que esto puede hacerse sin utilizar ninguna regla multimodal controversial, esto es, las reglas usuales de la lógica modal y la lógica epistémica son suficientes para mostrar la paradojicidad de la construcción infinitaria. (shrink)

In the present piece we defend predicate approaches to modality, that is approaches that conceive of modal notions as predicates applicable to names of sentences or propositions, against the challenges raised by Montague’s theorem. Montague’s theorem is often taken to show that the most intuitive modal principles lead to paradox if we conceive of the modal notion as a predicate. Following Schweizer (J Philos Logic 21:1–31, 1992) and others we show this interpretation of Montague’s theorem to be unwarranted unless a (...) further non trivial assumption is made—an assumption which should not be taken as a given. We then move on to showing, elaborating on work of Gupta (J Philos Logic 11:1–60, 1982), Asher and Kamp (Properties, types, and meaning. Vol. I: foundational issues, Kluwer, Dordrecht, pp 85−158, 1989), and Schweizer (J Philos Logic 21:1–31, 1992), that the unrestricted modal principles can be upheld within the predicate approach and that the predicate approach is an adequate approach to modality from the perspective of modal operator logic. To this end we develop a possible world semantics for multiple modal predicates and show that for a wide class of multimodal operator logics we may find a suitable class of models of the predicate approach which satisfies, modulo translation, precisely the theorems of the modal operator logic at stake. (shrink)

Recent discussions on the use of metaphor have centered on how it may be used in a way that has been said to require mandatory attention to the fact that it is metaphorical, resulting in what has come to be known as deliberate metaphor (Steen, 2008 Steen, G. 2008. The paradox of metaphor: Why we need a three-dimensional model of metaphor. Metaphor and Symbol, 23(4): 213–241. [Taylor & Francis Online], [Web of Science ®], [Google Scholar]). While metaphor deliberateness and conventionality/novelty (...) are conceptually distinct, associations are likely to exist in practice. This article focuses on the deliberate use of conventional metaphor in images, by way of examining the use of animate and anthropomorphic metaphors in an instance of corporate branding discourse (i.e., the prospectuses of Singapore's corporatized universities). Through our analysis, we show that deliberate conventional metaphor serves to reinforce particular conceptualizations rather than effect radical conceptual change. Moreover, we discuss visual and multimodal metaphor as deliberate if used in carefully crafted texts and draw on the notion of an image's connotative meaning to point out how such deliberateness can be further accentuated. The article concludes by discussing some implications for how the degree of conventionality is likely to have an effect on how deliberate metaphor achieves its key objective of changing addressees’ concepts of a particular Target. (shrink)

Language plays a central role in human life. However, the term 'language' as defined in the language sciences of the 20th century and the traditions these have drawn on, have arguably, limited our thinking about what language is and does. The two inter-linked volumes of Thibault's study articulate crucially important aspects of an emerging new perspective shift on language - the Distributed Language view - that is now receiving more and more attention internationally. Rejecting the classical view that the fundamental (...) architecture of language can be localized as a number of inter-related levels of formal linguistic organization that function as the coded inputs and outputs to each other, the distributed language view argues that languaging behaviour is a bio-cultural organisation of process that is embodied, multimodal, and integrated across multiple space-time scales. Thibault argues that we need to think of human languaging as the distinctively human mode of our becoming and being selves in the extended human ecology and the kinds of experiencing that this makes possible. Paradoxically, this also means thinking about language in non-linguistic ways that break the grip of the conventional meta-languages for thinking about human languaging. Thibault's book grounds languaging in process theory: languaging and the forms of experience it actualizes is always an event, not a thing that we 'use'. In taking a distinctively interdisciplinary approach, the book relates dialogical theories of human sense-making to the distributed view of human cognition, to recent thinking about distributed language, to ecological psychology, and to languaging as inter-individual affective dynamics grounded in the subjective lives of selves. In taking this approach, the book considers the coordination of selves in social encounters, the emergent forms of self-reflexivity that characterise these encounters, and the implications for how we think of and live our human sociality, not as something that is mediated by over-arching codes and systems, but as emerging from the endogenous subjectivities of selves when they seek to coordinate with other selves and with the situations, artefacts, social institutions, and technologies that populate the extended human ecology. The two volumes aim to bring our understanding of human languaging closer to human embodiment, experience, and feeling while also showing how languaging enables humans to transcend local circumstances and thus to dialogue with cultural tradition. Volume 1 focuses on the shorter timescales of bodily dynamics in languaging activity. Volume II integrates the shorter timescales of body dynamics to the longer cultural-historical timescales of the linguistic and cultural norms and patterns to which bodily dynamics are integrated. (shrink)

The paper deals with several problems concerning with notion of truth. The author is interested in logical aspects of the definition of truth given by Ajdukiewicz and Kotarbinski. He introduces the multimodal logical calculus with propositional quantifier and applies it to analysis of some formulations of the definition. The analysis is focused on two main formulations of the definition, namely on absolute and partial formulation. It is shown that the notion of truth specified by absolute formulation is unconstructive i.e. (...) it is possible to state that some utterance is true without stating any sentence which express the propositional content of the utterance. On the other hand after the partial formulation the notion of truth seems to have some counterintuitive features, for example the falsehood is no longer the same as the lack of truth. Moreover only the absolute approach leads to difficulties connected with the Liar Paradox. (shrink)

ABSTRACT Amygdala is an intensively researched brain structure involved in social processing and multiple major clinical disorders, but its functions are not well understood. The functions of a brain structure are best hypothesized on the basis of neuroanatomical connectivity findings, and of behavioral, neuroimaging, neuropsychological, and physiological findings. Among the heaviest neuroanatomical interconnections of amygdala are those with perirhinal cortex (PRC), but these are little considered in the theoretical literature. PRC integrates complex, multimodal, meaningful, and fine-grained distributed representations of (...) objects and conspecifics. Consistent with this connectivity, amygdala is hypothesized to contribute meaningful and fine-grained representations of intangible knowledge for integration by PRC. Behavioral, neuroimaging, neuropsychological, and physiological findings further support amygdala mediation of a diversity of such representations. These representations include subjective valence, impact, economic value, noxiousness, importance, ingroup membership, social status, popularity, trustworthiness, and moral features. Further, the formation of amygdala representations is little understood, and is proposed to be often implemented through embodied cognition mechanisms. The hypothesis builds on earlier work, and makes novel contributions to understanding the heavy but neglected amygdala-PRC interconnections, and the diversity of amygdala-mediated intangible knowledge representations. Importantly, these illuminate amygdala’s involvement in social processing, and in major clinical disorders. The latter is demonstrated with novel and testable explanations of a number of prominent and unexplained symptoms of autism spectrum disorder. (shrink)

We introduce a multimodal logic for order of magnitude reasoning which considers a new logic-based alternative to the notion of closeness, we provide an axiom system and prove its soundness and completeness.

Analysing film. Distinguishing the filmic contribution to meaning -- Examples of filmic "textual organisation" -- Redrawing boundaries -- Organisation of the book -- Semiotics and documents. Semiotics and its relations to film -- The nature of discourse semantics -- The film as cinematographic document -- A combined view: filmic documents for filmic discourse -- Constructing the semiotic mode of film. Semiotic multimodality -- The internal organisation of semiotic strata -- Composing and combining semiotic modes -- Materiality and "epistemological commitment" -- (...) Christian Metz and the grande syntagmatique of the image track. The original model -- Two examples of analysis with the grande syntagmatique -- Revisions and rebuttals -- Foundations for analysis: filmic units. The basic units of film: preliminaries -- Audiovisual iconic representations -- Perception, perceptual realism and reliable measurement -- Multiplicity: from perception to discourse -- Filmic units revisited: discourse-motivated definitions -- The paradigmatic organisation of film. Beyond Metz: towards a grande paradigmatique -- Capturing discourse dependency structures in film -- The paradigmatic dimensions of projection, taxis and plane -- Two examples of paradigmatic analysis -- Summary and conclusions. (shrink)

When I am looking at my coffee machine that makes funny noises, this is an instance of multisensory perception – I perceive this event by means of both vision and audition. But very often we only receive sensory stimulation from a multisensory event by means of one sense modality, for example, when I hear the noisy coffee machine in the next room, that is, without seeing it. The aim of this paper is to bring together empirical findings about multimodal (...) perception and empirical findings about (visual, auditory, tactile) mental imagery and argue that on occasions like this, we have multimodal mental imagery: perceptual processing in one sense modality (here: vision) that is triggered by sensory stimulation in another sense modality (here: audition). Multimodal mental imagery is not a rare and obscure phenomenon. The vast majority of what we perceive are multisensory events: events that can be perceived in more than one sense modality – like the noisy coffee machine. And most of the time we are only acquainted with these multisensory events via a subset of the sense modalities involved – all the other aspects of these multisensory events are represented by means of multisensory mental imagery. This means that multisensory mental imagery is a crucial element of almost all instances of everyday perception. (shrink)

During the last decade, one source of debate in argumentation theory has been the notion that there are different modes of arguing that need to be distinguished when analyzing and evaluating arguments. Visual argument is often cited as a paradigm example. This paper discusses the ways in which it and modes of arguing that invoke non-verbal sounds, smells, tactile sensations, music and other non-verbal entities may be defined and conceptualized. Though some attempts to construct a ‘multimodal’ theory of argument (...) are criticized, it advocates for an argumentation theory that makes room for visual arguing and for other non-verbal modes that have not been explored in depth. In the process, the paper provides a method for identifying the structure of multimodal arguments and argues that adding modes to our theoretical tool box is an important step toward a comprehensive account of argument. (shrink)

We present an embedding of quantified multimodal logics into simple type theory and prove its soundness and completeness. A correspondence between QKπ models for quantified multimodal logics and Henkin models is established and exploited. Our embedding supports the application of off-the-shelf higher-order theorem provers for reasoning within and about quantified multimodal logics. Moreover, it provides a starting point for further logic embeddings and their combinations in simple type theory.

We study straightforward embeddings of propositional normal multimodal logic and propositional intuitionistic logic in simple type theory. The correctness of these embeddings is easily shown. We give examples to demonstrate that these embeddings provide an effective framework for computational investigations of various non-classical logics. We report some experiments using the higher-order automated theorem prover LEO-II.

This is a philosophical study by Lithuanian authors on issues related to how to teach philosophy, especially moral philosophy, through films, paintings, images, etc. The topics include multimodality as a synthesis; semiotics and language and image; cinema and philosophical education; postructuralism; film education; value education through spiritual cinema; Eastern Ethics for Western students through multimodal education; philosophy for children; sound and multimodality; Pedagogy of aesthetic to eco-pedagogy, etc.

One way to characterize the special relation that one has to one's own body is to say that only one's body appears to one from the inside. Although widely accepted, the nature of this specific experiential mode of presentation of the body is rarely spelled out. Most definitions amount to little more than lists of the various body senses (including senses of posture, movement, heat, pressure, and balance). It is true that body senses provide a kind of informational access to (...) one's own body, which one has to no other bodies, by contrast to external senses like vision, which can take many bodies as their object. But a theory of bodily awareness needs to take into account recent empirical evidence that indicates that bodily awareness is infected by a plague of multisensory effects, regardless of any dichotomy between body senses and external senses. Here I will argue in favour of a multimodal conception of bodily awareness. I will show that the body senses fail to fully account for the content of bodily experiences. I will then propose that vision helps compensate for the insufficiencies of the body senses in people who can see. I will finally argue that the multimodality of bodily experiences does not prevent privileged access to one's body. (shrink)

By the time they reach early adulthood, English speakers are familiar with the meaning of thousands of words. In the last decades, computational simulations known as distributional semantic models have demonstrated that it is possible to induce word meaning representations solely from word co-occurrence statistics extracted from a large amount of text. However, while these models learn in batch mode from large corpora, human word learning proceeds incrementally after minimal exposure to new words. In this study, we run a set (...) of experiments investigating whether minimal distributional evidence from very short passages suffices to trigger successful word learning in subjects, testing their linguistic and visual intuitions about the concepts associated with new words. After confirming that subjects are indeed very efficient distributional learners even from small amounts of evidence, we test a DSM on the same multimodal task, finding that it behaves in a remarkable human-like way. We conclude that DSMs provide a convincing computational account of word learning even at the early stages in which a word is first encountered, and the way they build meaning representations can offer new insights into human language acquisition. (shrink)

The aim of this paper is to argue that our experience of artworks is normally multimodal. It is the result of perceptual processing in more than one sense modality. In other words, multimodal experience of art is not the exception; it is the rule. I use the example of music in order to demonstrate the various ways in which the visual sense modality influences the auditory processing of music and conclude that this should make us look more closely (...) at our practices of engaging with artworks. (shrink)

Logical paradoxes – like the Liar, Russell's, and the Sorites – are notorious. But in Paradoxes and Inconsistent Mathematics, it is argued that they are only the noisiest of many. Contradictions arise in the everyday, from the smallest points to the widest boundaries. In this book, Zach Weber uses “dialetheic paraconsistency” – a formal framework where some contradictions can be true without absurdity – as the basis for developing this idea rigorously, from mathematical foundations up. In doing so, (...) Weber directly addresses a longstanding open question: how much standard mathematics can paraconsistency capture? The guiding focus is on a more basic question, of why there are paradoxes. Details underscore a simple philosophical claim: that paradoxes are found in the ordinary, and that is what makes them so extraordinary. (shrink)

It is common to characterize pain with touch-related terms, like ‘cutting’, ‘pressing’, ‘sharp’, and ‘pulsing’, or temperature-related terms, like ‘hot’ or ‘burning’. This suggests that many pains are phenomenally multimodal because they are experienced as having some tactile-like or thermal-like character. The goal of this chapter is to investigate the structure of phenomenally multimodal pain experiences. It is argued that the usual accounts of multimodal structure proposed in investigations regarding exteroceptive experiences cannot be plausibly applied to (...) class='Hi'>multimodal experiences of pain. Instead, an alternative framework is proposed which characterizes the structure of tactile-like and thermal-like pains by referring to the notion of crossmodal correspondences. (shrink)

The article investigates a multimodal practice for self-selecting observed in a video-taped corpus of work meetings: the use of pointing gestures predicting possible turn completions and projecting the emergence of possible next speakers. This practice is analyzed in various sequential positions, namely at turn beginnings and at pre-beginnings. It displays recipients' practical online turn parsing, and their orientation to transition spaces, and to TCU, completions in a visible, recognizable, public way. It shows the emergent and progressive establishment of speakership, (...) exploiting both systematic features of turn-taking and specific features of the interactional space. The article explores the emic, locally situated and contingent definition of speakership by considering not only where pointing gestures begin but also where they end: pointing does not only end in pre-completion positions, projecting turn end, but can also persist through sequences, showing speaker's orientations to her turn's sequential implicativeness. Thus, by observing a particular multimodal practice within a specific interactional setting, the article explores participants' orientations to the rights and obligations associated with talk-related categories such as `non current speaker', `possible next speaker', `incipient speaker' and `current speaker'. (shrink)

The analysis of multimodal argumentation in advertising is a crucial and problematic area of research. While its importance is growing in a time characterized by images and pictorial messages, the methods used for interpreting and reconstructing the structure of arguments expressed through verbal and visual means capture only isolated dimensions of this complex phenomenon. This paper intends to propose and illustrate a methodology for the reconstruction and analysis of “double-mode” arguments in advertisements, combining the instruments developed in social semiotics, (...) pragmatics, and argumentation theory. An advertisement is processed through a five-step path. The analysis of its context, text genre, and images leads to a first representation of the messages that it encodes both pictorially and verbally (step 1). These first semantic representations are further enriched by including their polyphonic articulations and presuppositions (step 2), their explicatures (step 3), and their dialogical functions and illocutionary forces (step 4). These pragmatic steps retrieve the commitment structure of the ad, which allows a further argument analysis conducted through argumentation schemes (step 5). (shrink)

Supererogatory acts—good deeds “beyond the call of duty”—are a part of moral common sense, but conceptually puzzling. I propose a unified solution to three of the most infamous puzzles: the classic Paradox of Supererogation (if it’s so good, why isn’t it just obligatory?), Horton’s All or Nothing Problem, and Kamm’s Intransitivity Paradox. I conclude that supererogation makes sense if, and only if, the grounds of rightness are multi-dimensional and comparative.

What is the correct procedure for determining the contents of perception? Philosophers tackling this question increasingly rely on empirically-oriented procedures in order to reach an answer. I argue that this constitutes an improvement over the armchair methodology constitutive of phenomenal contrast cases, but that there is a crucial respect in which current empirical procedures remain limited: they are unimodal in nature, wrongly treating the senses as isolatable faculties. I thus have two aims: first, to motivate a reorientation of the admissible (...) contents debate into a multimodal framework, charting its various significances. The second is to explore whether any experimental studies of multimodal perception support a so-called Liberal (or ‘high-level’ or ‘rich’) account of perception’s admissible contents. I conclude that the McGurk effect and the ventriloquist effect are both explicable without the postulation of high-level content, but that at least one multimodal experimental paradigm may necessitate such content: the rubber hand illusion. One upshot of this argument is that Conservatives who claim that the Liberal view intolerably broadens the scope of perceptual illusions, particularly from the perspective of perceptual psychology, should pursue other arguments against that view. (shrink)

This essential guide to paradoxes takes the reader on a lively tour of puzzles that have taxed thinkers from Zeno to Galileo and Lewis Carroll to Bertrand Russell. Michael Clark uncovers an array of conundrums, such as Achilles and the Tortoise, Theseus' Ship, Hempel's Raven, and the Prisoners' Dilemma, taking in subjects as diverse as knowledge, ethics, science, art and politics. Clark discusses each paradox in non-technical terms, considering its significance and looking at likely solutions.

ABSTRACTThis article offers the first large-scale study of a multimodal corpus of 210 advertisements. First, the reader is presented with a description of the corpus in terms of the distribution of conceptual operations and use of modal cues. Subsequently, the weight of mode and marketing strategy to trigger more or less amounts of conceptual complexity is analyzed. This corpus-based survey is complemented with the qualitative analysis of three novel metaphor–metonymy interactions that stem from the data and that have not (...) yet been surveyed in multimodal use. The results show that metaphtonymy is the most frequet conceptual operation in the corpus; that there is a significant effect of the use of modes in the activation of different amounts of conceptual complexity; and that the type of advertised product and the marketing strategy has no significant effect on the number and complexity of conceptual mappings in the advert... (shrink)

This paper presents an analytical framework for analyzing how multimodal resources of emotion expression are semiotically materialized in discursive interactions specific to political discourse. Interested in how political personae are emotionally constructed through multimodal meaning-making practices, our analysis model assumes an interdisciplinary perspective, which integrates facial expression analysis – using FaceReader™ software –, the theory of emotional arcs and bodily actions (hand gestures) analysis that express emotions, in the analytical framework of multimodality. The results show how the (...) class='Hi'>multimodal choices that political actors make during discursive interactions allow them to build their political brand and make connections with the audience on an emotional level. (shrink)

According to the shared signal hypothesis the impact of facial expressions on emotion processing partially depends on whether the gaze is directed toward or away from the observer. In autism spectrum disorder several aspects of face processing have been found to be atypical, including attention to eye gaze and the identification of emotional expressions. However, there is little research on how gaze direction affects emotional expression processing in typically developing individuals and in those with ASD. This question is investigated here (...) in two multimodal experiments. Experiment 1 required processing eye gaze direction while faces differed in emotional expression. Forty-seven children participated. Their Autism Diagnostic Observation Schedule scores ranged from 0 to 6 in the experiment. Event-related potentials were sensitive to gaze direction and emotion, but emotion processing did not depend on gaze direction. However, for angry faces the gaze direction effect on the N170 amplitude, as typically observed in TD individuals, diminished with increasing ADOS score. For neutral expressions this correlation was not significant. Experiment 2 required explicit emotion classifications in a facial emotion composite task while eye gaze was manipulated incidentally. A group of 22 children with ASD was compared to a propensity score-matched group of TD children. The same comparison was carried out for a subgroup of nine children with ASD who were less trained in social cognition, according to clinician’s report. The ASD group performed overall worse in emotion recognition than the TD group, independently of emotion or gaze direction. However, for disgust expressions, eye tracking data revealed that TD children fixated relatively longer on the eyes of the stimulus face with a direct gaze as compared with averted gaze. In children with ASD we observed no such modulation of fixation behavior as a function of gaze direction. Overall, the present findings from ERPs and eye tracking confirm the hypothesis of an impaired sensitivity to gaze direction in children with ASD or elevated autistic traits, at least for specific emotions. Therefore, we conclude that multimodal investigations of the interaction between emotional processing and stimulus gaze direction are promising to understand the characteristics of individuals differing along the autism trait dimension. (shrink)

This is an excerpt of a report that highlights and explores five questions which arose from The Unity of Consciousness and Sensory Integration conference at Brown University in November of 2011. This portion of the report explores the question: Are some of the basic units of consciousness multimodal?

The question, “What norms are appropriate for the evaluation of the probative merits of visual arguments?” underlies the investigation of this paper. The notions of argument and of multimodal visual argument employed in the study are explained. Then four multimodal visual arguments are analyzed and their probative merits assessed. It turns out to be possible to judge these qualities using the same criteria that apply to verbally expressed arguments. Since the sample is small and not claimed to be (...) representative, this finding can at best be regarded as suggestive for the probative assessment of multimodal visual arguments in general. (shrink)

‘다중양상성’은 다양한 맥락에서 상이한 의미로 이해된다. 이 글에서 ‘다중양상성’은 음악의 미적 경험에서 지각과 의식이 신경 토대 연결망을 통해 인지적으로 동기화(synchronization)되는 방식을 가리킨다. 이 과정을 도식적으로 말하면, 우선 시각, 청각, 촉각 등 다양한 감각 자료들이 뇌의 피질 안에 분산된 전문 모듈들에 의해 신경적으로 처리‧저장된다. 심적 상태가 생물학적으로 저장되는 것이다. 이후 어떤 시점에서, 주체가 음악의 특수한 청각적 국면에 주목할 때 비청각적인 신경적 자료들은 활성화되어 중앙 의식에 합류한다. 즉 중앙 의식의 요구에 부응하여 생물학적 데이터가 심적 상태로 변환되고 현재화되며, 이에 따라 주체의 청각 경험은 (...) 상이한 지각 양상들과 앙상블을 이룬다. 이 단계에서 기억과 사고가 참여하여 주도적으로 서사적 해석을 구성할 수도 있으나 이것은 주체의 관심사에 달린 문제이다.BR 본 논의의 직접적인 초점은 음악에 있지만, 다중양상성 논제는 예술 일반에 확대 적용될 수 있다. 왜냐하면, 첫째로, 다중양상성 논제는 매체 지각의 다양성을 뜻하는 것이 아니라 예술 감상자가 작품 전체의 형식으로서 투사하는, 자기 표상적인 의식에 다름 아니기 때문이다. 둘째로, 예술 감상자가 미적 주목을 통해 가상적으로 투사하는 통합적인 작품 형식은 그가 현재 의식적으로 주목하는 작품의 지각적 면모들뿐만 아니라, 그 자료들을 추상하여 전체 형식으로 구성하는 과정에 개입하는 상이한 양태의 ‘지각 흔적’들과 개념적 사고틀이 산출하는 다중양상적 앙상블이기 때문이다. 이렇게 인지적으로 동기화된 앙상블을 가능하게 하는 것은 다름 아니라 의식 아래 차원에서 작동하는 다양한 지각 모듈들과 그것들을 연결해주는 비의식적인 신경 연결망이다. 따라서 비록 ‘신경미학’이 고차적 사고, 지향성, 예술사적 지식 등이 어떻게 예술 경험에 관여하는지를 직접 설명하기 어렵지만, 적어도 신경 토대가 어떻게 미적 경험의 대상인 자기 표상적 의식의 형성을 가능하게 하는지를 보여줄 수 있다. (shrink)

_Paradoxes from A to Z, Third edition_ is the essential guide to paradoxes, and takes the reader on a lively tour of puzzles that have taxed thinkers from Zeno to Galileo, and Lewis Carroll to Bertrand Russell. Michael Clark uncovers an array of conundrums, such as Achilles and the Tortoise, Theseus’ Ship, and the Prisoner’s Dilemma, taking in subjects as diverse as knowledge, science, art and politics. Clark discusses each paradox in non-technical terms, considering its significance and looking at (...) likely solutions. This third edition is revised throughout, and adds nine new paradoxes that have important bearings in areas such as law, logic, ethics and probability. Paradoxes from A to Z, Third edition is an ideal starting point for those interested not just in philosophical puzzles and conundrums, but anyone seeking to hone their thinking skills. (shrink)

Taste is a central sense for humans and animals, and it has been largely studied either from physiological and neurological approaches or from socio-cultural ones. This paper adopts another view, focused on the activity of tasting rather than on the sense of taste, approached within the perspective of ethnomethodology and multimodal conversation analysis. This view addresses the activity of tasting as it is interactionally organized in specific social settings, observed in a naturalistic way, on the basis of video recordings. (...) Focusing on video recorded improvised tastings of cheese in gourmet shop encounters, the paper offers a systematic analysis of the way in which tasting is orderly achieved in an intersubjective way. It follows the various steps characterizing tasting, from the invitation to taste, to the grasping of a bit to taste, which is put in the mouth, chewed, and swallowed; it details how an interactional moment offering the taster a priviledged, individual, focused space in which to devote exclusive attention to the object tasted is actively tailored by all parties. By contrast, the completion of tasting is marked by a return to mutual gaze, the animation of facial expressions and nods, and the final production of a judgment of taste. By offering a systematic reconstruction of how these tasting moments are organized, the paper invites to a multimodal approach of sensoriality in social interaction. (shrink)

One of the main limitations of natural language‐based approaches to meaning is that they do not incorporate multimodal representations the way humans do. In this study, we evaluate how well different kinds of models account for people's representations of both concrete and abstract concepts. The models we compare include unimodal distributional linguistic models as well as multimodal models which combine linguistic with perceptual or affective information. There are two types of linguistic models: those based on text corpora and (...) those derived from word association data. We present two new studies and a reanalysis of a series of previous studies. The studies demonstrate that both visual and affective multimodal models better capture behavior that reflects human representations than unimodal linguistic models. The size of the multimodal advantage depends on the nature of semantic representations involved, and it is especially pronounced for basic‐level concepts that belong to the same superordinate category. Additional visual and affective features improve the accuracy of linguistic models based on text corpora more than those based on word associations; this suggests systematic qualitative differences between what information is encoded in natural language versus what information is reflected in word associations. Altogether, our work presents new evidence that multimodal information is important for capturing both abstract and concrete words and that fully representing word meaning requires more than purely linguistic information. Implications for both embodied and distributional views of semantic representation are discussed. (shrink)