Competition among visual, verbal, and auditory modalities: a socio-semiotic perspective

Semiotica 2024 (259):127-147 (2024)
  Copy   BIBTEX

Abstract

This article presents a fresh perspective on the interplay among visual, verbal, and auditory modalities, positing that these modalities, as semogenic resources, compete to express dynamic meanings. The theoretical paradigm emphasizes that whether a modality or an element within a modality gets or loses semantic status, it will elicit an additional layer of social meaning to depict a comprehensive picture of a story together with an explicit semiotic meaning. The article adopts a qualitative method to analyze the data, which are drawn from The Good Wife and My Roommate is a Gumiho and annotated in ELAN 6.3. It was found that modal competition can shed light on the dynamic meaning-making processes in semiotic and societal orientations. Modal competition may distort space and time of different stories, and reconstruct a different discursive spatio-temporal dimension in the TV world. It can diversify the dynamic orientations from New to Given in visual, verbal, and auditory texts of multimodal discourses to tell stories. Modal competition provides a lens to understand the multidimensional reality and to appreciate the aesthetics of a modern TV series.

Other Versions

No versions found

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 103,885

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Visual affect in films: a semiotic approach.Yi Jing - 2021 - Semiotica 2021 (239):99-124.
Perceptual Modalities: Modes of Presentation or Modes of Interaction?Marek McGann - 2010 - Journal of Consciousness Studies 17 (1-2):1-2.

Analytics

Added to PP
2024-06-14

Downloads
13 (#1,399,496)

6 months
7 (#590,730)

Historical graph of downloads
How can I increase my downloads?