The Scene Perception & Event Comprehension Theory (SPECT) Applied to Visual Narratives

Topics in Cognitive Science 12 (1):311-351 (2020)
  Copy   BIBTEX

Abstract

Understanding how people comprehend visual narratives (including picture stories, comics, and film) requires the combination of traditionally separate theories that span the initial sensory and perceptual processing of complex visual scenes, the perception of events over time, and comprehension of narratives. Existing piecemeal approaches fail to capture the interplay between these levels of processing. Here, we propose the Scene Perception & Event Comprehension Theory (SPECT), as applied to visual narratives, which distinguishes between front-end and back-end cognitive processes. Front-end processes occur during single eye fixations and are comprised of attentional selection and information extraction. Back-end processes occur across multiple fixations and support the construction of event models, which reflect understanding of what is happening now in a narrative (stored in working memory) and over the course of the entire narrative (stored in long-term episodic memory). We describe relationships between front- and back-end processes, and medium-specific differences that likely produce variation in front-end and back-end processes across media (e.g., picture stories vs. film). We describe several novel research questions derived from SPECT that we have explored. By addressing these questions, we provide greater insight into how attention, information extraction, and event model processes are dynamically coordinated to perceive and understand complex naturalistic visual events in narratives and the real world.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 76,479

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Narrative Pictures.Bence Nanay - 2009 - Journal of Aesthetics and Art Criticism 67 (1):119 - 129.
Shifting perspectives in pictorial narratives.Emar Maier & Sofia Bimpikou - 2019 - In Uli Sauerland & Stephanie Solt (eds.), Proceeding of Sinn und Bedeutung 23. Barcelona: Leibniz-Centre General Linguistics (ZAS).
Perceiving pictures.Bence Nanay - 2011 - Phenomenology and the Cognitive Sciences 10 (4):461-480.
Scene Perception.Ronald A. Rensink - 2000 - In A. E. Kazdin (ed.), Encyclopedia of Psychology. Oxford University Press. pp. 151-155.
Change Detection.Ronald A. Rensink - 2002 - Annual Review of Psychology 53 (1):245-277.
The Modeling and Control of Visual Perception.Ronald A. Rensink - 2007 - In Wayne Gray (ed.), Integrated Models of Cognitive Systems. Oxford University Press. pp. 132-148.
Attention, Consciousness, and Data Display.Ronald A. Rensink - 2006 - In 2006 Proceedings of the American Statistical Association, Statistical Graphics Section.

Analytics

Added to PP
2019-09-05

Downloads
11 (#846,983)

6 months
2 (#302,213)

Historical graph of downloads
How can I increase my downloads?