Intersemiotic translation (IT) was defined by Roman Jakobson (The Translation Studies Reader, Routledge, London, p. 114, 2000) as “transmutation of signs”—“an interpretation of verbal signs by means of signs of nonverbal sign systems.” Despite its theoretical relevance, and in spite of the frequency in which it is practiced, the phenomenon remains virtually unexplored in terms of conceptual modeling, especially from a semiotic perspective. Our approach is based on two premises: (i) IT is fundamentally a semiotic operation process (semiosis) and (ii) (...) IT is a deeply iconic-dependent process. We exemplify our approach by means of literature to dance IT and we explore some implications for the development of a general model of IT. (shrink)

Film critics and theorists often refer to the ‘worlds’ that films create, present, or embody,e.g. the world of Eraserhead or the world in Fanny and Alexander. Like the world of a novel or painting, the world of a film in thisprevalent use of the term denotes its represented content or setting, or whatever formaland thematic aspects distinguish it from other films in a pronounced and oftenimmediately recognisable way. Yet there is much more to be said in philosophical termsabout films as, (...) or as containing, worlds. This paper will argue that pursuing this subjectentails a needed re-evaluation of multi-faceted issues that are of concern to bothcontemporary film theorists and philosophers of film, including the relation betweencinematic representation and expression, reflexivity, the nature of film style andauthorship, and cinema’s relation to, and direct interaction with, other art forms. (shrink)

Name der Zeitschrift: Semiotica Jahrgang: 2018 Heft: 220 Seiten: 95-121.

Detection in contemporary genre films is in the process of being transformed: viewers see less and less of moving, traveling, and active human bodies entering in interaction and exchanging words. Instead, what takes up a significant part of film time is the view of computer screens, with digitally stored and retrieved traces, meaningful for detection, playing the lead role. One result of this type of detection on screen – rather than detection in the streets or on murder scenes – is (...) that detection is presented as a process happening on the human-computer interface. With reference to Lev Manovich the article asks how the “illusion of navigating through virtual spaces” is recreated, when the context of such an illusion is filmic diegesis defined by genre rules, where “the virtual spaces of the screen” should have a direct effect on “the real spaces of filmic diegesis”? (shrink)

This article surveys the current debate among analytic philosophers and film narratologists about the logic and phenomenology of cinematic narration. Particular attention is given to the question of whether every film that represents a fictional narrative also represents a narrator's fictional narration.

This article examines the role of moods in aesthetic experience by focussing on film. It considers specifically the function of moods in relation to narrative and aesthetic perspectives which a film provides and which recipients are invited to adopt. I distinguish superficial transitory moods from profound enduring ones. This differentiation is important with regard to the question why moods in film matter and why they are different from emotions. I will focus on Lars von Trier’s film “Melancholia” and claim that (...) the moods of the leading characters can at one and the same time count as moods and perspectives on the world. Their moods are strongly connected to how they perceive their world, evaluate it, and “are” in the world. By being put into a mood that assails human beings holistically, viewers get acquainted with a perspective of a fictional character in an encompassing manner that includes mind and body. However, it will be discussed whether the viewers feel profound or superficial moods when engaging in the moods of the film and the characters and whether they are infatuated or can remain aesthetic distance. (shrink)

Summary This article questions certain assumptions concerning film form made by the recent psychological film research and compares them to those of precursors of film psychology like Hugo Münsterberg and Rudolf Arnheim, as well as the principles of Gestalt psychology. It is argued that principles of Gestalt psychology such as those of ‘good form’ and good continuation are still underlying the psychological research of film, becoming particularly apparent in its approach to continuity editing. Following an alternative Gestalt genealogy that links (...) Gestalt theory with more recent dynamic models of brain activity and with accounts of brain complexity and neuronal synchronisation, the article concludes that psychological research on film needs to shift the focus from form to transformation, both in conceiving the perceptual and cognitive processing of films and in approaching film aesthetics more broadly. (shrink)

Human engagement with nonhuman animals in motion pictures is a complex process that anthropomorphism and identification misconstrue. A superior model comes from cognitive theories of how spectators engage characters, particularly Smith , who suggests modifications to account for the nuances of spectator engagement with nonhuman animal characters. The central components of this amended model include the person schema, the three types of cues that films use to activate the person schema, and what Smith calls the "Structure of Sympathy." Such a (...) model enables us to understand better the role that moving image representations of nonhuman animals play in human-animal relationships. (shrink)

Filmmakers use continuity editing to engender a sense of situational continuity or discontinuity at editing boundaries. The goal of this study was to assess the impact of continuity editing on how people perceive the structure of events in a narrative film and to identify brain networks that are associated with the processing of different types of continuity editing boundaries. Participants viewed a commercially produced film and segmented it into meaningful events, while brain activity was recorded with functional magnetic resonance imaging (...) (MRI). We identified three degrees of continuity that can occur at editing locations: edits that are continuous in space, time, and action; edits that are discontinuous in space or time but continuous in action; and edits that are discontinuous in action as well as space or time. Discontinuities in action had the biggest impact on behavioral event segmentation, and discontinuities in space and time had minor effects. Edits were associated with large transient increases in early visual areas. Spatial-temporal changes and action changes produced strikingly different patterns of transient change, and they provided evidence that specialized mechanisms in higher order perceptual processing regions are engaged to maintain continuity of action in the face of spatiotemporal discontinuities. These results suggest that commercial film editing is shaped to support the comprehension of meaningful events that bridge breaks in low-level visual continuity, and even breaks in continuity of spatial and temporal location. (shrink)

This paper compares two computer war games, US-produced and Arab-produced, which represent the conflict in Lebanon. It asks whether the format exerts an influence over the content of the games. The paper gives the historical background to the actual activities of the US and Hizbollah in the region and then looks at the representations of social actors, settings, and action in the games. We ask how these games relate to the real world events they recontextualize. We ask how they frame (...) these events in terms of a ‘special operations’ discourse of war that has its origins in the US, yet do so with specific inflections that reflect the interests of the context in which they were produced. We show that different political interests are reflected in the content of the games, but that the global power of the format of the computer war game exerts its influence across this divide. Such formats are not neutral containers for politically different content, but themselves carry values and an ideological message about conflict resolution. (shrink)

The concept of suture has long been an important and controversial concept in investigations of the relationships between narrative, diegesis, character, and spectator. The dominant understanding of suture has paid more attention to its Lacanian derivation – and to the account given by Daniel Dayan – than to the work of Jean-Pierre Oudart which first introduced suture into Film Studies. This article, however, follows the recent work of George Butte, who argues that the way Oudart understands suture is very illuminating (...) for the study of the complex forms of intersubjectivity that cinema so readily, and so richly, dramatises – famously by means of shot/reverse shot figures. It argues that certain key moments in Ridley Scott's Alien activate ideas of corporeality, desire, and intersubjectivity in ways that contribute to a wider thematic and figurative nexus at work in the film directed at the exploration of impossible intersubjectivities. The article also proposes that, via this nexus, the film offers an intriguing instantiation of Nietzsche's notion of the “human, all too human”, thereby demonstrating that there is much more in Nietzsche of relevance to Alien than the xenomorph's superhuman “will-to-power”. The android Ash's admiration for the alien's lack both of conscience and consciousness ironically indicates his own all-too-human recognition of the superfluity but inescapability of his own consciousness. The article concludes by drawing briefly on the work of Stanley Cavell on acknowledgment, proposing that much of the horror of Alien lies not only in how bodies are ruptured but in the fact that some subjectivities cannot even be sutured. (shrink)

This article draws on recent research in the medical humanities to analyze two contemporary Chinese films: Zhang Yuan's Sons (1996) and Zhou Xiaowen's The Common People (1998). By portraying psychic and physical anguish in ways that refuse to divorce biology from culture, such films offer rare moral dialogues on biomedical issues and contribute a cross-cultural perspective invaluable to the task of responding to illness and suffering.

The following article frames a particular case study: Jean-Luc Godard’s À bout de souffle (1960), referenced in the paper with its American title, Breathless. Foraging through the dense and sophisticated thicket of narrative, visual and textual features, the present study will attempt to untangle the overall intrinsic complexity of Godard’s film, as it exceeds simple commonalities between genre conventions or traditional stylistic approaches.The abrasive dialectical opposition that Breathless enacts against classical storytelling is indeed central to the specific cluster that can (...) be examined under the labels of “experimental cinema”, “auteur cinema”, “art cinema”, predicated on Godard’s abundant departures from cinematic (mainstream) norms.The methodology adopted in the article will encompass both a cultural studies approach and the visual strategies of textual analysis from the perspective of film studies. This will spur a close examination of Godard’s directorial style, paying attention to a rich plethora of technical devices inscribed within salient sequences and offset against the matrix of creative options presented by the French Nouvelle Vague. (shrink)

This article reads some familiar examples of contemporary visual arts, such as Cindy Sherman, Mona Hatoum, Robert Gober, John Miller, Eva Hesse, Orlan and Robert Mapplethorpe, by engaging with diff...

Moral constructions of suicide are deliberately avoided in contemporary suicidology, yet morality persists, little or imperfectly acknowledged, in its practices and in the policies, discourses, and instruments that it underpins. This study used narrative methodologies to examine the normative force of suicidology and its implications for persons who had engaged in an act of nonfatal suicidal behavior. I interviewed a convenience sample of twelve persons from two inner–urban community mental health centers who were receiving crisis and case management services after (...) a recent act of nonfatal suicidal behavior. Interviews focused on events leading up to and after participants’ suicidal behavior; the responses their suicidal behavior generated in others, including family, friends, and the health professionals caring for them; and cultural views of suicide more broadly. Analysis of these interviews revealed that, although participants’ narratives were broadly consistent with a number of recognizable, canonical story formats common to our cultural repertoire of stories of suicide, they also revealed important tensions, divisions, conflicts, and challenges to contemporary suicidological discourse and practice. Despite evidence to suggest that biomedical understandings of suicide provided some therapeutic benefit to participants, they did not address important social and moral dimensions of human life or explore their connection to suicidal behavior—aspects of the suicidal event that were critical to its causation and to its retelling and “resolution.” The results of this study provide important insights into the moral features of suicidal behavior, the moral and ethical implications of suicide research, and the limitations of moral and ethical discourse in suicidology. (shrink)

According to conceptual metaphor theory, there are two basic metaphorical models for conceptualising time in terms of space: the ego-moving model maps our movement through space onto our imagined movement through time, while the time-moving model represents time as an entity moving through spatial locations, the ego being just a passive observer. The aim of this article is to investigate how time is conceptualized in film where ego, movement, time and space also play basic roles. I compare the two linguistic (...) models to Gilles Deleuze’s conceptualization of filmic time: the movement-image and the time-image. While the movement-image and the moving-ego metaphor directly map spatial structures onto the domain of time, the time-image and the moving-time metaphor correlate only in their basic structures and involve different levels of conceptual integrations and conversions. Due to film techniques such as a mobile camera, montage and image manipulation, the time-image seems to transcend the constraints of natural perception and maps onto mental rather than external space, thus giving rise to a new reverse metaphor where space acquires characteristics of the time domain. (shrink)

How should critics approach narrative temporality in times of ecological disorder? Literary critics have attempted to bridge eco-criticism with narrative theory, shifting attention from narrative content to narrative form. Econarratology studies how narrative shapes our understanding of the environment. Yet, eco-critical interrogations of narrative form are lacking. Grounded in a homogeneous conception of time, narratology often relays a dichotomy between narrativity and “dysnarrativity”. This dichotomy fails to translate the variety of temporal processes in film. I shall highlight the problem underlying (...) Jacques Rancière's critique of Deleuze's film-philosophy and its relevance for narrative theory. My discussion of this dispute is grounded in the examination of Apichatpong Weerasethakul's Uncle Boonmee Who Can Recall His Past Lives. Critics invariably base their analyses on Boonmee's remembrances and reduce narrative complexity to dysnarrative indeterminacy by accommodating non-human storylines into a human plot. I argue that Uncle Boonmee both confirms and bypasses the critique of linear narrative that is at heart of the Rancière-Deleuze discussion. In doing so, Weerasethakul's feature calls for a new paradigm – different, yet unlike the crystalline narrative, positively determined. By bringing the event to the fore, Deleuze offers another theoretical backdrop for event narratology, that in turn proves useful to econarratology. (shrink)

Popular movies present chunk-like events that promote episodic, serial updating of viewers’ representations of the ongoing narrative. Event-indexing theory would suggest that the beginnings of new scenes trigger these updates, which in turn require more cognitive processing. Typically, a new movie event is signaled by an establishing shot, one providing more background information and a longer look than the average shot. Our analysis of 24 films reconfirms this. More important, we show that, when returning to a previously shown location, the (...) re-establishing shot reduces both context and duration while remaining greater than the average shot. In general, location shifts dominate character and time shifts in event segmentation of movies. In addition, over the last 70 years re-establishing shots have become more like the noninitial shots of a scene. Establishing shots have also approached noninitial shot scales, but not their durations. Such results suggest that film form is evolving, perhaps to suit more rapid encoding of narrative events. (shrink)

Narratives are an integral part of human expression. In the graphic form, they range from cave paintings to Egyptian hieroglyphics, from the Bayeux Tapestry to modern day comic books (Kunzle, 1973; McCloud, 1993). Yet not much research has addressed the structure and comprehension of narrative images, for example, how do people create meaning out of sequential images? This piece helps fill the gap by presenting a theory of Narrative Grammar. We describe the basic narrative categories and their relationship to a (...) canonical narrative arc, followed by a discussion of complex structures that extend beyond the canonical schema. This demands that the canonical arc be reconsidered as a generative schema whereby any narrative category can be expanded into a node in a tree structure. Narrative “pacing” is interpreted as a reflection of various patterns of this embedding: conjunction, left-branching trees, center-embedded constituencies, and others. Following this, diagnostic methods are proposed for testing narrative categories and constituency. Finally, we outline the applicability of this theory beyond sequential images, such as to film and verbal discourse, and compare this theory with previous approaches to narrative and discourse. (shrink)

The goal of this article is to offer a new model for the study of ocularization in film grounded in the semiotic pragmatism of Charles Sanders Peirce. We first present a literature overview addressing the state of research regarding the theorization of ocularization in film studies. Second, we discuss Peirce’s three universal categories (Firstness, Secondness, and Thirdness) on which our model will be based. Third, we argue how the theme of ocularization in film, as outlined in the first part, can (...) be theorized anew through these categories. This will result in the introduction of a nine-field matrix that will allow us to systemize all kinds of instances of subjectivity in cinema. Lastly, we will demonstrate the empirical usefulness of this model by illustrating each of the matrix’ nine categories through a discussion of Steven Soderbergh’s film Kimi (2022). (shrink)

In this paper, we address the problematic of film narration and its narrator from a re-reading of Émile Benveniste’s theory of enunciation in open discussion with both the theories of film enunciation that have derived from it, and the cognitive theories that, by discarding it, have tried to take its place. This has led us to a differentiation between two dimensions of the problem of enunciation that are usually ignored: that which separates the act of enunciation and the subject who (...) performs it from that of the textual subjects who inscribe that act in the text. An erroneous understanding of the modes of enunciation of story and discourse has derived from their ignorance, which has led to reducing the former to a kind of form that derives from the latter, constituting no more than a form of discourse that would hide its basis. A precise enunciative definition of the lie is derived from their conscience. Certainly, there is always a subject of the act of enunciation whose traces can be recognized in the materiality of the statement. But there is a properly ontological distance that separates them – as material traces – from the enunciator, as a purely formal textual figure that, by being that, may or may not be present in the text. In this way, the Benveniste’s affirmation can be sustained according to which the story, the pure mode of the narrative, so to speak, is characterized by the absence – not the erasure, nor the invisibility – of any enunciator. (shrink)

“Unraveling Braid” analyzes how unconventional, non-linear narrative fiction can help explain the ways in which video games signify. Specifically, this essay looks at the links between the semiotic features of Jonathan Blow’s 2008 puzzle-platform video game Braid and similar elements in Georges Perec’s 1978 novel Life A User’s Manual, as well as in other puzzle-themed literary precursors. Blow’s game design concepts “dynamical meaning” and “game play rhetoric” are explained in relation to a number of Braid levels; along side this analysis (...) is a parallel examination of the relationship between puzzle-makers and puzzle-solvers in Life A User’s Manual, revealed from a close reading of textual and organizational elements of Perec’s novel. Ultimately, Braid and Life A User’s Manual are shown to draw upon the same signifying processes, which are understood by their authors to operate within an implicitly communicative model. “Unraveling Braid”develops this model by positing a theory of storytelling in the imperative mood, in which the representation and arrangement of objects in the visual/organizational space of the text or game world becomes a fundamental rhetorical technique and meaning-maker.This technique signal show the reader/player is meant to progress through the work and interpret it as narrative, telling the reader/player what to do (but not necessarily how to do it). An understanding of “imperative” storytelling, this essay concludes, allows for a discussion of games and other media that denies neither the importance of player interactivity nor that of authorial design. (shrink)

This article develops a biosemiotic ´hyper-narrative model´ for the purposes of investigating emergent motor behaviors. It proposes to understand such behaviors in terms of the following associations: the organization of information acquired from the environment, focusing on narrative; the organizational dynamics of epigenetic mechanisms that underly the neural processes facilitating the processing of information; and the evolution of emergent motor behaviors that enable the informational acquisition. The article describes and explains these associations as part of a multi-ordered and multi-causal generative (...) principle of biological phenotype emergence that supersedes the theory of the arbitrary coding of life. Preceeding from narrative’s operations in a biological dimension, the article presents scientific research dealing with the associations of action-oriented organization of narrative information and underlying psychological and physiological dynamics and depicts the relations with a distributed multi-directional mapping dynamic. The article presents the explanatory implications of such a hyper-narrative dynamic model on an example of emergent motor behaviors – bruxism. Central to this discussion is the exploration of the possible mechanisms of emergence and etiopathogenesis of bruxism, based on its neurobiology. The article takes the perspective that complex systems dynamics themselves with a tendency to narrative form are found not to be underlain merely by arbitrary coded mechanisms but, rather, biological neural networks that render context-dependent bio-informational mapping analogous to that of the narrative possible. (shrink)

The most surprising conclusion of our analysis is that videogames can be most effective in generating suspense not by highlighting their unique ability to be interactive, but, to the contrary, limiting interactivity at key points, thereby turning players into helpless spectators like those that watch films. Discovering this technique in video games allows us to turn our attention back to film, where we are able to highlight a previously ignored feature of viewer film interaction, namely, helplessness.

In this article I aim to shed light on the question of whether aesthetic experience can constitute practical knowledge and, if so, how it achieves this. I will compare the approaches of Nelson Goodman and Edmund Husserl. Both authors treat the question of which benefits aesthetic experience can bring to certain basic skills. Though one could argue together with Goodman that repeated aesthetic experience allows for a trained and discriminating approach to artworks, Husserl argues that by viewing aesthetic objects we (...) can learn to perceive in a more undiluted fashion and to qualify our own perceptions against the backdrop of the conceptual framework that shapes our everyday experience. As a consequence, aesthetic experience is not to be regarded as something that only contributes to a normatively loaded involvement in the distinct field of the ‘aesthetic’. Reading Goodman with Husserl and vice versa, I will argue in support of a practical aesthetic knowledge account that mediates cognitivist-constructivist and phenomenological concerns and can thus overcome some of their respective shortcomings. The account I present is useful for understanding the practical value of aesthetic experience in and beyond the confined field of the arts. (shrink)

In this article, I first address the question of how musical forms come to represent meaning—that is, the semantics of music—and illustrate an important conceptual distinction articulated by Leonard Meyer in Emotion and Meaning in Music between absolute or intramusical meaning and referential or extramusical meaning through a critical analysis of two recent films. Second, building examples of scholarship around a single piece of music frequently used in film—Samuel Barber's Adagio for Strings—I follow the example set by Murray Smith in (...) Film, Art, and the Third Culture and discuss the complementary approaches of the humanities, the behavioral sciences, and the natural sciences to understanding music and its use in film. (shrink)

Referring to Bauman’s concept of “liquid modernity”, this paper aims to discuss the new film theory that has emerged from the digitalization of cinema. The concepts of perceptual reality and elastic reality constitute the two most important parts of the theory. Bauman argues that contemporary modern societies are “liquid” because of their dynamic character. Although contemporary societies are in constant movement, he indicates that they lack certainty and borders, and flexibility and uncertainty become prominent instead. The digital cinema that Belton (...) has defined as “a false revolution” is nothing but 1’s and 0’s. The key concept here is CGI. Manovich points out that we have arrived at a digitally transformable reality that depends on computer programs and which is beyond photographic reality due to the digitalization of cinema: This is elastic reality. The second concept in the theoretical discussion of digital cinema through visual effects is brought by Prince : "Perceptual realism". This paper opens a theoretical debate through CGI examples and is based on the argument that Bauman's concept of “liquid” constitutes a social and cultural background for digital theory. (shrink)

That the same story can be told in different media is one of the fundamental claims of narratology. Claude Bremond famously listed verbal narrative, novels, theater, movies and ballet among potential vehicles for story. He thus prepared the ground for narratology’s future as a discipline engaged in narrative research across media, in principle including single still pictures. However, narratological research concerned with pictorial narrativity generally proceeds from the assumption that although single pictures may evoke or imply stories, they are unsuitable (...) for storytelling in a strict narratological sense. Focusing on the key issue of temporality, this essay will show that a single still picture may indeed tell “a story proper” and can thus be regarded as a narrative, even according to a narrow definition. (shrink)