Doing theology with children, in a systematic and focused way, is a new practice. This article contributes to this theological practice by examining its emergence, nature and mission and proposing multimodal narrativity as a practical theological methodology for doing such theology. The article argues, from a practical theological standpoint, that doing theology with children should be understood as a synodal event – a journeying together with children about their faith; as a way of seeing the mysteries of God (...) through the eyes of the child and of encouraging a robust understanding of God and God’s plan for humanity and the entire creation; and as a way of seeing the faces of children and hearing their voices, thereby accounting for their suffering and hope. Children themselves are sources and disruptors of hope. The use of multimodal narrativity creates space for these narratives and disruptions of hope and encourages children to theologise their experiences in the midst of their different communities. (shrink)

Name der Zeitschrift: Semiotica Jahrgang: 2015 Heft: 207 Seiten: 583-606.

Literary narratives are well recognised for their power to foster engagement with complex social themes. Transmedia narratives, which present the same story in different media, can help advance both critical multimodal discourse studies and multiliteracies pedagogies. To harness this potential, we need to develop methods for systematically relating media affordances to discourse-semantic patterns and the broad social themes these patterns construct in narratives, and ensure these methods build on the knowledge learners bring to the classroom. This article introduces a (...) social semiotic method for analysing transmedia narratives and illustrates its ability to reflect the persuasive power of narrative and build on young children's critical multimodal awareness. This is achieved through a case study comprising data from three adaptations of the same award-winning narrative - animated film (Joyce, W. (Producer), Joyce, W., & Oldenburg, B. (Directors) (2011). The fantastic flying books of Mr Morris Lessmore [Motion Picture]. Moonbot Studios), interactive app (Moonbot Studios. (2011). The fantastic flying books of Mr Morris Lessmore (Version 1.4). [Mobile Application Software]), and traditional-format picture book (Joyce, W. (2012). The fantastic flying books of Mr Morris Lessmore. Illustrations by William Joyce and Joe Bluhm. Moonbot Books) - and mother-child interactions with the book and the app. (shrink)

This paper contributes to the Business Ethics literature by unpacking the multimodal construction of moral narratives in popular culture and its portrayals of organizations and organizational roles. Understanding such portrayals and their construction is crucial to Business Ethics scholarship because they shape organizational imaginaries, influencing understandings and expectations of the ethical/moral responsibilities of organizations and the actors within them. In particular, we study the construction of moral narratives within a reality TV show that focuses on immigration and border control (...) at an airport. We find that the immigration officers are depicted as rational and heroic figures whilst the travellers are presented as emotional and potentially dangerous characters. Our analysis highlights how this is achieved via five multimodal editing dimensions—the structure of interactional scenes, the ability to address the camera, the narrator’s comments, the visual and music effects—that are key in constructing clearly defined personae. We show how, through the intersubjective construction of clear-cut characters, the show downplays the moral complexity of its content. Portraying immigration officers as heroic, while presenting travellers as potentially dangerous, allows for a silencing of any ethical questioning of immigration officers’ organizational practices. (shrink)

This study investigates how COVID-19 advice is creatively delivered in a one-minute video produced by the Taiwan Centers for Disease Control in February 2022. It examines metaphors in verbal, visual, and multimodal modes, and illustrates how such metaphors interact with multimodal narrativity. Drawing on the insights of studies on multimodal metaphors, this paper seeks to identify which are the most pervasive metaphors or what dominant metaphor, if any, is used in the video. It finds that the (...) metaphorical mappings between coping with the covid pandemic and handling olympic weightlifting are represented across modes and that the creative delivery of COVID-19 advice is woven from a warp of metaphors in various modes and a weft of narrativity across modes. Such metaphorical creativity is underpinned by the semiotic flow that features four interconnected configurations: moving between metaphorization, literalization, and re-metaphorization; somehow blurring the source-target boundary; expanding the range of functions that the multimodal representation can serve; and initiating a metaphorical thought from one or more contextual factors. (shrink)

Pantomime has long been considered distinct from co-speech gesture. It has therefore been argued that pantomime cannot be part of gesture-speech integration. We examine pantomime as distinct from silent gesture, focusing on non-co-speech gestures that occur in the midst of children’s spoken narratives. We propose that gestures with features of pantomime are an infrequent but meaningful component of a multimodal communicative strategy. We examined spontaneous non-co-speech representational gesture production in the narratives of 30 monolingual English-speaking children between the ages (...) of 8- and 11-years. We compared the use of co-speech and non-co-speech gestures in both autobiographical and fictional narratives and examined viewpoint and the use of non-manual articulators, as well as the length of responses and narrative quality. The use of non-co-speech gestures was associated with longer narratives of equal or higher quality than those using only co-speech gestures. Non-co-speech gestures were most likely to adopt character-viewpoint and use non-manual articulators. The present study supports a deeper understanding of the term pantomime and its multimodal use by children in the integration of speech and gesture. (shrink)

The 9/11 attacks in the USA had profound political consequences at both domestic and international levels. Specific and controversial policy developments were pursued requiring substantial legitimation to find acceptance. A prime example was the USA PATRIOT Act, which was passed in the immediate aftermath of 9/11 and subsequently received considerable critique due to the sweeping nature of its redefinition of what was acceptable in the cause of ‘fighting terror’. The media, and their construal of events and policies, played a significant (...) role in the necessary process of legitimation. In this paper, we explore how one particular area of the media, the superhero comic book, was also active in this regard. By focusing specifically on the multimodal meaning construction within Marvel's Civil War comics series, we suggest how a close multimodal discourse analysis can shed further light on the mechanisms by which particular discourse contexts of public opinion are propagated. (shrink)

This paper presents an analytical framework for analyzing how multimodal resources of emotion expression are semiotically materialized in discursive interactions specific to political discourse. Interested in how political personae are emotionally constructed through multimodal meaning-making practices, our analysis model assumes an interdisciplinary perspective, which integrates facial expression analysis – using FaceReader™ software –, the theory of emotional arcs and bodily actions (hand gestures) analysis that express emotions, in the analytical framework of multimodality. The results show how the (...) class='Hi'>multimodal choices that political actors make during discursive interactions allow them to build their political brand and make connections with the audience on an emotional level. (shrink)

Multimodal discourse analysis offers a novel lens for the study of legal discourse. Within the closing arguments of a trial, prosecution and defense attorneys utilize various multimodal resources to present evidence, articulate opinions, and adopt stances to achieve their communicative goals. This research focuses on the closing arguments in the criminal trial concerning the death of George Floyd to analyze the multimodal representation of the closing arguments delivered by both prosecution and defense attorneys. It employs the analytical (...) framework of the attitude system and paralinguistic typology proposed by Martin and colleagues, and uses the UAM Corpus Tool and Praat to qualitatively annotate and quantify the linguistic and paralinguistic information. The findings reveal that these attorneys employ different multimodal resources, including language and paralanguage, to convey their attitudes towards the case’s participants. This leads to the construction of competing narratives, shedding light on how justice is seen to be done. (shrink)

The paper examines selected aspects of the defence closing argument in a highly publicised criminal trial to illustrate the orchestration of various semiotic resources in legal persuasion and to explain their role in the creation of meaning. The study demonstrates that closing arguments are multimodal performances whose persuasiveness results from the combination of modes (speech, image, video, gaze, gesture, posture, proxemics) which contextualise and strengthen one another, rather than language alone. Drawing on earlier research into multimodality, courtroom rhetoric and (...) proximity in disciplinary genres, the analysis centres on the ways in which the defence counsel controls the rhetorical features of his narrative and constructs himself and the audience as people with similar understandings and goals. The study specifically demonstrates how the counsel constructs the proximity of commitment, the proximity of membership and the proximity of experience. It explores such facets of proximity as: organisation, argument structure, credibility, stance and engagement, and identifies key rhetorical strategies used to achieve the intended communicative effect. The analysis clearly shows that the persuasiveness of the counsel’s performance depends on the synchronisation of a range of meaning-making resources, which, if used in isolation, would result in a much less engaging argument. (shrink)

Adult-infant early dyadic interactions have been extensively explored by developmental psychologists. Around the age of 2 months, infants already demonstrate complex, delicate and very sensitive behaviors that seem to express their ability to interact and share emotions with their caregivers. This paper presents 3 pilot studies of parent-infant dyadic interaction in various set-ups. The first two present longitudinal data collected on two infants aged between 1 and 6 months and their mothers. We analyzed the development of coordination between them, at (...) the motor and at the vocal level. The 3rd pilot study aims to explore interpersonal coordination in both vocal behavior and motor activity for one infant and his mother at 2, 4 and 6 months. These pilot studies however leave a number of questions open concerning developmental changes and infants’ progressive mastery of interaction. We identify areas worth examining and try to tease out specific issues that may help develop new methodological pathways for the study of early naturalistic social interaction. We assume that a continuous, rather than discrete, approach would better capture the changes taking place in the various communicative modalities, while also displaying each dyad’s specificity and the narrative dimension of social engagement between infants and caregivers. (shrink)

This case study extends the findings of Pickering et al. 2009 to the domain of conversational humor. We find that, as was the case in humorous narratives, conversational humor is not marked by higher pitch or volume, increased speech rate, or significant pauses. Unlike narrative humor, conversational humor is not produced at a lower pitch and slower rate than non-humorous parts of the text. We find that smiling and laughter tend to occur with humor.

This study focuses on a series of videos aimed at teacher recruitment in Singapore and how they are used as an ideological tool for persuasion. By adopting a multimodal critical discourse analysis approach to focus on affect, it examines how these videos create and promulgate the ideology of an ideal teacher as one who is caring, encouraging and supportive of students. The analysis shows how affect is not only embodied in and performed by the primary protagonists in the video (...) narratives through their action, facial expression, posture and speech. It is also evoked through various secondary meaning-making modes, such as focus, angle, lighting, background music and setting, through which the narratives unfold. More importantly, it demonstrates how affect is used not only as a means to arouse and engage viewers’ sensibilities but also as a persuasive strategy to manufacture and manage particular social and economic realities in contemporary society. (shrink)

“The journey (the [filmic] narrative) is made by the traveler (the viewer) step by step, pebble by pebble, cue by cue.”Flashbacks in Film: A Cognitive and Multimodal Analysis is devoted to explaini...

Over the last fifty years there has been much discussion about the value of narrative in the production of historical knowledge whereby it is generally assumed that “narrative” is a given and that the only thing at issue is its epistemological value. This article critically examines this assumption. It shows how conceptions of “narrative” have mutated in response to changes in cultural practice and, as importantly, how they have been implicitly modeled on the particular medium envisaged for telling stories: the (...) stand-alone monograph. The belief that history's natural form is a book written by an individual historian has thus informed most discussions of narrative in the twentieth century, meaning that the primacy of language, the autonomy of the author, and the finished, self-contained character of the work have been taken for granted. The “naturalness” of the stand-alone monograph can no longer be taken as a given, however, in the new media ecologies. Digitization and the internet offer new technologies for producing and disseminating historical knowledge and, in the process, present both opportunities and challenges to professional historians. Beyond their practical implications, the digital media also provide a new theoretical model for viewing historical narrative in terms of its social production by multiple agents across different platforms, and this changes our understanding both of past and of future practices. (shrink)

This study addresses the issue of how religious authority is negotiated and redefined in the age of digital media, focusing on the case of Raja Zia ul Haq, a Pakistani Muslim cleric. Utilizing Multimodal Critical Discourse Analysis, the study posits that Zia ul Haq’s strategic semiotic choices in attire and symbolism serve as calculated maneuvers to navigate complex dialogues of power, identity, and cultural capital. The findings reveal that his appropriation of biker club symbolism disrupts traditional paradigms of Islamic (...) clerical authority in Pakistan. These choices resonate with a younger, digitally savvy audience and function as a form of religious rebranding. The study argues that Zia ul Haq’s semiotic choices challenge monolithic interpretations of Islamic authority, thereby opening new avenues for religious engagement and interpretation. The significance of this work lies in its transnational implications, offering a counter-narrative that challenges prevailing stereotypes about Islamic scholars and suggests new paradigms for understanding religious authority in a globalized world. (shrink)

Atypical sensorimotor developmental trajectories greatly contribute to the profound heterogeneity that characterizes Autism Spectrum Disorders. Individuals with ASD manifest deviations in sensorimotor processing with early markers in the use of sensory information coming from both the external world and the body, as well as motor difficulties. The cascading effect of these impairments on the later development of higher-order abilities underlines the need for interventions that focus on the remediation of sensorimotor integration skills. One of the promising technologies for such stimulation (...) is Immersive Virtual Reality. In particular, head-mounted displays have unique features that fully immerse the user in virtual realities which disintegrate and otherwise manipulate multimodal information. The contribution of each individual sensory input and of multisensory integration to perception and motion can be evaluated and addressed according to a user’s clinical needs. HMDs can therefore be used to create virtual environments aimed at improving people’s sensorimotor functioning, with strong potential for individualization for users. Here we provide a narrative review of the sensorimotor atypicalities evidenced by children and adults with ASD, alongside some specific relevant features of IVR technology. We discuss how individuals with ASD may interact differently with IVR versus real environments on the basis of their specific atypical sensorimotor profiles and describe the unique potential of HMD-delivered immersive virtual environments to this end. (shrink)

The epidemic outbreak of the coronavirus has meant a sudden, temporary ceasing of activities as we knew them. The health crisis has led to a social and economic crisis, and these circumstances have revealed solidarity on a global scale. In moments of separation, when culture has brought us closer together, the global phenomenon of charity songs has emerged, generating financial aid for scientific research and care for the most vulnerable people. This work focuses on a charity song turned into a (...) hymn, a narrative poem in the first person that tells everyone's common story, “Aves enjauladas” by the Spanish singer-songwriter Rozalén. This paper carries out a linguistic, stylistic and audiovisual analysis of this multimodal event, which has been transmitted through a ‘lyric video’ and spread in a vertiginous way on digital platforms and social networks, reaching millions of views. Ultimately, the paper analyses the spiritual and material impact, the body and soul of this living poem, taking a still photograph of the artistic recreations and musical, visual, pictorial and pedagogical ‘echoicities’ of this work, as well as appreciating its material socio-economic repercussions in the real lives of families at risk of exclusion. (shrink)

Combining textual, visual, and ethnographic approaches to discourse, this article examines a variety of resources employed in the narrative construction of Washington, DC’s Chinatown in a billboard advertisement that de-ethnicizes the neighborhood. Analysis of the linguistic resources of narrative structure, comparative reference, and lexical cohesion reveals how the gentrification of Chinatown is constructed as a positive transformation driven by a corporation. Further, the visual juxtaposition of text with photos and graphics appropriates the community voice and infuses it with corporate identity. (...) This ideological multimodal construction of the transformation of Chinatown is finally actualized in its durable material form and strategic spatial emplacement. Incorporating ethnographic observation and an interview, this article illustrates how the symbolic power of narrative in place-making is interdependent on the economic power of its producer to propagate ideological discourse in the material world. (shrink)

Small things loom large as a distinct category in social and cultural analysis. However, the social construction and effects of this idiom of scale commonly remain vague and underexplored. Bringing the literature on quantification in conversation with the literature on scale-making, this article offers a theoretically-informed analysis of how smallness consolidates as a publicly salient social attribute, and how it feeds collective narratives. The empirical focus is on American Jewry – an ethnoreligious minority group whose leaders and experts have invested (...) in its quantification, including its representation as a small population. Drawing on a variety of texts and images, as well as on interviews and fieldwork, I show that American Jewish research bodies and public figures engage in a myriad of comparative arithmetic exercises and spectacles of scale to assert the smallness of the population. Deploying smallness as a generative narrative tool allows them to engage with the ambivalences implicated in the American-Jewish post-Holocaust, minority, and diasporic experience. In particular, exercises around notions of numerical negligibility, disproportional success, and numerical inferiority elicit protean narratives around endangerment, power, and a questioned diasporic future. The broader theoretical intervention of this article is to offer scalemaking as a valuable prism for understanding the narrative potency and poignancy of arithmetically-based constructs such as smallness. Instead of emphasizing the assumed epistemological strengths of numbers, this article considers the narrative work that statistics do when they lend themselves to multimodal scaling. It argues that through scaling, statistics are infused with perspective, relevance and meaning, descriptively and prescriptively. (shrink)

Comics are complex multimodal documents that make for intriguing materials to analyze with computer vision and computational linguistics. This review summarizes the growing developments in computational modeling which have been progressing to analyze visual narratives across their various substructures.

This article provides support for the argument that horror media “works” by activating evolved cognitive and affective systems that are flexibly tailored to local socio-ecological contexts. Guided by previous work using evolutionary theory to study horror literature (e.g., Clasen 2012, 2018, 2019), I investigate horror manga’s popularity and international market, which indicate a cross-cultural preoccupation with horror transmedia that is expli­cable in terms of the form’s ability to target evolved psychological systems. Specifically, these multimodal texts elicit the evolved emotions (...) of anxiety, fear, and disgust in response to culturally specific and evolutionarily relevant narratives, characters, antagonists, and environments. Thus, horror manga reflects the myths, folklore, and religious traditions of Japanese society in addition to salient ubiquitous evolutionary threats such as predators, antisocial conspecifics, and infectious diseases. (shrink)

This study examines the dual discursive articulation in the Instagram posts of the street library community, Literasi Trotoar (LIAR), in Purwakarta, Indonesia. The study focuses on two groups of posts: those directed towards the LIAR community and the general public, and those aimed at the Indonesian government. To analyse the posts, this study adopts ‘Multimodal Critical Discourse Analysis (MCDA),’ which focuses on both the language and visual elements of the posts. The findings reveal the presence of two integrated and (...) inseparable types of articulation within the posts. Firstly, articulation serves as a discursive tool to persuade the public to embrace the ideology of anarchism within the context of in-group power relations. This articulation is strategically employed for positive in-group representation, in-group ideological glorification, subject interpellation, ideological legitimation, and power formation. Secondly, articulation functions as a discursive mechanism to challenge the authority of the government within the context of out-group power relations. This articulation is strategically utilized for negative out-group representation using a narrative model of populism, out-group ideological debasement, subject resistance, ideological delegitimization, and power exertion. This study proposes a model termed ‘dual discursive articulation,’ which integrates two discursive objectives: persuasion and resistance. (shrink)

This article analyzes discourse, narrative, and video editing to introduce the concept of ‘historical coherence’. This concept is an expansion of Alessandro Duranti’s notion of ‘existential coherence’ – the construction of an embodied narrative connecting a candidate’s past with his or her decision to run for office – from his 2006 study of a candidate’s campaign speeches. This study examines how language and communication are linked with historical narratives through the use of multimodal stories in which US political commercials (...) link candidates’ present actions with historical events, dynamics, artifacts, and/or figures. This ‘historical coherence’ is constructed through the following strategies: constructing a narrative in which popular historical figures or archetypal figures are in agreement with the candidate; preempting charges of lack of historical coherence; and presenting historical restrictions to freedom and casting the candidate, or the candidate’s party, in general, as a preventative from future calamities and transgressions to freedom. (shrink)

Cross-cultural communication is about generating dialogical positions across cultural barriers. Communication is achieved when participants are able to construct meaning across varied sign systems. Oral communication makes use of a wide range of signs that contribute to make meaning, from eye contact to gestures and speech. In written/printed communication, together with the reproduction of visual images through painting, photography, etc., the most important resource is the textual format. Texts are grounded on a cognitive deictic basis and work alongside the cause-effect (...) relationship that links events in human working memory. This relationship frequently posits a hierarchical dependency between the understanding of visual images, textuality and narrativity. Although texts are vehicles of contextualized information and cultural positions are often presented in a historiographical way, culture is not just about textuality; it is also about multimodality, that is, the use of symbolic forms that employ simultaneously several material-semiotic resources to create a kind of common framework of socially acceptable behaviours and customs which arise both from individual personal experiences and from shared cultural and ethical values. Signs areused to represent these values and, in turn, these representations affect their further emotional interiorization. This creates particular strong moments of remembrance and recollection in human memory. In addition, the production, distribution and reception of culture has always been dependent on changing material formats and technologies, from manuscripts to printed books, from mural painting to photography, and from architecture to virtual recreations on a computer screen. In recent years, the interest in intertextual and intermedial configurations is mostly due to the growth of hypermedia paradigms, and is reflected in the increasing number of disciplinary publications and conferences devoted to the topic. This paper shall explore the reasons behind a renewed interest in intertextual and intermedial manifestations in cross-cultural communication. (shrink)

Within the framework of Viewpoint Spaces (Dancygier, Barbara. 2012. The language of stories: A cognitive approach. Cambridge: Cambridge University Press), this paper investigates viewpoint interactions in a mobile game’s plot to show how the game’s structural framing leads to meaning construction, specifically the construal of irony. The notion of (meta-)Ground Viewpoint Space is proposed not only to provide a generalized account of a global mental space where local spaces and viewpoints relate to one another, but also to elucidate how the (...) invoked genre-specific expectation makes a significant meaning contribution to the player’s overall construal of the game. This study presents a case study of the mobile game Liyla and the Shadows of War (Abueideh, Rasheed. 2016. Liyla and the Shadows of War) as a viewpoint phenomenon whose construal involves the interaction of multiple viewpoints. The game depicts the consequences of the 2014 Gaza conflict from the perspective of an unnamed Palestinian father struggling to escape the war zone with his daughter Liyla. It deviates from prototypical games in that it is impossible to complete the expected narrative, regardless of the player’s skill, although its ostensible goal is to let the protagonists survive and escape to a safer place. The mismatch between the player’s goal to clear all the stages, the character’s goal to survive, and the developer’s goal to convey a message is a source of ironic meaning, and this study focuses on how the network of multiple viewpoints – of the game developer, the character, and the player – constructs the intended meaning for players. (shrink)

The importance of the gesture and the glance in oral communication face-to-face are undeniable, however, the communication skills of children with Specific Language Impairment has been measured, primarily preferring a description of its language orally or has been considered the verbal and non-verbal in an isolated manner. Given this, the objective of this study was to describe and interpret the use of the word, gesture and glances in narrative discourse in children SLI from a multimodal perspective, that allows to (...) observe not only the use of these resources, but also their integration. With a retelling task with support of visual images, oral productions of six Chilean children between 5 years and 5 years 11 months were analyzed. The findings indicate that children construct narratives from a combination of verbal and non-verbal resources and their number increases when the character’s actions are described. Also, it was possible to account for two instances of multisemiotic meaning construction through an assembly between different elements, in coordination or integration. These results corroborate previous findings that show that these children replace some of their problems with oral language through gestures and looks, which allow them to increase the communicability of their stories. (shrink)

ABSTRACT Literature, as the art of words, presents its text in different forms and languages. Whether through its humanizing potential or, still, through its narrative quality, it reaches readers and offers them a plurality of tools to create texts, using established works as arguments. After all, literature holds within its scope narratives that are true treasures arranged as a testament for all of humanity. Thus, in this article, our goal is to analyze the literary work A verdadeira história de Chapeuzinho (...) Vermelho [The True Story of Little Red Riding Hood] (2020)1 by Agnese Baruzzi and Sandro Natalini, presented as a book-object with a keen materiality. We will seek to understand the characteristics of the work that promote literary aesthetic enjoyment, moving the work away from a didactic and moralizing perspective. To do so, we will comprehend the specificities of the verbal text, the imagery, and the materiality characteristics that pervade the work, understand the techniques, tools, and proposed interactions, as well as recognize the book’s multimodal capacity. (shrink)

This paper employs Mikhail Bakhtin’s concept of heteroglossia as a frame­work to interpret internal tensions within contemporary digital games. To that end, I propose to acknowledge the multimodal character of entertain­ment software, with audial, visual, haptic, spatiotemporal and systemic elements of a game in constant interaction. But to properly understand said tensions — frequently dubbed “dissonance” in game criticism — it is im­portant to acknowledge the complex multimodal structure of games that attempt to utilize culturally-rooted ways to describe (...) the world, sometimes trying to combine several such ways at once. As a result, ‚game-languages‘ are born: ways to utilize all game components to cover the specificity of certain narrative genres, to explain the nature of the world in terms con­sistent with its ideological stance. Quite often, one game combines several game-languages, and their mutually exclusive ideologies are a source of tension and dissonance. To illustrate the issue, I describe how three pri­mary game-languages of Uncharted 3 — the language of Adventure, the language of Heroics, and the language of the Traditional Game — compete to describe an armed conflict to the player. (shrink)

Extending narratological analysis to media as varied as graphic novels, photography, television, musicals, computer games and advertising, the essays gathered in this volume address some of the most fundamental questions raised by the medial turn in narratology: how can narrative meaning be created in media other than language; how do different types of signs collaborate with each other in so-called multimodal works; and what new forms of narrativity are made possible by the emergence of digital media.".

Summary In natural face-to-face interactions, verbal communication always occurs in association with expressions of nonverbal behavior. The functional contribution of these multimodal aspects to the meaning of the message and to its effects fulfils multiple communicative functions that differ according primarily to the speaker’s intentions, to the interpersonal relations between the speaker and the addressee, to the nature of the message, and to the context. When nonverbal behavior is reproduced in a written literary text, it becomes functional to the (...) textual and narrative process as it serves as a signifier for the reader. A fictional character is never fixed and unchanging. Through writing, each author encourages the explicit or implicit evocation of a multisensory world, which readers decode and reconstruct, inevitably conditioned by their cognitive and cultural environment. In this paper, we refer to Salinger’s famous novel The Catcher in the Rye to analyze the literary valence of representing the characters’ multisensory communication, focusing on the core relationship between the explicit and the implicit parts in reconstructing the psychological depth of a literary character. (shrink)

ABSTRACT This article seeks, from a growing production of works in which literary narratives operate as verbal and visual languages in dialogue, to approach the formats widely found in bookstores, libraries, and in the hands of readers: comics and picturebooks. Thinking about the similarities and differences between them, we can understand how multimodal literature transits between the resources of these formats, without losing aesthetic quality and continuity, that is, highlighting the fluidity between them. To this end, we analyzed theoretical (...) references (McCloud, 2005; Nikolajeva and Scott, 2011; Linden, 2011) and observed two narratives that do not reflect the traditional parameters of these formats: In the Night Kitchen (1970), by Maurice Sendak and Are We There Yet? (2016) by Dan Santat. We reflect, therefore, on this confrontation of borders that reveals a need for a broader understanding of literature. (shrink)

Electronic text can be defined on two different, though interconnected, levels. On the one hand, electronic text can be defined by taking the notion of “text” or “printed text” as the point of departure. On the other hand, electronic text can be defined by taking the digital format as the point of departure, where everything is represented in the binary alphabet. While the notion of text in most cases lends itself to being independent of medium and embodiment, it is also (...) often tacitly assumed that it is in fact modeled on the print medium, instead of, for instance, on hand-written text or speech. In late 20th century, the notion of “text” was subjected to increasing criticism, as can be seen in the question that has been raised in literary text theory about whether “there is a text in this class.” At the same time, the notion was expanded by including extralinguistic sign modalities (images, videos). A basic question, therefore, is whether electronic text should be included in the enlarged notion that text is a new digital sign modality added to the repertoire of modalities or whether it should be included as a sign modality that is both an independent modality and a container that can hold other modalities. In the first case, the notion of electronic text would be paradigmatically formed around the e-book, which was conceived as a digital copy of a printed book but is now a deliberately closed work. Even closed works in digital form will need some sort of interface and hypertextual navigation that together constitute a particular kind of paratext needed for accessing any sort of digital material. In the second case, the electronic text is defined by the representation of content and (some parts of the) processing rules as binary sequences manifested in the binary alphabet. This wider notion would include, for instance, all sorts of scanning results, whether of the outer cosmos or the interior of our bodies and of digital traces of other processes in-between (machine readings included). Since other alphabets, such as the genetic alphabet and all sorts of images may also be represented in the binary alphabet, such materials will also belong to the textual universe within this definition. A more intriguing implication is that born-digital materials may also include scripts and interactive features as intrinsic parts of the text. The two notions define the text on different levels: one is centered on the Latin, the other on the binary alphabet, and both definitions include hypertext, interactivity, and multimodality as constituent parameters. In the first case, hypertext is included as a navigational, paratextual device; whereas in the second case, hypertext is also incorporated in the narrative within an otherwise closed work or as a constituent element on the textual universe of the web, where it serves the ongoing production of (possibly scripted) connections and disconnections between blocks of textual content. Since the early decades of early 21st century still represent only the very early stages of the globally distributed universe of web texts, this is also a history of the gradual unfolding of the dimensions of these three constituencies—hypertext, interactivity, and multimodality. The result is a still-expanding repertoire of genres, including some that are emerging via path dependency; some via remediation; and some as new genres that are unique for networked digital media, including “social media texts” and a growing variety of narrative and discursive multiple-source systems. (shrink)

This essay brings together critical perspectives from the discrete traditions of artists’ books and the medical humanities to examine artists’ books by three contemporary artists – Penny Alexander, Martha A. Hall and Amanda Watson-Will – that treat experiences of illness and wellbeing. Through its focus on a multimodal and multisensory art form that has allegiances with, but is not reduced to, narrative, the essay adds to recent calls to rethink key assumptions of illness narrative study and to challenge utilitarian (...) approaches. In particular, it draws attention to the aesthetic and imaginative elements of illness communication by exploring how artists’ books represent lived experiences in a distinctively palpable way and offer an “intimate authority” that extends beyond narrative legitimacy or a form of struggle against the medical gaze. By interrogating narrative’s dominance in medical humanities research, the essay further expands awareness of illness experiences that resist conventional forms of representation (such as chronic illness), and of alternative reflective practices within healthcare education that encourage engagement with both mind and body. (shrink)

Located in Kleinbasel close to the Rhine, the Kaskadenkondensator is a place of mediation and experimental, research-and process-based art production with a focus on performance and performative expression. The gallery, founded in 1994, and located on the third floor of the former Sudhaus Warteck Brewery (hence cascade condenser), seeks to develop interactions between artists, theorists and audiences. Eight, maybe, nine or ten 40 litre bags of potting compost lie strewn about the floor of a high-ceilinged white washed hall. Dumped, split (...) open, the soil mixed with iridescent specks of green, blue and red glitter. On the walls hang large black and white photographic images—negative and positive prints barely clean, hardly sharp, scavenged from the world and presented half processed. On a third wall, hangs a framed golden and charcoal surface. Finally, a huge stain of black dye runs down a wall that descends into a sunken quarter of the Kaskadenkondensator gallery space. The results of a collaboration between Oliver Minder and Walter Derungs reflect on themes addressed in the recent Aesthetics in the 21st Century conference held by the department of English, University of Basel. In particular, the joint show questions how an aesthetic experience may be other than a human-world interaction, hinting at the withdrawal and veiling that objects perform, while demanding that different works engage with each other and play out this game under the non-supervisory eyes of a human audience. Things here are becoming—sometimes it’s a movement towards a more complete ontic whole in a projection of finality, other times it’s a dispersal, an atrophy to rather disarrayed entities. Yet, in the moment and place in which the objects are, we take them as here and now. Let’s get to the material of the stuff that Minder and Derungs have assembled. Oliver Minder employs organic materials—potting earth, cuttlefish ink secretion, rice, and insects; yet his works hardly seem natural in the sense of a harmonic relation between material and the form they are constrained into, the objects they are compelled to occupy. For the substrates on, through, or within which these natural materials are mediated are harshly inorganic substances—Plexiglas, safety glass, acrylic resin, boat varnish, spray paint. Minder, thus, generates a conflict within the materiality of his work between two polar opposites—from the human perspective—in the contiguity of materials engaging with each other in a thrown together formation that nonetheless appears to keep the materials and the objects they make in happy accidental relation to each other. Let me expand a little: on the one hand, the things Minder makes query our belief in substance as belonging in a particular domain, an environment suited to precisely that stuff. We are focused on thinking categorically where things belong, both in terms of natural place and natural relations they might extend to each other. Hence, we are driven to think of environment and order. On the other hand, while extracting things from their conventional place and arranging them within awkward constellations that we as observers feel isn’t quite right, Minder manages to persuade the viewer that the materials are nonetheless “doing alright.” So, simultaneous to our awareness of the appropriateness of the world according to our global notions of accord and uniformity, we are forced to accept the local discrepancies of disassociation, inappropriateness and misplacement. The tension between these two vectors generates a vacillation that intensifies Minder’s work. In the Kaskadenkondensator works, then, it is vital to first consider the material of Minder’s works: potting compost—what is it doing here in the first place?—seems to enjoy being “polluted” by sparkly glitter. Glitter has a long history, used in cosmetics by the Egyptians, and in cave paintings, too, earlier made of beetle shells and mica, nowadays glitter is made of plastic cut to minute sizes down to 50 microns. So what’s the point here? Well shiny bits of dust-like material are actually generated from ultra-thin plastic sheets and are normally cut into shapes that fit contiguously on a two-dimensional surface: squares, triangles, hexagons etc. What then appears to be totally random, chaotic decoration, is actually an array of extremely regular identifiable objects. 1 Of course scale has a role to play here. The minuteness of the dimensions means the regularity is beyond our recognition—all we see are the twinkling surfaces of the multi-coloured grains of plastic. In contrast, potting compost, which appears to be unary in its dull unresponsive lumpen disposition, is in fact an amalgam of a variety of organic and inorganic materials: peat, bark, mushroom compost, and sand and perlite, and should perhaps be more proactively exciting to the viewer because of this complexity. Yes; we can (if we care to) identify different textures, different sizes in the mixture of the medium, but I claim that we tend to treat this organic/inorganic assemblage as just a simple substance. Further and crucially important to our consideration here is that the medium is partially contained, but also partially spilling from the split plastic bags in which it is sold in garden centres. That the compost spills out gives it a movement suggesting life; that the bags are cast here and there in a random fashion by Oliver Minder, lying like discarded carcasses, hacked torsos, dismembered bodies, suggests a horrific murder scene, a Tatort. 2 The glitter flourishes in the medium, lies happy and decorative; that is simply what it does, how it is—always already broken, made-for-scattering, designed to be incomplete; the taken-to-be-natural compost, in contrast, cannot rest content but is forced to speak to us metaphorically in its abject overflowing of violence and rupture. While Oliver Minder’s elements in the installation direct our attention to material, Walter Derungs’ works raise questions around seeing and making in photography. There is a simultaneous flicker between the materials and their use in the production of a sense making representation, on the one hand, and on the other the very notion of what is worthy of picturing, framing, representing on the other. Derungs' images are of non-places. Ranging from archaic decaying monster buildings, buildings that have gone far beyond the ravages of a time that we can safely associate with the genteel preservation of a Bernd and Hill Belcher post-industrial decline, to the background “noise” of an urban world that is falling apart, and to which we most of the time seem to pay little attention, and habitually just pass by. In this respect, their non-ness differs somewhat from the conventional association of the term with Marc Augé 3 , where emphasis is on the specifics (if we do care to examine them for their non-placedness) of the spatial or place containment in which movement between multimodal coordinates occurs in supermodern late capitalist post-urban spaces. In other words, we might be in an Augéian non-place and (not) experience—be impervious to—that environment, or we might in Derungs’ manner look out from such a position at the “scenery” around us. I claim scenery, as this is what Derungs seems to do with his partial photography—construct a very purposefully articulated, symmetric, flat world of image. Mostly depopulated, his images construct a space in which the direction of time is uncertain: are these partial structures falling apart, or perhaps terminated in a never-to-be-completed state, or are they a few steps from final completion? Temporal and spatial dimensions figure large in Derungs’ image-making: his world, and perhaps this is in fact the only way for it to be registered photographically, is already image before it is photographed. A key combination of images in this show is a matrix of six black and white negative prints measuring 300 x 215 cm that form the image of a semi-derelict (or is it yet incomplete) church, and adjacent on a perpendicular wall, a single black and white positive print 150 x 250 cm of two bricked-up windows of a late-Victorian industrial building. What are we led to believe that we see here? In the negative print, the conditions of perception 4 are sufficiently reproduced for us to recognise the structure of the building, to distinguish ground and form, to relate some partial elements of narrative, and to recognize symbols such as the alter cross and figure of Christ, a looming crane, a traffic cone, and banks of tiered seating. We piece the image together both from the individual forms which we recognize despite the tonal reversal, and we piece the six prints together as a whole, the matrix of lines between them emphasizing our purview onto the world. While we recognise the forms at work in the image and might possibly relate the negative reversals to other figurations such as Vera Lutter’s camera obscura exposures, we cannot but avoid seeing the partialness of the image in the sponge marks of the developer that was spread by hand across the prints. 5 Derungs’ thus intervenes with our usual conception of photography as the mimetic realist vehicle sine qua non , by exposing the viewer to tonal reversal and incomplete or over developed areas of the print. We thus confront both the idiom of such image making and its raw (chemical) materiality at once in the simultaneity of the recognition of what the image pictures and the recognition that it is in the act of picturing. The church image, taken from the series “BW Negativs 2011,” thus orients us towards how we see things in the world via photographs. The single image of the bricked-up wall presents us with a completely different visuality that relates to a faciality 6 which we cannot easily escape from. We look, or rather try to look with no success, through the face of the windows, through the classic Albertian screen 7 which has already been given to us in the church matrix beside. Yet although we should be able to make more of these concealed windows because they are a positive print, because they are complete, because they approach us on a more realistic scale, reproduced at life size, we cannot. The objects pictured here withdraw from us; furthermore, they merely mock our blindness at not seeing how we look. Blocked up with quite a hint of paned glass behind, one window is blanked out with a white blind, the other simply blankly dark. The apertures look like eyes with teeth in them, or a Dogon mask, or even Man Ray’s Noire et Blanche (1926) if we want to get really perverse. The height of elegant modernist chauvinist beauty thrown against the vacuity of post-industrial decline. Derungs thus catapults us consciously into a world enfolded with and through images, but in such a way that the images themselves become objects that stand resistant to us, impervious to our gaze, indifferent. We—and indeed they—do not attempt to reach out to a real that is beyond, rather the images play in a world that is just theirs, and we can only enter that world if we too submit to their regime: tonal reversal, segmented, partial, inadequate, still, wrenched out of time. In contemplation, in the flood of the image “falling” off the wall, we too become image-object. Perhaps enough has now been said about the works, yet enough can never really be said, we know the image will always exceed the word—let’s accelerate the critique: Derungs’ work continues in a second space partially partitioned from this first room. Opposing three more “BW Negativs” which figure yet more quotidian aspects of the world is Minder’s gold spray paint and cuttlefish secretion mix: things that just shouldn’t work together do in the dialogue between stuff that Derungs and Minder have constructed. Minder makes things; Derungs makes images; together they make objects which inhabit their own world which we can approach and sensually engage with and come to grips with only on those objects’ own terms. This is best summarised by a final work made by Oliver Minder which on a third wall faces these two semi-partitioned spaces. A deep black stain about 100 X 200 cm with streak marks running down a further 2 metres hovers positioned to observe the whole work, and also to be part of this installation, too. This liminal flat suzerain lies in/out of the whole work. The stain of cuttlefish secretion resonates with Derungs’ sponge strokes on the church image; it mirrors the iris of an all-seeing eye; it combines material in situ with the situation itself. Where Minder’s other works have material and medium or substrate upon which the material is exercised, this single black hole is image which sucks everything up into itself. It draws the viewer, who must otherwise look away attentively at the floor work, and imagine horror, or smile at the ironic play of glitter. Look away at the image constructions that suggest how it is we too look to our world. See the play of thing and image in a third area. Or, finally return to the base of the pyramid that triangulates, to realise the stuff-image that unlocks it all for us. Black on white, organic on inorganic, material to substrate, that which in the falling out of one on the other, in its running down the wall simply gives form to both content and expression in one direction, and content and expression to form in another. NOTES In fact, glitter is used as associative forensic evidence: the 20,000 or so varieties are all uniquely identifiable. Joel Sternfeld, Tatorte: Bilder gegen das Vergessen (München: Schirmer/Mosel, 1996). Marc Augé, Non­places: Introduction to an Anthropology of Supermodernity trans. John Howe (London: Verso, 2006). An echo of the uneven paint strokes of light­sensitive chemicals in the paper preparations made by Henry Talbot some 170 years ago in the first sun drawings that also often pictured architectural forms. It was Talbot’s surprising discovery that where a weaker chemical solution was more thinly spread, greater light sensitivity was actualized, yet this virtual image had then to be chemically developed in a second step. Thus, Derungs unevenly finished spongings suggestively trace back to this originary technology (although his sweeps are the stains of uneven development and not those of the initial preparation of light–sensitive material). Umberto Eco, “Critique of the Image” in “Articulations of Cinematic Code” Cinematics 1, 1970. Gilles Deleuze and Felix Guattari, A Thousand Plateaus: Capitalism and Schizophrenia trans. Brian Massumi (Minneapolis: University of Minnesota Press, 2007). Geoffrey Batchen, Burning With Desire: the Conception of Photography (Cambridge, Mass: MIT Press, 1999). (shrink)

Riassunto: Al centro di questo articolo è l’analisi dei fondamenti neurocognitivi dei deficit macrolinguistici, discorsivo-narrativi nello specifico, osservabili nei pazienti affetti da schizofrenia. Tale analisi è condotta in riferimento alle ricerche svolte negli ultimi decenni nell’ambito della psicolinguistica e delle neuroscienze. I risultati di queste ricerche hanno mostrato che alcuni aspetti dei disturbi macroelaborativi che caratterizzano il profilo linguistico dei pazienti schizofrenici possono essere spiegati chiamando in causa i deficit di tre sistemi cognitivi: teoria della mente, funzioni esecutive, memoria semantica. (...) In questo articolo si sostiene che un tale quadro esplicativo vada integrato attraverso il riferimento a un ulteriore processo cognitivo cruciale per l’elaborazione macrolinguistica: la costruzione di scenari. Tale processo è fondamentale per la comprensione e produzione discorsiva in quanto responsabile della costruzione della rappresentazione globale degli eventi del discorso narrativo. Alla luce di queste considerazioni, in questo lavoro si propone che un ruolo cruciale nella spiegazione di alcuni aspetti dei disturbi macrolinguistici nella schizofrenia sia svolto da una compromissione nel processo di costruzione di scenari mentali e si avanza l’ipotesi che tale compromissione sia determinata, a sua volta, da problematiche che agiscono sul piano del funzionamento delle aree cerebrali preposte alla percezione e all’assemblaggio multimodale delle rappresentazioni sensomotorie. Parole chiave: Abilità macrolinguistiche; Costruzione di scenari; Elaborazione discorsiva: Embodied Cognition; Narrazione; Schizofrenia; Percezione; Modelli mentali The role scenario building in the explanation of macrolinguistic disorders in schizophrenia: This article analyzes the neurocognitive foundations of macrolinguistic deficits, specifically narrative, observable in patients with schizophrenia. This analysis is conducted with reference to the investigations carried out in recent decades in the field of psycholinguistics and neuroscience. The results of these investigations showed that some aspects of macrolinguistic deficits of schizophrenics can be explained in terms of impairments of three cognitive systems: theory of mind, executive functions, and semantic memory. In this article, it is suggested that this explanatory framework has to be integrated with the reference to a further cognitive process: scenarios construction. Such process turns out to be critical for discourse comprehension and production as it is responsible for the building of the global representation of events of a narrative. In the light of these considerations, it is claimed that a crucial role in the explanation of some aspects of macrolinguistic disorders in schizophrenia is played by an impairment in the process of constructing mental scenarios. The hypothesis is that this impairment is, in turn, determined by problems affecting the brain areas responsible for the perception and multimodal assembly of sensorimotor representations. Keywords: Discourse Processing; Embodied Cognition; Macrolinguistic Skills; Scenario Building; Narrative; Schizophrenia; Perception; Mental Models. (shrink)

This article focuses on how the human body and body parts such as the legs, abdomen, and torso are conceptualized in Spanish director Pedro Almodóvar's films. The comparative analysis follows a qualitative methodology in which instances of the use of body parts are analyzed within their multimodal, sociocultural, and cinematic contexts. Through camera work and mise-en-scène, the actors' bodies and bodily functions are mapped onto complex cultural, social, and filmic targets within the narrative structure. Ultimately, the author shows how (...) artistic creativity is an activity whose purpose is a reembodiment of the emotion by visual and physical alteration. The new body is an environment onto which traditional views of the body based on folk theories are mapped, and body parts and functions are metonymically highlighted. (shrink)

This study explores the semiotics of humor and political disaffection in the online feedback discourse evaluating party performance in a post-election era in Nigeria’s democratic practice. It examines the incongruities in multimodal digital humor as semiotic resources of subversive play to criticize a political party for its perceived weak program-to-policy linkage. Data for the study comprise some purposively sampled political internet memes which were deployed to express political disaffection at the party All Progressives Congress in the first half of (...) its four-year tenure. The study applies Algirdas J. Greimas’ semiotic theory by drawing upon the notions of narrativity and modalities to read the selected political internet memes, which run profound social commentaries on the anxieties and frustrations of the ordinary citizens in a failing economy, thereby underpinning the thrust of the theory, which lies not only in the signification of texts but also in the signification of the living experience. The study reveals the power of signs evidenced in the deployment of objects, behaviors, practices, images, and symbols within the socio-economic sub/culture of the production of the internet memes to configure backlashes of democratic deficits relating largely to worsening poverty, hunger, struggle for survival, and political cynicism in an emerging democracy. (shrink)

Our contribution is part of the REMILAS project, a research on interactions between asylum seekers and health professionals, with or without interpreters. Here we observe the emergence, expected or not by professionals, of snippets of migration narratives. Our study combines multimodal analysis of interactions (Sidnell & Stivers, 2012) with a critical sociolinguistic perspective (Boutet & Heller, 2007) so as to inform the development of training methods. Our empirical focus will be on interactional moments where the doctor, searching for the (...) information needed to write an expert medical certificate, repeatedly urges the applicant to make certain responses required in it. (shrink)

This article argues that to disrupt legal education in a radical sense, students need to become acquainted with the art of worldmaking and the view that law is a “way of worldmaking”. First, I show that law is a cultural semiotic practice that requires decoding and, for that reason, demands a creative intervention by those that want to know, understand, and do things with law. Altogether this amounts to recognizing the different modes in which law creates, and is part of, (...) worlds. Second, I propose that due to different features of their aesthetic form, comics are a particularly effective medium to place students before the myriad ways in which law and lawyers make and reproduce worlds. Third, I illustrate the argument by exploring how the Saga comic series, through its formal multimodality and narrative and cultural complexity, can make good on that challenge. (shrink)

This article considers scientific data and methods taken as a vocabulary for a visual language of poetics, shaping an artistic practice exploring the liminal poetics of space, time, science and mythology, equally considered. These artworks focus on the moving image as an immersive, architectonic construct, one that makes it possible to blur the boundary between space and time. They are cinematic environments that create a space of spatial and temporal ambiguity, open to the performative role of the viewer in composing (...) the unfolding narrative. The artworks presented here began in the crossover between art and science, technology and anthropology, exploring topics and incorporating methods from each area. Transdisciplinary processes play a critical role in this artistic research. These works reflect cinema approached as a multimodal field of possibilities in which montage motivates movement and focus through this field, creating a participatory composition of sight, sound, movement and memory that immerses viewers by actuating somatic perception. Shape, scale, immersion, interactivity, simultaneity, embodiment, implementation and the manipulation of time create concrete metaphors that echo the multivalent content of the works: a collaboration with 300 tropical spiders to create a Kino, then letting the audience walk freely among them (or the spiders freely among the audience); an immersive environment enacting the space-time of glacial ice to experience the time of a different form of matter as somatosensory experience; a journey through the human history of the Moon, transcending time, political ideologies, realities and cultures as an encompassing field of simultaneous views and sounds; performing a 2000-year-old act of Thessalian magic on the skyline of Hong Kong. Combining the technological tools available to cinema and science, contrasting magnifications and speeds of observation reveal a material poetics beyond appearance. The artworks presented here elaborate the details of cardinal subjects, diving deep into fundamental domains to unravel the cultural implications embedded within the aesthetics of their data artefacts. (shrink)

Collective memories are multiple discursive practices, in which social representations about a common past are used to build and maintain cohesion and identity of groups socio-historically located at a socio-culturally determined moment and to project future in frameworks of rights and dignity. It is understood that the memories articulated to the Colombian armed conflict are diverse: different stories of violence, oppression and resistance of peoples, communities and groups are identified and made explicit. Thirty media narratives distributed in the ElTiempo.com Special (...) “Thirty encounters with peace” (2017) comprise the universe of research. The sample is made up of seven narratives that propose the sense of testimony. The selected format is storytelling, which is built in the special edition of the newspaper as a communication proposal for the reconstruction of the social fabric, within the year after the signing of the Peace Agreement between the National Government and the FARC-EP (post-agreement). The research is nucleated on situations of rights violations linked to the conflict, and the proposals derived from these narratives, as regards the overcoming of the exercises of violence to which they refer. The analysis is assumed from the principles of Multimodal and Multimedia Critical Discourse Studies (MMCDS). The forms of representation in the discourses, their multimodal articulations and the multimedia implications in the production of meanings are articulated; the final aim is to derive sociopolitical consequences of the discursive proposal, constructed and socialized in the narratives of the special edition of the newspaper. (shrink)

I begin with a typology of reasoning and cross it with types of processes. I demonstrate that the thrust of Plato’s Republic is theory-building. This involves the critical and dialectic processes which are paradigms of Platonic methodology. Book I displays abductive analogical reasoning joined by an induction that is embedded in a deduction; hence there is a deduction–induction–abduction chain. In Book VI, Plato constructs a visual model of the divided line, which also displays model-based and abductive hypothesis generation that is (...) essential to theory building. Book VII provides an abductive metaphor model of the allegory of the cave. Both models depict degrees of reality and the ascendency of knowledge. The multimodal model-based allegory has far reaching applications from criminal justice to information systems. I conclude by capturing the narrative of the Republic as a critical and dialectic process of theory building using deductive–inductive–abductive chains, an abductive visual model and an abductive metaphor model. Hence, the Republic is simultaneously a masterpiece of deductive reasoning and a marvel of complex model-based abduction, involving visual models, analogies and metaphors. (shrink)

This paper considers the ways that concepts such as social justice and law were used as semiotic objects-in-tension by a group of five US undergraduates considering law school to make sense of their ideas about entering the discourse communities and communities of practice associated with being a lawyer. This group was made up of undergraduate women who had completed a summer residency program sponsored by the Law School Admissions Council to increase enrollment of students from under-represented groups. Of the five (...) participants, two were US-born; the others immigrated to the US as teenagers; each was aware of her position as multiply marginalized, by gender as well as other factors, including refugee or immigrant status, religious affiliation, sexual identity, and/or association with “at risk” labeling. Data analyzed reflect a 3-year study of their changing perceptions of their relationships to law school discourse communities, using text, interviews, individual video narratives, and informal, face-to-face group meetings. A sociolinguistic approach to multimodal discourse analysis is used to examine the ways that the women, each in a unique way, articulated an increased investment in direct and embodied engagement, lived experience, and personal testimony—not as supplements to doing/being a lawyer, but as necessary and expected practices therein. Over time and through various modalities, they used their vantage point from outside the dominant discourse communities of law to stage social critique and to contest the binary logic and normative criteria that forge the boundaries of exclusion from and inclusion in these communities. Specifically, they resemiotized notions of being a lawyer from the margins in ways that demanded a more fluid and polysemous interpretation of what it means to do ethically rigorous social justice work—hence reworking the relationships between justice and the law and widening the semiotic potential of their own future work. Particularly significant are the ways that semiotic trajectories progressed from an emphasis on what Halliday identifies as textual functions of language to interpersonal and ideational functions. Such a trajectory away from entextualization suggests that voices and perspectives from the margins may be using those imaginary margins tactically as sites from which to contest the boundaries that define whose voices count within the legal system and to contest normative limits on semiotic potentialities for lawyers working toward more just social futures. (shrink)

In company with its sister volume, Arts-Based Research Across Textual Media in Education explores arts-based approaches to research across media, including film and comics-related material, from a variety of geographic locations and across a range of sub-disciplines within the field of education. This first volume takes a textual focus, capturing process, poetic, and dramaturgical approaches. The authors aim to highlight some of the approaches that are not always centered in arts-based research. The contributors represent a variety of arts-based practices and (...) methods, and they weave this marrying of artistic and scientific expertise and experience into the fabric of the chapters themselves. Authors from international contexts speak to the importance of utilizing artistic approaches for research processes. From multimodal field notes to poetic forms to the dramaturgical, chapters in this book represent steps forward in educational inquiry to bringing together both the creative and credible. The book includes multiple images and rich descriptions shared from the field. This first volume covers amongst other topics: co-created narratives; creative fiction in research; analytic portraits; dramatic representation, and critical poetic inquiry. It would be suitable for graduate students and scholars interested in qualitative inquiry and arts-based methods, in Education and the social sciences. (shrink)

The lifting of work restrictions for Romanian and Bulgarian citizens in the EU, in January 2014, encountered much resistance both in European political discourse and the media, as these migrants became demonised and presented as social and economic threats. In this article, we show how the Romanian press dealt with such discriminatory discourses against the Romanian migrants. We conduct a thorough Multimodal Critical Discourse Analysis of news items published in Romanian press, prior to the lifting of work restrictions, and (...) we argue that the Roma emerged as the perfect scapegoats that could explain the deviant and unruly behaviours ascribed by some western media to ‘Romanians’. We also show how racism toward the Roma, referred here as Romaphobia, invokes non-racial practices and instead builds on a reverse victimhood narrative. Such discourses relate in a broader sense to well-established discursive practices in Romanian context but also to the political climate across Europe which is marked by increased intolerance toward the Roma. It is the mixture of stereotypical discourses and populist rhetoric that makes racism towards the Roma appear naturalised and increasingly more difficult to challenge. (shrink)

Semiotics has been making progressively inroads into marketing research over the past thirty years. Despite the amply demonstrated conceptual appeal and empirical pertinence of semiotic perspectives in various marketing research streams, spanning consumer research, brand communications, branding and consumer cultural studies, there has been a marked deficit in terms of consolidating semiotic brand-related research under a coherent disciplinary umbrella with identifiable boundaries and research agenda. -/- The Handbook of Brand Semiotics furnishes a compass for the perplexed, a set of anchors (...) for the inquisitive and a solid corpus for scholars, while highlighting the conceptual richness and methodological diversity of semiotic perspectives. -/- Written by a team of expert scholars in various semiotics and branding related fields, such as John A. Bateman, David Machin, Xavier Ruiz Collantes, Kay L. O’Halloran, Dario Mangano, George Rossolatos, Merce Oliva, Per Ledin, Gianfranco Marrone, Francesco Mangiapane, Jennie Mazur, Carlos Scolari, Ilaria Ventura, and edited by George Rossolatos, Chief Editor of the International Journal of Marketing Semiotics, the Handbook is intended as a point of reference for researchers who wish to enter the ‘House of Brand Semiotics’ and explore its marvels. -/- The Handbook of Brand Semiotics, actively geared towards an inter-disciplinary dialogue between perspectives from marketing and semiotics, features the state-of-the-art, but also offers directions for future research in key streams, such as: -/- · Analyzing and designing brand language across media · Brand image, brand symbols, brand icons vs. iconicity · The contribution of semiotics to transmedia storytelling · Narrativity and rhetorical approaches to branding · Semiotic roadmap for designing brand identity · Semiotic roadmap for designing logos and packaging · Sociosemiotic accounts of building brand identity online · Multimodality and Multimodal critical discourse analysis · Challenging the omnipotence of cognitivism in brand- related research · Semiotics and (inter)cultural branding · Brand equity semiotics Comparative readings of structuralist, Peircean and sociosemiotic approaches to brandcomms . (shrink)

As the title implies, this article asks what an adequate practical ethic is and what a hermeneutic of moral experience can mean for practical ethics. We will use some elements from Ricoeur’s work to examine our view critically and develop it further. We will ask how experience can be an object of hermeneutical study and how we can tie narrativity and normativity together.