One page, two stories: intersemiotic dissonance in a comic adaptation of<i>Journey to the West</i>

Yu, Hailing

doi:10.1080/10350330.2019.1645986

Cited by 10 publications

(10 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Voice over is more "psychological" since it concentrates on words rather than noises, making the character"s awareness more internalized (Yu, 2021). The use of visuals rather than words in a mise-en-scene conveys interior monologue.…”

Section: Discussionmentioning

confidence: 99%

“…The other source -the basis for the cognitive translation is intersemiotic transfer: here, we deal with the transition of meaning between two different sign systems: painting and words, sound and image, etc., i.e., between those signs which belong to different semiotic systems (Sütiste, 2021). When talking about adaptations, the problem of transferring literary texts into film becomes even more complicated since it is necessary to take into consideration both cognitive and intersemiotic aspects (Yu, 2021). The main goal of this study is to reveal the specificity of screen text when compared to its original in order to show how close relations could be established between prose literature and cinema in film art.…”

Section: Introductionmentioning

confidence: 99%

“…It has been applied to film by Christian Metz, who noted that the filmic codes are not arbitrary but motivated. He described in great detail how cinematic sign systems have their own structure and combine with each other and with language in a multi-code structure (Yu, 2021). According to (Giannakopoulou 2019), the main function of verbal forms of inner voices is to provide inner voices" owners with a sense of understanding about what they are experiencing; the other function is to convey significance/meaning/emotion/mood of the experience.…”

Section: Introductionmentioning

confidence: 99%

“…There is such kind of intersemiotic relations as a more detailed description of event episodes, events" temporal structure presentation of author"s thoughts and characters" thoughts their mental activity formulated indirect speech and inner speech that is shown only by the actor"s speech, visual image or intonation, etc. 2 (Yu, 2021). So, it follows that to transfer meaning from one semiotic mode into another requires cognitive translation, which cannot be reduced only to the intersemiotic relations between verbal and visual modes.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Cognitive and Intersemiotic Model of the Visual and Verbal Modes in a Screen Adaptation to Literary Texts

Holubenko¹

2022

WJEL

View full text Add to dashboard Cite

The aim of the study is to examine screen adaptations from the perspective of cognitive and intersemiotic models of the visual and verbal modes. The purpose of the study is to express the specificity of a screen text which is defined as a combination of three media: speech, image, and music. The scope is to demonstrate the general framework of an intersemiotic translation from a new point of view – like a transliteration. The method of the research refers to semiotic and stylistic analyzes – methods of transformation from one sign system into another from prose works with regard to their cognitive as well as narrative and stylistic features (Zhong, Chen, & Xuan, 2021). Thus, the study analyses such specific relations between the verbal and visual modes in film adaptations of prose literature as a more detailed description of event episodes, events’ temporal structure, presentation of author’s thoughts and characters’ thoughts; their mental activity formulated indirect speech and inner speech that is shown only by the actor’s intonation. The results of the study made possible to show the types of inner speech in their adaptations: author’s thoughts, characters’ thoughts which are presented only by the verbal mode, and visual modes’ inner speeches that combine the modes of character’s voice and image. One can conclude, that taking into account intersemiotic relations between the visual and verbal spaces, it is possible to explain, for instance, how the words of characters are replaced by their facial expressions, gestures, or intonations.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Cognitive and Intersemiotic Model of the Visual and Verbal Modes in a Screen Adaptation to Literary Texts

Holubenko¹

2022

WJEL

View full text Add to dashboard Cite

show abstract

“…Another important line of research has been pursued through the cognitive lens (e.g., Cohn, 2013; Cohn et al, 2017), which throws light on the narrative structure of comic sequences and how it is processed by human brains. These studies have been complemented by those from the perspective of social semiotics, which mainly draws from systemic functional linguistics and takes social context into account (e.g., Bateman et al, 2017; Chen, 2017; Yu, 2019).…”

Section: Theoretical Framework and Methodologymentioning

confidence: 99%

Recontextualizing Literary Classics With Modernity: A Social Semiotic Analysis of a Comic Adaptation of Journey to the West

2021

View full text Add to dashboard Cite

A large number of literary classics have been transformed into comic works with varied adaptation strategies. As a typical example, Cai Zhizhong’s comic adaptation of Journey to the West has made successful attempts in rewriting the story with modern elements that carry socio-cultural values. Under the general theoretical frameworks of social semiotics, this article seeks to explain what and how these elements are presented and explore how such elements are infused with values that affiliate people of different communities and provoke thoughts on cultural diversity and global issues. It is found that (a) modern elements have been presented with particular ideational, interpersonal, and textual semiotic options and (b) different values have been implanted into these elements through bondicons, iconization, and visual attitudes.

show abstract

Multi‐Modal Crisis Discourse and Collective Sensemaking on TikTok

Khoury,

Owen‐Smith,

Joh

et al. 2023

Proceedings of the Association for Information Science and Tech

View full text Add to dashboard Cite

An explosion at the Port of Beirut resulted in over 200 fatalities and displaced many more. Hundreds recorded and thousands shared the event, sparking discourse across social media. We provide a mixed‐methods analysis of 26 TikTok videos about the port explosion. Our study involved a semiotic analysis of the videos and a content analysis of the related 21,150 comments. The discourse surrounding the explosion extends a growing body of literature on the role of TikTok in disseminating crisis‐related information. We use a collective sensemaking framework to investigate how TikTok contributes to the understanding of an event. The authors find that Middle Eastern content creators contributed more to collective sensemaking about the event than non‐Middle Eastern creators. We additionally examine the current state of collective sensemaking on TikTok and provide platform implications.

show abstract

One page, two stories: intersemiotic dissonance in a comic adaptation ofJourney to the West

Cited by 10 publications

References 25 publications

Cognitive and Intersemiotic Model of the Visual and Verbal Modes in a Screen Adaptation to Literary Texts

Cognitive and Intersemiotic Model of the Visual and Verbal Modes in a Screen Adaptation to Literary Texts

Recontextualizing Literary Classics With Modernity: A Social Semiotic Analysis of a Comic Adaptation of Journey to the West

Multi‐Modal Crisis Discourse and Collective Sensemaking on TikTok

Contact Info

Product

Resources

About