Narrative Cognition in Interactive Systems: Suspense-Surprise and the P300 ERP Component

Bruni, Luis Emilio; Baceviciute, Sarune; Arief, Mohammed

doi:10.1007/978-3-319-12337-0_17

Cited by 11 publications

(7 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Contrary to the projection towards the future implied by suspense, surprise is usually associated with the unmet expectations of the "here and now. " Every increase of (unexpected) information that reduces (or increases) uncertainty may have an element of surprise [41]. Temporal immersion is also related to the level of narrativity involved in the experience that is staged in the particular XR application.…”

Section: Immersionmentioning

confidence: 99%

Digital Narratives in Extended Realities

Bruni¹,

Kadastik²,

Pedersen³

et al. 2022

Roadmapping Extended Reality

View full text Add to dashboard Cite

XR technologies are increasingly considered as expressive media with special qualities for narrative representation. In this chapter, we chart some of the major challenges inherent in the implementation of digital narratives in XR. For this purpose, we consider the intersections between different research domains like classical and post-structural narratology, cognitive narratology, literary studies, computer science, game research, cognitive science, and particularly interactive digital narratives (IDN) and storytelling. As with IDN, many of the challenges of implementing narratives in XR have to do with the trade-offs between interactivity and immersion. In this direction, we aim to contribute to the bridging between the IDN and XR research domains. We elaborate on specific issues in IDN that may require particular care in XR, such as agency, embodiment, narration, "point of view technologies, " artificial agents, and AI. Additionally, we provide examples of different application domains in games, serious games, cultural experiences, healthcare, and immersive journalism. To conclude, we highlight the eminent role of narrative cognition in XR and suggest a roadmap for combining XR technologies, cognitive sciences, advanced biometric signals processing, and storytelling techniques for investigating ways we interact cognitively with stories and the effects of XR narratives on the human emotional-cognitive system.

show abstract

Section: Immersionmentioning

confidence: 99%

Digital Narratives in Extended Realities

Bruni¹,

Kadastik²,

Pedersen³

et al. 2022

Roadmapping Extended Reality

View full text Add to dashboard Cite

show abstract

“…They address the mental relations between perceiver and the narrator and character, for example via point of view, dialogue, description of action and body language and conveyance of emotion. Empirical studies on these cognitive processes have been conducted by [73,74]. In relation to authoring see for example [75].…”

Section: Narrative and Narrationmentioning

confidence: 99%

Interactive digital narrative (IDN)—a complexity case

Nack

2022

New Review of Hypermedia and Multimedia

View full text Add to dashboard Cite

Any form of design 1 is a creative process considering goals and constraints that result in a product, which addresses aesthetic, functional, economic, or socio-political considerations that are established by the stakeholders involved. A design can follow two main development paradigms, namely a rational or action-centric model [1]. The rational model is plan-driven, where the plan is executed in terms of a discrete sequence of stages, such as pre-production (i.e. design brief, analysis of design goals, requirement specification, conceptualising solutions), production (i.e. development and testing), and post production (i.e. introducing the solution into the environment, evaluation and conclusion). This procedural view 2 allows for the repetition of stages at any time before, during, or after production based on accompanying best practices [2][3][4][5][6][7]. The rational paradigm understands design as informed by research and knowledge in a predictable and controlled manner. The action-centric paradigm apprehends design also as informed by research and knowledge but considers the design process as improvised, where the sequences of analysis, design and implementation are undistinguishably connected [8][9][10][11][12][13]. Within action-centric design designers conceptualise a problem (framing) by defining goals and objectives and then construct tentatively the object to be designed (move). The design process here asks the designer to simultaneously refine the mental image of the design object based on the actual perception of the context in and for which it needs to be designed (sensemaking-coevolution-implementation framework [11]). The expression of the idea through suitable design tools facilitates the critical rethinking of the perceived idea, which results in a new design cycle. The essential element in action-centric design, actually the development of any design idea, is the means of expression and perception to facilitate a space for inspiration, ideation, and implementation through which the designer refines ideas and explores new directions [12]. This way of looking at design is known as design thinking [13]. Both paradigms are essentially human-centred, in the way that they see human needs, competences (cognitive as well as knowledge) and behaviour as the basis of the investigation and only then design to accommodate those [4]. At its core, all design is experiential and that is why all design addresses fundamental concepts, such as affordance, mapping, feedback, conceptual models, and system image. Affordance refers to the relationship between the properties of an item and the capabilities of an agent that establish how that item can be used or understood. Mapping represents the relationship between the elements of two sets of items (i.e. the layout of controls and the devices being controlled). Mappings represent analogies, which can be spatial, biological, cultural, or follow principles of perception (such as Gestalt psychology) to facilitate grouping through proximity. Feedback communicates the r...

show abstract

“…We are interested in higher level insights. For example, [41] talks about a similar idea of collecting parameters and then figuring out how to map them to corresponding cognitive processes but limits the scope of their discussion to two feedback items -suspense and surprise.…”

Section: Related Workmentioning

confidence: 99%

A Systematic Analysis of User Experience Dimensions for Interactive Digital Narratives

Revi

Millard

Middleton

2020

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Providing intelligent feedback to aid authoring has been proposed as a way to speed up authoring, give the author more control, and to enable the authoring of more complex interactive narratives. However, there is little research investigating what concrete feedback items would be useful for interactive digital narrative (IDN) creators. In this paper, we discuss potentially useful feedback items in relation to authoring goals and concerns. We perform a systematic literature review to make a list of concrete feedback items of interest related to the most emphasised concern of authoring -the effect of the interactive narrative on the user. We identify 47 User Experience (UX) dimensions in the IDN literature that could serve as useful feedback items, covering 8 categories -Agency, Cognition, Immersion, Affect, Drama, Rewards, Motivation and Dissonance. This list combines and untangles how different IDN researchers have interpreted and expressed interest in the complex idea of UX in the past decade and gives us insight into what concrete aspects of UX might be useful to estimate via automated feedback.

show abstract

Narrative Cognition in Interactive Systems: Suspense-Surprise and the P300 ERP Component

Cited by 11 publications

References 29 publications

Digital Narratives in Extended Realities

Digital Narratives in Extended Realities

Interactive digital narrative (IDN)—a complexity case

A Systematic Analysis of User Experience Dimensions for Interactive Digital Narratives

Contact Info

Product

Resources

About