The Expansion of Paths in the Mutual Transformation Mechanism of Music and Narrative

Abstract

For a mechanism of the surface expression phase in the authors' narrative generation system architecture, this paper proposes an approach to the circulative generation by the mutual transformation between music and narrative. In the concept for musical mechanism, music is not just the accompaniment for narrative and the authors extremely aim at using musical knowledge & techniques and conceptual knowledge & techniques in fusion by the medium of music. Depending on this concept, in this paper, the authosr introduce the newest prototyping system composed of eight routes of transformation modules between narrative and music including automatic composition and musical variation mechanisms. In addition, through the simple preliminary evaluations, the authors consider several insufficient points in the quality of music and the correspondence of music to narrative.

Narrative Forest: An automatic narrative generation system with a visual narrative operation mechanism

“…Next, although music mechanism in the integrated narrative generation system consists of eight generation or transformation modules between narrative and music [10], NF uses only a function to transform from a story to music. In this mechanism, a tree structure of story is corresponded to a musical tree structure.…”

“…Music in this narrative generation system is not only after expression function for generated narratives and narrative generation from music is also possible through the mutual transformation cycle between conceptual narrative structures and musical structures. Musical operations including variation and composition can result in the change of narrative structures [9,10]. One of our objectives is to treat the metaphorical visual interface in NF as a narrative generation function for representing and controlling the narrative generation process.…”

Building Conceptual Dictionaries for an Integrated Narrative Generation System

“…The surface expression or representation module consists of the following three mechanisms: a natural language mechanism that transforms a story or discourse conceptual representation into a sequence of sentences [32], an image mechanism including an animated movie generation mechanism [33] as a part, and a music mechanism that conducts on the cyclical mutual transformation between conceptual narrative structures and musical structures [16,17]. In the present version of …”

“…One of the main current research topics is to design and develop the Integrated Narrative Generation System (INGS) [12,13]. INGS integrates diverse narrative elements into an organically integrated architecture based on a variety of background conceptual ideas or concepts relating to narrative generation, such as "expanded literary theory" [14,15] and "circulative narrative generation" [16]. The expanded literary theory is the conception of a new literary theory, on which existing literary theories and narratology are used in the reconstruction for informatics.…”