Multimedia tool suite for the visualization of drama heritage metadata

Abstract

This paper presents a multimedia tool suite for, on the one hand, the annotation of metadata that encode the dramatic qualities of cultural heritage items, and, on the other, the visualization of such metadata for drama analysis and didactics. The tool suite relies upon an ontology of drama to devise an annotation schema for the metadata concerning the dramatic qualities. The two major modules of the tool suite are a web-based platform, that allows for the insertion of the annotation metadata, and a visualization program for the interactive exploration of such metadata, respectively. The tool suite was tested on the cross-media studies of drama analysis and teaching of drama structure through the application to classical examples.

Coupling conceptual modeling and rules for the annotation of dramatic media

“…The mapping rules were devised with the aim of allowing a support for drama scholars based on the explicitation of character's intentions connected to the unit (a visualization interface provide immediate access to such information, see [65,64]). The reasoning that we want to achieve by using this set of rules is that one of obtaining a recognition of equality between the actions (incidents) occurring in the unit, and the action in plans, according to some shared properties such as the fact that such actions are represented by the same Schema with the same Roles and Fillers.…”

“…The appropriate action templates are identified through natural language terms that access the external lexical and commonsense knowledge resources (respectively, FrameNet and YagoSumo, accessed via WordNet). For example, to annotate Hamlet's action "testing", the annotator starts by searching some word she/he thinks is appropriate for describing it (in the current implementation, the Italian verb "esaminare"); then, he/she selects the appropriate Wordnet synset (the number 61, in this case); finally, the system retrieves the frames that are mapped onto such synset in FrameNet, from which she/he selects the 6 As shown in [65], despite the individual approach, the segmentation of a drama reveals to be highly consistent among annotators. frame that is the most significant for the situation (here "questioning").…”

Automatic Annotation of Characters’ Emotions in Stories

“…These character-centered description issues, not encompassed by the annotation languages above, are accounted for by the ontology-based story annotation in [14] and [15]. The ontology of drama called Drammar grounds the representation of characters upon the notion of agents' intention (realized through the notion of plan).…”

Ontology–Based Visualization of Characters’ Intentions

“…For example, the writing assistant Dramatica Pro 3 visualizes the building blocks of a plot structure, with diagrams for plot progression and story points, that helps the writer in controlling and balancing the tension within the story development. Some works [14,13], propose the metadata annotation of dramatic heritage items, assuming an ontological approach (ontology called Drammar) to the representation of the drama elements, encoding the widely acknowledged relationship between the drama abstraction and one of the concrete shapes a drama can assume [19, p. xviii]. There exist other approaches that guide the annotation for the formal encoding of the drama elements.…”

“…The ontology Drammar (encoded in the OWL2 RL language) has been designed with the twofold goal of providing a formalized conceptual model of the dramatic elements [2,13,14], and an annotation schema for encoding the description of a dramatic item. So, along with classes that represent the domain of drama, it contains specific classes that are intended for interfacing the representation of drama with linguistic and common sense knowledge.…”