Towards a multimedia formatting vocabulary

Ossenbruggen, Jacco van; Hardma, Lynda; Geurts, Joost; Rutledge, Lloyd

doi:10.1145/775152.775207

Cited by 16 publications

(2 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Examples of such systems include Cuypers [16], Multimedia for You (MM4U) [21], Web, Adaptation, and Multimedia (WAM) [13], and Media Spatial Temporal and Interactive (MSTI) [17]. Cuypers uses a number of processing steps (e.g., semantic structure and quantitative constraints) to generate the final presentation.…”

Section: Motivation and Related Workmentioning

confidence: 99%

A model for editing operations on active temporal multimedia documents

Jansen

César

Bulterman

2010

Proceedings of the 10th ACM Symposium on Document Engineering

View full text Add to dashboard Cite

Inclusion of content with temporal behavior in a structured documents leads to such a document gaining temporal semantics. If we then allow changes to the document during its presentation, this brings with it a number of fundamental issues that are related to those temporal semantics. In this paper we study modifications of active multimedia documents and the implications of those modifications for temporal consistency. Such modifications are becoming increasingly important as multimedia documents move from being primarily a standalone presentation format to being a building block in a larger application. We present a categorization of modification operations, where each category has distinct consistency and implementation implications for the temporal semantics. We validate the model by applying it to the SMIL language, categorizing all possible editing operations. Finally, we apply the model to the design of a teleconferencing application, where multimedia composition is only a small component of the whole application, and needs to be reactive to the rest of the system. The primary contribution of this paper is the development of a temporal editing model and a general analysis which we feel can help application designers to structure their applications such that the temporal impact of document modification can be minimized. Categories and Subject Descriptors General TermsDesign, Experimentation, Languages. KeywordsDeclarative languages, Dynamic transformations, Multimedia application design. INTRODUCTIONIn the first generation of multimedia documents, the document format served as a simple transport wrapper for a byte stream of content. In the second generation, the document often contained additional temporal, styling and structuring primitive that allowed the transformation for interoperable playback on compliant multimedia players and some user interaction. In both cases, the multimedia content is dynamic, temporally and spatially constrained by the document, but the document itself is static: the relationships described by it do not change. Currently, multimedia documents are entering a new generation: the document is embedded as part of a larger application, where the content of the document may be adapted during rendering time, based on the needs and directives of the embedding application. These adaptations can change the underlying multimedia data, but also the general presentation structure. Examples of such applications include live editing of broadcast content [10] and interactive multimedia applications that make use of Web services [11]. In this paper, we use the term multimedia transformations to refer to the process of adapting various aspects of a multimedia document while it is playing.A representative example of dynamic multimedia applications is a video conferencing system that allows multiparty playing of an electronic board game [23]. The application needs to support multi-party social communication, guided by verbal and physical cues from users, as well as camera actions that are...

show abstract

Section: Motivation and Related Workmentioning

confidence: 99%

A model for editing operations on active temporal multimedia documents

Jansen

César

Bulterman

2010

Proceedings of the 10th ACM Symposium on Document Engineering

View full text Add to dashboard Cite

show abstract

“…These approaches require the utilization of declarative languages. An extensive study on the topic can be found in [7]. The Different Capabilities requirement has been researched in [8], although in some simple cases CSS and XSLT are viable alternatives [3].…”

Section: Platformmentioning

confidence: 99%