Modeling Multimedia-Objects with MME

The context of this work is to characterize the content and the structure of audiovisual documents by analysing the temporal relationships between basic events resulted from different segmentations of the same document. For this objective, we need to represent and reason about time. We propose a parametric representation of temporal relation between segments (points or intervals) in which the parameters are used to characterize the relationship between two non-convex intervals corresponding to two segmentations in the video analysis domain. The relationship is represented by a co-occurrences matrix noted as Temporal Relation Matrix (TRM). Each document is represented by a set of TRMs computed between each couple of segmentations of the same document using different features. The TRMs are analysed later to detect semantic events, highlight clues about the video content structure or to classify documents based on their types. For higher-level semantic events and documents' structure, we needed to apply some operations on the basic temporal relations and TRMs such as composition, disjunction, complement, intersection, etc. These operations brought to light more complex patterns; e.g. event 1 occurs at the same time of event 2 followed by event 3. In the work presented in this paper, we define a temporal relation algebra including its set of operations based on the parametric representation and TRM defined above. Several experi-mentations have been done on different audio and video documents to show the efficiency of the proposed representation and the defined operations for audiovisual content analysing.

show abstract

“…In [17], a set of models that base on the temporal relations between intervals and points to compose multimedia data is cited (i.e. [8,14]).…”

Section: Temporal Representation and Reasoningmentioning

confidence: 99%

Temporal relation algebra for audiovisual content analysis

Ibrahim

Ferrané

Joly

2018

Multimed Tools Appl

View full text Add to dashboard Cite

show abstract

UML-basierte Modellierung von Multimediaanwendungen

Sauer

Engels

1999

Modellierung ’99

View full text Add to dashboard Cite

Ein Vorgehensmodell für die Multimedia-Entwicklung mit Autorensystemen

Depke¹,

Engels²,

Mehner³

et al. 1999

Informatik - Forschung und Entwicklung

View full text Add to dashboard Cite

Zusammenfassung. Multimedia-Anwendungen sind interaktive Softwaresysteme und verlangen als solche, mit softwaretechnischen Methoden erstellt zu werden. Sie werden heutzutage in der Regel mit Hilfe von Autorensystemen entwickelt, die eine Ad-hoc-Entwicklung auf Implementierungsniveau unterstützen. Hierdurch und wegen des Fehlens etablierter Vorgehensmodelle für die Multimedia-Softwareentwicklung reduziert sich der MultimediaEntwicklungsprozeß auf die Implementierungsphase. Dies führt zu den in der Softwaretechnik bekannten Problemen wie mangelnder Konzeption und fehlender Dokumentation. Wir stellen in diesem Beitrag ein Vorgehensmodell für die Entwicklung von Multimedia-Anwendungen vor, in dessen Mittelpunkt eine Analyse-und Entwurfsphase im Hinblick auf eine Implementierung der Multimedia-Anwendung mit einem Autorensystem stehen. Ausgehend von einem frameworkbasierten Analysemodell der Anwendung und einem Modell der Realisierungsmöglichkeiten mit einem konkreten Autorensystem wird systematisch ein Implementierungsmodell auf Instanzebene abgeleitet, das als Eingabe für das Autorensystem verwendet wird. Das postulierte Vorgehensmodell wird exemplarisch für das Autorensystem Director am Beispiel der Domäne multimedialer Lehr-/Lernanwendungen erläutert.Abstract. Multimedia applications are interactive software systems and should therefore be developed using software engineering techniques. They are nowadays built using authoring systems that support ad hoc implementation without a preceding modeling phase. Because of that and due to the lack of established process models for multimedia software development, the development process is reduced mainly to the implementation phase. This leads to problems wellknown in software engineering like missing conceptualization and missing documentation. In this paper, we present a process model for the development of multimedia applications which is centered upon an analysis and a design phase with regard to an implementation with an authoring system. Starting from a framework-based analysis model of the application and a model of the programming capabilities of a concrete authoring system, an instance-level implementation model can be systematically derived. The proposed process model is exemplarily explained using the Director authoring system for the domain of computer-based training applications.

show abstract

Modeling Multimedia-Objects with MME

Cited by 6 publications

References 1 publication

Temporal relation algebra for audiovisual content analysis

Temporal relation algebra for audiovisual content analysis

UML-basierte Modellierung von Multimediaanwendungen

Ein Vorgehensmodell für die Multimedia-Entwicklung mit Autorensystemen

Contact Info

Product

Resources

About