An Ontology-Driven Framework for the Management of Semantic Metadata Describing Audiovisual Information

Abstract

In this paper, we describe a framework for the management of semantic metadata that describe audiovisual content. The main objectives of this work are to provide a framework allowing enhanced retrieval performance and better user interfaces for audiovisual data, based on extensions of the well accepted international standards for the digital media, digital broadcasting and TV-Anytime domains like TV-Anytime and MPEG-7, as well as to provide an interoperability framework between TV-Anytime and MPEG-7 for the rapidly expanding set of interoperating digital library and interactive TV applications. The framework was developed in the context of the UP-TV project, which investigates TV-Anytime architectures and services. Our approach is ontologydriven, in the sense that we provide ontology based domain-specific extensions of the standards for describing multimedia content. Several aspects of the framework are based on the existence of ontologies. Our framework allows the creation of more efficient user interfaces for accessing content, better retrieval performance and better support in the indexing phase. It also provides compatibility in indexing between the two standards and interoperability for TV-Anytime and digital library applications supported by TV-Anytime servers. We have developed a domain-specific ontology (football games) to test our framework ideas and implementation. The developed ontology uses as primitive modelling elements those provided by the MPEG-7 metadata model. The mapping of the ontology to TV-Anytime metadata primitives is straightforward. We show in detail the concrete implementation of the framework on top of relational databases and its interfaces with the other system components.

Context-aware support in structured documents for interactive-TV

“…In order to match users' interests, applications need to know: the composition and the segmentation of objects and programs; the media object features and relationships between objects [5,10,16,26,31,32]. We advocate that further information is demanded: context features.…”

Performance analysis in soccer: a Cartesian coordinates based approach using RoboCup data

“…Based on these, Tsinaraki et al (2003) proposed a framework in order to manage the semantic metadata used for audiovisual information, providing a semi automatic creation of MPEG-7 metadata description as well as TV-anytime descriptions. Based also on MPEG-7, Yu et al (2006) proposed a hierarchical organizing model to represent high-and low-level information in sports video.…”

An MPEG-7 query language and a user preference model that allow semantic retrieval and filtering of multimedia content

“…A methodology for the systematic integration, in MPEG-7 semantic descriptions, of domain knowledge expressed using pure MPEG-7 constructs (i.e. abstract semantic entities and the MPEG-7 relationships generalizes/specializes, exemplifies/exemplifiedBy and property/propertyOf) has been described in [27]. Using this methodology, the soccer fields are related with relationships of type exemplifies with an abstract semantic entity that represents the class of all the soccer fields and the abstract semantic entity is related with relationships of type exemplifiedBy with every soccer field.…”

“…We have shown, in our previous research [27], that domain knowledge, in the form of domain ontologies, can be expressed using MPEG-7 constructs and integrated in the MPEG-7 semantic descriptions. The rich information captured in the MPEG-7 descriptions allows providing powerful retrieval and filtering capabilities on top of them.…”