Automated Content Metadata Extraction Services Based on MPEG Standards

Abstract

This paper is concerned with the generation, acquisition, standardized representation and transport of video metadata. The use of MPEG standards in the design and development of interoperable media architectures and web services is discussed. A high-level discussion of several algorithms for metadata extraction is presented. Some architectural and algorithmic issues encountered when designing services for real-time processing of video streams, as opposed to traditional offline media processing, are addressed. A prototype real-time video analysis system for generating MPEG-7 Audiovisual Description Profile from MPEG-2 transport stream encapsulated video is presented. Such a capability can enable a range of new services such as content-based personalization of live broadcasts given that the MPEG-7 based data models fit in well with specifications for advanced television services such as TV-Anytime and Alliance for Telecommunications Industry Solutions IPTV Interoperability Forum.

Time‐based tags for fiction movies: comparing experts to novices using a video labeling game

“…State‐of‐the‐art automatic moving image indexing can achieve content‐based retrieval based on the images' low‐level features, and concept‐based retrieval based on derived high‐level concepts (Stock, ). However, the performance is still not optimal to be used in all settings (Gibbon, Liu, Basso, & Shahraray, ; Yeh & Wu, ). In addition, semi‐automatic techniques that use existing texts (such as closed‐captioning subtitles) to retrieve the corresponding shots, have been investigated (e.g., by Turner & Colinet, ), but there is no evidence of the use of these techniques by audiovisual archives yet.…”

Research on metadata-based multiclass information sharing technology

“…As in [5] [6] [7] [8], directory systems are set up to manage the scientific experiment data, which provide support to experimental scientists to access their raw data, facility managers to account for facility usage and other scientists who wish to re-use raw experimental data. As digital data becomes increasingly pervasive, metadata is an essential tool to describe music [9], videos [10] [II] [12] and images [13], and extremely important to retrieval and manage media files. However these standards above have respective emphasis and few of them will be still appropriate if the data category is changed.…”