Content on demand video adaptation based on MPEG-21 digital item adaptation

Abstract

One of the major objectives in multimedia research is to provide pervasive access and personalized use of multimedia information. Pervasive access of video data implies the access of cognitive and affective aspects of video content. Personalized use requires the services satisfy individual user's needs on video content. This article attempts to provide a content-on-demand (CoD) video adaptation solution by considering users' preference on cognitive content and affective content for video media in general, sports video and movies in particular. In this article, CoD video adaptation system is developed to support users' decision in selecting their content of interest and adaptively deliver video source by selecting relevant content and dropping frames while considering network conditions. First, video contents are annotated by the description schemes (DSs) provided by MPEG-7 multimedia description schemes (MDSs). Then, to achieve a generic adaptation solution, the adaptation is developed following MPEG-21 Digital Item Adaptation (DIA) framework. We study the MPEG-21 reference software on XML generation and develop our own system for CoD video adaptation in three steps: (1) the content information is parsed from MPEG-7 annotation XML file together with bitstream to generate generic Bitstream Syntax Description (gBSD); (2) Users' preference, network characteristic and adaptation QoS (AQoS) are considered for making adaptation decision; (3) adaptation engine automatically parses adaptation decisions and gBSD to achieve adaptation. Unlike most existing adaptation work, the system adapts the content of interest in the video stream according to users' preference. We implement the above-mentioned MPEG-7 and MPEG-21 standards and provide a generic video adaptation solution. Adaptation based on gBSD avoids complex video computation. Thirty students from various departments were invited to assess the system and their responses have been positive.

Modeling and Evaluation of a Metadata-Based Adaptive P2P Video-Streaming System

“…[5,6,7,8,9,10], due to their proven scalability and alleviation of the need for powerful centralized resources. While there are many recent research works that use MPEG-21 based metadata content description for multimedia adaptation [42][47] [48][49], we did not find any promising research entailing metadata-based adaptation and overlay streaming except the PAT system, proposed by Liu et al [11], where the authors propose a peer assisted online transcoding scheme in P2P/overlay streaming. In PAT, authors save the intermediary transcoding results as metadata and re-use it in another transcoding request.…”