A Novel Paradigm for Optimized Scalable Video Transmission Based on JPEG2000 with Motion

Naman, Aous Thabit; Taubman, David

doi:10.1109/icip.2007.4379773

Cited by 11 publications

(23 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Exploiting scalable nature of JPEG2000, proposals 11,12 have also been made to use JPEG2000 for video browsing, where the streaming video can be randomly accessed with complete flexibility at the frame level: random access any frame in sequence, forward/backward playback in time, playback at K× speed by decoding only every K frames, etc. Though at encoding time each frame is encoding independently, inter-frame redundancy can nevertheless be exploited.…”

Section: Video Browsingmentioning

confidence: 99%

“…This was done so that frames could be sent either forward or backward in time per client's request, and the client could simply decode and play back the video in the transmission order with no excess buffering. Note that this was a more limited form of media interactivity than video browsing, but unlike JPEG2000-based approaches 11,12 for video browsing, where each frame was encoded independently, the inter-frame redundancy was explicitly exploited here during actual media encoding, hence the resulting encoding rate is expected to be much lower.…”

Section: Reversible Video Playbackmentioning

confidence: 99%

See 1 more Smart Citation

On media data structures for interactive streaming in immersive applications

et al. 2010

View full text Add to dashboard Cite

Interactive media streaming is the communication paradigm where an observer, viewing transmitted subsets of media in real-time, periodically requests new desired subsets from the streaming sender, upon which the sender sends the appropriate media data corresponding to the received requests. This is in contrast to non-interactive media streaming like TV broadcast, where the entire media set is compressed and delivered to the observer before the observer interacts with the data (such as switching TV channels). Examples of interactive streaming abound in different media modalities: interactive browsing of JPEG2000 images, interactive light field or multiview video streaming, etc. Interactive media streaming has the obvious advantage of bandwidth efficiency: only the media subsets corresponding to observer's requests are transmitted. This is important when an observer only views a small subset out of a very large media data set during a typical streaming session. The technical challenge is how to structure media data such that good compression efficiency can be achieved using compression tools like differential coding, while providing sufficient flexibility for the observer to freely navigate the media data set in his/her desired order. In this introductory paper to the special session on "immersive interaction for networked multiview video systems", we overview different proposals in the literature that simultaneously achieve the conflicting objectives of compression efficiency and decoding flexibility.

show abstract

Section: Video Browsingmentioning

confidence: 99%

Section: Reversible Video Playbackmentioning

confidence: 99%

On media data structures for interactive streaming in immersive applications

et al. 2010

View full text Add to dashboard Cite

show abstract

“…Other research, closer to the process proposed in this paper, is described in [18,19,6]. They perform a conditional replenishment of JPEG2000 code-blocks with motion compensation, but this technique appears to be too complex to be applied in real-time environments, since they work with a low-level code stream.…”

Section: Introductionmentioning

confidence: 99%

MIJ2K: Enhanced video transmission based on conditional replenishment of JPEG2000 tiles with motion compensation

Bustamante

2011

Journal of Visual Communication and Image Representation

View full text Add to dashboard Cite

A video compressed as a sequence of JPEG2000 images can achieve the scalability, flexibility, and acces-sibility that is lacking in current predictive motioncompensated video coding standards. However, streaming JPEG2000-based sequences would consume considerably more bandwidth. With the aim of solving this problem, this paper describes a new patent pending method, called MIJ2K. MIJ2K reduces the inter-frame redundancy present in common JPEG2000 sequences (also called MJP2). We apply a real-time motion detection system to perform conditional tile replenishment. This will significantly reduce the bit rate necessary to transmit JPEG2000 video sequences, also improving their quality.The MIJ2K technique can be used both to improve JPEG2000-based real-time video streaming services or as a new codec for video storage. MIJ2K relies on a fast motion compensation technique, especially designed for real-time video streaming purposes. In particular, we propose transmitting only the tiles that change in each JPEG2000 frame. This paper describes and evaluates the method proposed for real-time tile change detection, as well as the overall MIJ2K architecture.We compare MIJ2K against other intra-frame codecs, like standard Motion JPEG2000, Motion JPEG, and the latest H.264-Intra, comparing performance in terms of compression ratio and video quality, measured by standard peak signal-to-noise ratio, structural similarity and visual quality metric metrics.

show abstract

“…In our earlier work [3], we proposed a new paradigm for serving video; in which, we rely on JPEG 2000 to independently compress the original video frames, providing quality scalability and spatial resolution scalability. To exploit the inter-frame redundancy, we rely on a server policy to optimally select the number of quality layer for each code-block transmitted and on a client policy to make the most of the received (distorted) frames and a (possibly client-specific) motion model.…”

Section: Introductionmentioning

confidence: 99%

“…In [3], we restricted our attention to the case where redundancy is exploited only within each pair of frames. By contrast, the current paper extends the approach to the case in which the server optimization policy is run over a sliding window of frames; this potentially allows for the exploitation of redundancy between any two frames in the window.…”

Section: Introductionmentioning

confidence: 99%

Optimized scalable video transmission based on conditional replenishment of jpeg2000 code-blocks with motion compensation

Naman

Taubman

2007

Proceedings of the International Workshop on Workshop on Mobile Video

Self Cite

View full text Add to dashboard Cite

A video stored as a sequence of JPEG2000 images can provide the scalability, flexibility, and accessibility that is lacking in current predictive motion-compensated video coding standards; however, streaming this sequence would consume considerably more bandwidth. This paper presents a new method for optimized streaming of a JPEG2000 video that relies on motion compensation and server-optimized conditional replenishment to reduce temporal redundancy, in collaboration with an intelligent client policy for reconstructing the available content. In particular, we propose transmission of motion vectors and an optimized number of layers, possibly zero, for each code-block of the JPEG2000 representation of each new frame. We also propose the use of a sliding window to optimize a group of frames such that codeblocks of these frames have more than one chance of being enhanced if that is beneficial to subsequent frames. Ratedistortion optimization in the Lagrangian sense is employed to achieve the lowest possible MSE. It is expected that mobile clients with their limited processing powers would benefit from this work in real-time and interactive applications, such as teleconferencing and surveillance. This paper introduces the concept, formulates optimization criteria, and compares the performance with alternative strategies.

show abstract

A Novel Paradigm for Optimized Scalable Video Transmission Based on JPEG2000 with Motion

Cited by 11 publications

References 5 publications

On media data structures for interactive streaming in immersive applications

On media data structures for interactive streaming in immersive applications

MIJ2K: Enhanced video transmission based on conditional replenishment of JPEG2000 tiles with motion compensation

Optimized scalable video transmission based on conditional replenishment of jpeg2000 code-blocks with motion compensation

Contact Info

Product

Resources

About