Segmentation-based video coding system allowing the manipulation of objects

Salembier, Philippe; Marqués, Ferran; Pardàs, Montse; Morros, Josep Ramon; Corset, I.; Jeannin, S.; Bouchard, Lionel; Meyer, Fernand; Marcotegui, Beatriz

doi:10.1109/76.554418

Cited by 77 publications

(55 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Such schemes can be classified into methods which use motion field segmentation [15], [16] and those which use intensity based segmentation [17], [18], [19]. Motion field segmentation partitions the image into regions based on a criterion of similarity in motion.…”

Section: A Related Previous Workmentioning

confidence: 99%

“…However, it is not clear as to what is the "optimal grey level homogeneity scale" at which segmentation is to be performed and how to control the process of segmentation based upon a choice of scale. Recent work [19] proposes to use multiscale segmentation derived from a morphological processing framework. This method still requires the transmission of segmentation information to the decoder which results in an unacceptable amount of overhead at the bit -rates targeted in this paper.…”

Section: A Related Previous Workmentioning

confidence: 99%

See 1 more Smart Citation

Low bit-rate video coding with implicit multiscale segmentation

Yoon

Ratakonda

Ahuja

1999

IEEE Trans. Circuits Syst. Video Technol.

View full text Add to dashboard Cite

Abstract-In this paper, we report on our efforts toward developing a multiscale segmentation based video compression algorithm aimed at very low bit-rate applications such as video teleconferencing and video phones. We introduce novel techniques for multiscale segmentation based motion compensation and residual coding. Our region based forward motion compensation strategy (in terms of direction of motion vector, which is from the previous frame to the current frame) regulates the size and number of regions used, by pruning a multiscale segmentation of video frames. Since regions used for motion compensation are obtained by segmenting the previously decoded frame, the shape of the regions need not be transmitted to the decoder. Furthermore, our hierarchical motion compensation strategy refines an initial region level, coarse motion field to obtain a dense motion field which provides pixel level motion vectors. The refinement procedure does not require any additional information to be transmitted. This motion compensation technique effectively addresses the problem of dealing with "holes" and "overlapping regions" which are inherent to forward motion compensation. Residual coding is performed using a novel method which exploits the fact that the energy of the residual resulting from motion compensation is concentrated in a priori predictable positions. We will show that this residual coding technique can also be extrapolated to improve the performance of coders using a block based motion compensation strategy. A fusion of these concepts leads to a gain of 2-3 dB in peak signal-to-noise ratio, apart from significant perceptual improvement, over a generic video coding algorithm using a block based motion compensation strategy (such as H.261 or H.263) for a variety of test sequences.

show abstract

Section: A Related Previous Workmentioning

confidence: 99%

Section: A Related Previous Workmentioning

confidence: 99%

Low bit-rate video coding with implicit multiscale segmentation

Yoon

Ratakonda

Ahuja

1999

IEEE Trans. Circuits Syst. Video Technol.

View full text Add to dashboard Cite

show abstract

“…It deals with the encoding of the coding strategy (Decision codzng), the motion information The complete description of the various coding algorithms that are used in this technique can be found in [16].…”

Section: Coding Functionsmentioning

confidence: 99%

“…The Coding block [16] performs the coding of the necessary information in order to be able to reconstruct the encoded image in the receiver side. It deals with the encoding of the coding strategy (Decision codzng), the motion information The complete description of the various coding algorithms that are used in this technique can be found in [16].…”

Section: Coding Functionsmentioning

confidence: 99%

See 1 more Smart Citation

A segmentation-based coding system allowing manipulation of objects (SESAME)

Marqués

Salembier²,

Pardàs³

et al.

Proceedings of 3rd IEEE International Conference on Image Processing

Self Cite

View full text Add to dashboard Cite

In this paper, we present a coding scheme that achieves, for each image in the sequence, the best segmentation in terms of Rate-Distortion theory. It is obtained from a set of initial regions and a set of available coding techniques. The segmentation combines spatial and motion criteria. It selects at each area of the image the most adequate criterion for defining a partition in order to obtain the best compromise between cost and quality. In addition, the proposed scheme is very suitable for addressing content-based functionalities.

show abstract

An efficient parallel algorithm for motion estimation in very low bit-rate video coding systems

Konstantopoulos

Svolos

Kaklamanis

2000

Concurrency: Pract. Exper.

View full text Add to dashboard Cite

SUMMARYMotion estimation is widely used in video coding schemes in order to reduce the inherent temporal redundancy among the frames of a video stream. In particular, low and very low bit rate video coding schemes need sophisticated motion models which usually require a large number of arithmetic operations. In this paper we present a parallel algorithm for the most practical of these models. Specifically we implement the affine motion model on a hypercube-based multiprocessor. This model covers the most usual kinds of motion and requires only a modest number of arithmetic operations. Also, the hypercube network can efficiently handle the non-regular data flow resulting from the parallel implementation of this model. In addition, we assume that our multiprocessor is fine grained, in contrast to most programmable architectures used in video coding, where processors usually have large local memory. Apart from its practicality, the constraint of limited local memory makes the algorithm design more challenging and thus more theoretically interesting. Finally, with regard to other proposals in the literature, our scheme is more general: whereas our scheme covers all kinds of motion supported by the affine motion model, the rest of the proposals deal only with a subset of these kinds.

show abstract

Segmentation-based video coding system allowing the manipulation of objects

Cited by 77 publications

References 32 publications

Low bit-rate video coding with implicit multiscale segmentation

Low bit-rate video coding with implicit multiscale segmentation

A segmentation-based coding system allowing manipulation of objects (SESAME)

An efficient parallel algorithm for motion estimation in very low bit-rate video coding systems

Contact Info

Product

Resources

About