Scalable video summarization of cultural video documents in cross-media space based on data cube approach

Perez-Daniel, Karina Ruby; Nakano-Miyatake, Mariko; Benois-Pineau, Jenny; Maabout, Sofian; Sargent, Gabriel

doi:10.1109/cbmi.2014.6849824

Cited by 2 publications

(3 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The approach was tested on the 14 representative audio-visual documents from 14 categories of the INA dataset (see Section IV.A). In case of scalable navigation, the recall-precision figures in terms of correspondence of automatically generated summary with regard to the human annotation reported in [11] are balanced and are both close to 70% in average.…”

Section: Integration Level: Component -Datacube Productionmentioning

confidence: 66%

“…For the color, we used the well-known MPEG-7 features such as Color Structure Descriptor (CSD) [12] and Scalable Color Descriptor (SCD) [13]. Structural features used are Pyramidal Histograms of Oriented Gradients (PHOG) as described in [11].…”

Section: Integration Level: Component -Key Frames Featuresmentioning

confidence: 99%

“…In the context of a scalable video summary construction, it means that grouping of video frames is fulfilled accordingly to different features, which permits scalability. Video and audio features are calculated at different sampling rates and their synchronization is achieved by temporal interpolation [11] .…”

Section: A Summary Servicementioning

confidence: 99%

See 2 more Smart Citations

The Mex-Culture Multimedia platform: Preservation and dissemination of the Mexican Culture

Ramirez¹,

Benois-Pineau²,

Vázquez³

et al. 2015

2015 13th International Workshop on Content-Based Multimedia Indexing (CBMI)

Self Cite

View full text Add to dashboard Cite

In this paper we present the Mex-Culture Multimedia platform, which is the first prototype of multimedia indexing and retrieval for a large-scale access to digitized Mexican cultural audio-visual content. The platform is designed as an open and extensible architecture of Web services. The different architectural layers and media services are presented, ensuring a rich set of scenarios. The latter comprises summarization of audio-visual content in cross-media description spaces, video queries by actions, key-frame and image queries by example and audio-analysis services. Specific attention is paid to the selection of data to be representative of Mexican cultural content. Scalability issues are addressed as well.Keywords-Web based architecture, media service, scalability, scalable access to large-scale media archives.

show abstract

Section: Integration Level: Component -Datacube Productionmentioning

confidence: 66%

Section: Integration Level: Component -Key Frames Featuresmentioning

confidence: 99%

See 1 more Smart Citation

The Mex-Culture Multimedia platform: Preservation and dissemination of the Mexican Culture

Ramirez¹,

Benois-Pineau²,

Vázquez³

et al. 2015

2015 13th International Workshop on Content-Based Multimedia Indexing (CBMI)

Self Cite

View full text Add to dashboard Cite

show abstract

A scalable summary generation method based on cross-modal consensus clustering and OLAP cube modeling

Sargent

Perez-Daniel

Stoian

et al. 2015

Multimed Tools Appl

View full text Add to dashboard Cite

International audienceVideo summarization has been a core problem to manage the growing amount of content in multimedia databases. An efficient video summary should display an overview of the video content and most existing approaches fulfill this goal. However, such an overview does not allow the user to reach all details of interest selectively and progressively. This paper proposes a novel scalable summary generation approach based on the On-Line Analytical Processing data cube. Such a structure integrates tools like the drill down operation allowing to browse efficiently multiple descriptions of a dataset according to increased levels of detail. We adapt this model to video summary generation by expressing a video within a cross-media feature space and by performing clusterings according to particular subspaces. Consensus clustering is used to guide the subspace selection strategy at small dimensions, as the novelty brought by the least consensual subspaces is interesting for the refinements of a summary. Our approach is designed for weakly-structured contents such as cultural documentaries. We perform its evaluation on a corpus of cultural archives provided by the French Audiovisual National Institute (INA) using information retrieval metrics handling single and multiple reference annotations. The performances obtained overall improved results compared to two baseline systems performing random and arbitrary segmentations, showing a better balance between Precision and Recall

show abstract

Scalable video summarization of cultural video documents in cross-media space based on data cube approach

Cited by 2 publications

References 12 publications

The Mex-Culture Multimedia platform: Preservation and dissemination of the Mexican Culture

The Mex-Culture Multimedia platform: Preservation and dissemination of the Mexican Culture

A scalable summary generation method based on cross-modal consensus clustering and OLAP cube modeling

Contact Info

Product

Resources

About