Real-time visualisation and browsing of a distributed video database

Gonzales, Eduard; Evans, Alun; Gonzales, Sergi; Abadia, Juan; Blat, Josep

doi:10.1145/1690388.1690481

Cited by 3 publications

(4 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…14). This extraction of video frames from the HTML5 video element for use as textures within a 3D context is one of the major benefits of developing a hybrid interface within a web-based context, as such a pipeline in a standard desktop OpenGL context requires a greater level of software engineering and pre-processing [45].…”

Section: B Video Data and Timelinementioning

confidence: 99%

Multimodal Visual Data Registration for Web-Based Visualization in Media Production

Kim

Evans

Blat

et al. 2018

IEEE Trans. Circuits Syst. Video Technol.

Self Cite

View full text Add to dashboard Cite

Recent developments of video and sensing technology can lead to large amounts of digital media data. Current media production rely on both video from the principal camera together with a wide variety of heterogeneous source of supporting data (photos, LiDAR point clouds, witness video camera, HDRI and depth imagery). Registration of visual data acquired from various 2D and 3D sensing modalities is challenging because current matching and registration methods are not appropriate due to differences in formats and noise types of multi-modal data. A combined 2D/3D visualisation of this registered data allows an integrated overview of the entire dataset. For such a visualisation a web-based context presents several advantages. In this paper we propose a unified framework for registration and visualisation of this type of visual media data. A new feature description and matching method is proposed, adaptively considering local geometry, semi-global geometry and colour information in the scene for more robust registration. The resulting registered 2D/3D multi-modal visual data is too large to be downloaded and viewed directly via the web browser while maintaining an acceptable user experience. Thus, we employ hierarchical techniques for compression and restructuring to enable efficient transmission and visualisation over the web, leading to interactive visualisation as registered point clouds, 2D images, and videos in the browser, improving on the current state of the art techniques for web-based visualisation of big media data. This is the first unified 3D web-based visualisation of multi-modal visual media production datasets. The proposed pipeline is tested on big multimodal dataset typical of film and broadcast production which are made publicly available. The proposed feature description method shows two times higher precision of feature matching and more stable registration performance than existing 3D feature descriptors.

show abstract

Section: B Video Data and Timelinementioning

confidence: 99%

Multimodal Visual Data Registration for Web-Based Visualization in Media Production

Kim

Evans

Blat

et al. 2018

IEEE Trans. Circuits Syst. Video Technol.

Self Cite

View full text Add to dashboard Cite

show abstract

“…The hybrid interactive visualization, tightly integrating video, static image, hypertext and real-time 3D graphics, which is enabled by the 3D web, is more difficult to replicate with traditional offline methods [Jankowski and Decker 2013] [Gonzales et al 2009], and is better for the user. We address the web challenges to deal with big data in this context and our application demonstrates new functionalities in a challenging industrial environment.…”

Section: Introductionmentioning

confidence: 99%

“…Inspired by this paradigm, our work tightly integrates 2D image data (video and still images) and metadata within an interactive 3D context. When carried out in an offline application, such a hybrid approach requires specific software engineering to allow individual video frames to be passed to the 3D rendering engine as texture data [Gonzales et al 2009]. However, in a browser-based context, the HTML5 video element [Pfeiffer and Pearce 2010] provides a convenient wrapper for reading and accessing the pixel data provided by videos (and stored in a variety of formats), as well as providing HTTP 1.1 byte-range access to server-based files, which facilitates buffering and permits the implementation of video scrubbing interfaces (where the user can move forward and backwards through the duration of the video to view desired moments).…”

Section: Introductionmentioning

confidence: 99%

Hybrid visualisation of digital production big data

Evans

Agenjo

Blat

2015

Proceedings of the 20th International Conference on 3D Web Technology

Self Cite

View full text Add to dashboard Cite

In this paper, we present a web application for the hybrid visualisation of digital production Big Data. In a typical film or television production, several terabytes of data can be recorded per day, such as film footage from multiple cameras or background information regarding the set. Interactive visualisation of this multimodal data, integrating 2D (image and video) and 3D graphics modes, would result in enhanced use. A browser-based context is capable of this integration in a seamless and powerful manner, but faces significant challenges related to data transfer and compression which must be overcome. This paper presents an application designed to harness the power of a hybrid web context while attempting to overcome or compensate for the difficulties of data transfer limitations and rendering power. Results are presented from three, publicly available test datasets, which represent a realistic sample of data recorded on a typical high-budget production set.

show abstract

“…Broadband Internet connections and 3D graphics accelerators allow the enhancement of graphical user interfaces with technologies able to depict realistic 3D environments and support a wider set of human-computer interaction functionalities. The use of a 3D environment for data visualization and information browsing, results in a more natural and efficient, in terms of data access, graphical user interface [12]- [17]. Within this virtual world the visitor can freely navigate and change position, orientation and viewpoint direction.…”

Section: Introductionmentioning

confidence: 99%

Content-based navigation within virtual museums

Koutsoudis

Makarona

Pavlidis

2012

Journal of Advanced Computer Science &Amp; Technology

View full text Add to dashboard Cite

The ongoing evolution of the Internet has enabled web applications that use real time three-dimensional (3D) graphics and virtual environments. Moreover, in recent years, cultural technology has also flourished notably. Virtual museums represent one significant application that combines culture with modern technologies and the internet, requiring an interdisciplinary approach aiming both at dissemination and education. We present our approach to enhance virtual museums by incorporating content-based retrieval that refers to 3D objects. In this context, a virtual visitor is able to navigate within the museum, examine the exhibited artifacts and perform queries-byexample in order to locate the position of related artifacts. The retrieval mechanism responds to the visitor's queries by indicating similar artifacts, which are ranked according to their similarity scores. This way, the visitor is able to navigate within a virtual museum not only by means of a virtual walkthrough but also by means of the context.

show abstract

Real-time visualisation and browsing of a distributed video database

Cited by 3 publications

References 0 publications

Multimodal Visual Data Registration for Web-Based Visualization in Media Production

Multimodal Visual Data Registration for Web-Based Visualization in Media Production

Hybrid visualisation of digital production big data

Content-based navigation within virtual museums

Contact Info

Product

Resources

About