Real-Sense Media Representation Technology Using Multiple Devices Synchronization

Abstract

Abstract. Recently, the requirements for the real-sense media representation are increasing rapidly. Until now, most people mainly used the method SMSD on one device, but we need more than one device to play multiple audio/videos and multiple sensory effects of the real-sense media. Therefore, multi-track media synchronization and effect device synchronization algorithms are very important part of the real-sense media representation. Therefore, in this paper, we suggested concept of the real-sense media playback, sensory effect metadata scheme, real-sense media playback system architecture, and synchronization algorithm of multiple audio/video devices and multiple sensory effect devices.

Integration of Multisensorial Effects in Synchronised Immersive Hybrid TV Scenarios

“…As in traditional media, in mulsemedia scenarios there is also a need for achieving a synchronised state between the involved streams, in order to include mulsemedia content into traditional multimedia (i.e., AV) content. In previous studies, such as [64], [65], [66] and [67], this specific challenge has been studied. In particular, a sync algorithm for multi-device scenarios to provide synchronised mulsemedia experiences is presented in [64].…”

“…In previous studies, such as [64], [65], [66] and [67], this specific challenge has been studied. In particular, a sync algorithm for multi-device scenarios to provide synchronised mulsemedia experiences is presented in [64]. In that study, the mulsemedia content is separated into different streams, depending on the involved sense or effect (e.g., heat, wind, scent, light or vibration).…”

Especificación, implementación y evaluación de soluciones de sincronización multimedia híbrida (broadcast/broadband) e inter-destinatario para posibilitar nuevas experiencias televisivas enriquecidas, personalizadas, inmersivas y compartidas.

“…En [141] el contenido mulsemedia se separa en diferentes flujos, dependiendo del sentido que esté involucrado (como por ejemplo, calor, viento, aromas, luz o vibración). El algoritmo de sincronización que se propone en dicho trabajo está basado en el uso del protocolo RTP/RTCP y consiste en un esquema M/S donde el dispositivo encargado de presentar el contenido audiovisual adopta el rol de máster.…”

“…Fig 141. Opinión preliminar acerca de la mejora de la experiencia de consumo con la inclusión de efectos multisensoriales…”