Toward Hyper-Realistic and Interactive Social VR Experiences in Live TV Scenarios

Fernández, Sergi; Montagud, Mario; Cernigliaro, Gianluca; Rivera, David Rincón

doi:10.1109/tbc.2021.3123499

Cited by 24 publications

(15 citation statements)

References 48 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…La mayoría de las plataformas de RV Social se basan en el uso de avatares sintéticos, ya sean con apariencia de dibujos animados o humana, para representar a los usuarios (Montagud, et al 2022;Rincón, 2022b). Esto se ha identificado como una barrera para casos de uso en los que se requiere una apariencia seria, profesional y/o fidedigna (Lee;Joo;Jun, 2021) un impacto en el sector educativo, como se analiza a continuación.…”

Section: Avatares Vs Representaciones Realistas En Rv Socialunclassified

Capítulo 7. Realidad virtual social y comunicaciones holográficas en 3D: oportunidades y retos pendientes en el sector de la educación

Montagud

Cernigliaro

Arevalillo‐Herráez

et al. 2023

Espejo de Monografías

View full text Add to dashboard Cite

En los últimos años se está explorando el uso y adopción de tecnologías innovadoras en el sector de la educación y aprendizaje. Asimismo, modelos de educación y docencia online están ganando protagonismo, ya sea debido a una implantación voluntaria o forzosa de programas de educación remota y/o híbrida. Este auge ha hecho palpable las limitaciones de los sistemas de comunicaciones audiovisuales 2D, como la videoconferencia, en varios sentidos: confort, calidad de interacción, conciencia situacional, (co-)presencia, etc. Este trabajo introduce un nuevo medio de comunicación, interacción y colaboración que promete ser un candidato idóneo para superar estas limitaciones haciendo uso de tecnologías inmersivas: la Realidad Virtual (RV) Social. En primer lugar, se aportará una revisión de evidencias científicas recientes que vislumbran y demuestran potenciales beneficios de este medio para diferentes casos de uso de interés, en comparación al uso de sistemas de videoconferencia 2D tradicionales. Asimismo, se destacarán los potenciales beneficios que puede aportar la disponibilidad de representaciones holográficas 3D de los usuarios en comparación al uso de avatares sintéticos (y por tanto, poco realistas) en entornos de RV Social. A continuación, se destacarán una serie de retos a nivel tecnológico y de experiencia de usuario a superar con tal de conseguir una implantación efectiva y masiva de este nuevo medio de comunicación. Palabras clave: realidad virtual social, comunicaciones holográficas, metaverso, holoportación, educación inmersiva, educación virtual.

show abstract

Section: Avatares Vs Representaciones Realistas En Rv Socialunclassified

Capítulo 7. Realidad virtual social y comunicaciones holográficas en 3D: oportunidades y retos pendientes en el sector de la educación

Montagud

Cernigliaro

Arevalillo‐Herráez

et al. 2023

Espejo de Monografías

View full text Add to dashboard Cite

show abstract

“…In [12] the authors proposed a lightweight social VR platform that allows multiple users in shared virtual environments (e.g., a live TV show) to socially interact and collaborate though the broadband media contents. Since traditional IoT targets on narrowband applications, CATtalk can serve as intelligent control for the VR platform proposed in [12]. Details of the integration can be found in [13].…”

Section: Related Workmentioning

confidence: 99%

“…Line SA02 imports the DA library. Line SA03 imports the Swing1_API library provided by the artist at Figure 9 (12). Line SA04 specifies the URL of the CATtalk server.…”

Section: Da and Sa Generationmentioning

confidence: 99%

CATtalk: An IoT-Based Interactive Art Development Platform

2022

View full text Add to dashboard Cite

Interactive art has been significant advanced by the Internet of Things (IoT) and cyber physical interaction technologies, which enables the participants to engage with the art devices. Several tools and platforms have been proposed to create the art devices. However, the interactive artworks are typically developed with these art devices in ad hoc approaches, and the artists need to spend significant programming efforts to integrate the art devices. This paper proposes CATtalk, a platform to create and maintain interactive artworks. The novel idea is to treat all art devices in an interactive artwork as IoT devices that can be transparently reused by reconfiguration in CATtalk. Therefore, the artworks developed independently by individual artists can be quickly integrated to create new interactive applications. Through CATtalk's no-code and low-code mechanisms, the artists can manipulate CATtalk with little or no programing efforts. CATtalk offers a built-in mechanism so that any person in the audience can play with an interactive artwork with his/her smartphone. We also conduct analytic analysis, simulation and measurements to ensure that the interactive art performance in cross-country remote stages are not affected by the communications delays. In our measurements, the average local and remote communication delays are about 0.01 and 0.05 seconds, respectively. If the art performance is designed such that the average delay between two actions of a local (remote) performer is longer than 0.1 seconds, then the probability of out-of-sequence actions is less than 0.01%. That is, the local dancer should perform slower than the remote dancer. Such delay analysis for remote interactive art performance has not been conducted in the literature.

show abstract

“…The olfactory system can be triggered by vaporizer devices [5], and finally lighting fixtures can be used to stimulate the visual system. Enhancing the sense of reality and the strength of emotions can be seen as the primary reasons of adding effects to audio-visual contents, to achieve better viewing experience [8]- [11]. Most of the rendering devices for sensory effects in mulsemedia applications are using short range wireless communication standards (i.e., Bluetooth, WiFi, ZigBee,) to connect and render the effects, having as main disadvantage the used architecture.…”

Section: Introductionmentioning

confidence: 99%

“…In state of the art of mulsemedia assessments, ad-hoc systems were used rendering the effects. In [4], [9] and [11], a gaming console equipped with two fans and a vibrating bar was used to render haptic effects and the wind flow. The video was displayed on a 24" PC monitor and two loudspeakers with integrated RGB LED lights delivered the visual effects.…”

Section: Introductionmentioning

confidence: 99%

A QoE Model for Mulsemedia TV in a Smart Home Environment

Jalal

Puddu

Martini

et al. 2023

IEEE Trans. on Broadcast.

View full text Add to dashboard Cite

The provision to the users of realistic media contents is one of the main goals of future media services. The sense of reality perceived by the user can be enhanced by adding various sensorial effects to the conventional audio-visual content, through the stimulation of the five senses stimulation (sight, hearing, touch, smell and taste), the so-called multi-sensorial media (mulsemedia). To deliver the additional effects within a smart home (SH) environment, custom devices (e.g., air conditioning, lights) providing opportune smart features, are preferred to adhoc devices, often deployed in a specific context such as for example in gaming consoles. In the present study, a prototype for a mulsemedia TV application, implemented in a real smart home scenario, allowed the authors to assess the user's Quality of Experience (QoE) through test measurement campaign. The impact of specific sensory effects (i.e., light, airflow, vibration) on the user experience regarding the enhancement of sense of reality, annoyance, and intensity of the effects was investigated through subjective assessment. The need for multi sensorial QoE models is an important challenge for future research in this field, considering the time and cost of subjective quality assessments. Therefore, based on the subjective assessment results, this paper instantiates and validates a parametric QoE model for multi-sensorial TV in a SH scenario which indicates the relationship between the quality of audiovisual contents and user-perceived QoE for sensory effects applications.

show abstract

Toward Hyper-Realistic and Interactive Social VR Experiences in Live TV Scenarios

Cited by 24 publications

References 48 publications

Capítulo 7. Realidad virtual social y comunicaciones holográficas en 3D: oportunidades y retos pendientes en el sector de la educación

Capítulo 7. Realidad virtual social y comunicaciones holográficas en 3D: oportunidades y retos pendientes en el sector de la educación

CATtalk: An IoT-Based Interactive Art Development Platform

A QoE Model for Mulsemedia TV in a Smart Home Environment

Contact Info

Product

Resources

About