An Authoring Model for Interactive 360 Videos

Mendes, Paulo Renato da Costa; Guedes, Álan L. V.; Moraes, Daniel de Sousa; Azevedo, Roberto Gerson Albuquerque; Colcher, Sérgio

doi:10.1109/icmew46912.2020.9105958

Cited by 9 publications

(9 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…As part of this method, we also define an algorithm for finding an adequate number of clusters based on the silhouette score. We investigate to what extent this method can be used as the core to leverage and enhance some innovative applications, especially in three different practical and important tasks: Video Face Recognition [2], Educational Video Recommendation [4], and Subtitles Positioning in 360-Video [3].…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Spatio-temporal Localization of Actors in Video/360-Video and its Applications

Mendes

Colcher

2022

Anais Estendidos Do XXVIII Simpósio Brasileiro De Sistemas Multimídia E Web (WebMedia 2022)

View full text Add to dashboard Cite

The popularity of platforms for storing and transmitting video content has created a substantial volume of video data. Given a set of actors present in a video, generating metadata with the temporal determination of the interval in which each actor is present and their spatial 2D localization in each frame in these intervals can facilitate video retrieval and recommendation. In this work, we investigate Video Face Clustering for this spatio-temporal localization of actors in videos. We first describe our method for Video Face Clustering in which we take advantage of face detection, embeddings, and clustering methods to group similar faces of actors in different frames and provide the spatio-temporal localization of them. Then, we explore, propose, and investigate innovative applications of this spatio-temporal localization in three different tasks: (i) Video Face Recognition, (ii) Educational Video Recommendation and (iii) Subtitles Positioning in 360-video.

show abstract

Section: Discussionmentioning

confidence: 99%

“…In [3], we proposed an authoring model for interactive 360video. In such a model, we can define interactive 360-videos that are presented together with additional information, such as images, text, subtitles, 2D traditional videos, and spatial audio.…”

Section: Subtitles Positioning In 360-videosmentioning

confidence: 99%

Spatio-temporal Localization of Actors in Video/360-Video and its Applications

Mendes

Colcher

2022

Anais Estendidos Do XXVIII Simpósio Brasileiro De Sistemas Multimídia E Web (WebMedia 2022)

View full text Add to dashboard Cite

show abstract

“…Based on the videogame development industry, which is a current environment for VR content creation [23], the work of [18] recommends the use of VR to produce and place objects within the content in order to improve production and provide greater fidelity in the final product. For this particular type of technology, game engines, such as Unity 1 , offer good production support for VR content, as well as support for standard media, such as image, video and audio, user interaction and even integration with sensory effects [20], [21].…”

Section: Introductionmentioning

confidence: 99%

Immersive Authoring of 360 Degree Interactive Applications

et al. 2022

View full text Add to dashboard Cite

Although there are proposals in the literature for authoring mulsemedia (multiple sensorial media) applications with 2D content, there are no suitable solutions when it comes to 360°content. Moreover, little consensus on 360°mulsemedia authoring methodology exists. Aiming at filling this gap, we propose the concept of immersive authoring of 360°multisensory applications. Our proposal comprises an immersive 360°authoring environment to bring the author closer to the final user presentation environment. We implemented our proposal in AMUSEVR, a virtual-reality (VR) environment for authoring 360°m ulsemedia applications. We see it as an alternative or a possible complement to available 2D mulsemedia authoring tools. AMUSEVR provides creation and editing of interactive multiple sensorial media scenes by directly arranging objects in a 3D space using VR technology. Also, the tool allows users to run their applications through AMUSEVR viewer mode. We used the Goal Question Metric (GQM) approach to plan our tests and a group of users evaluated the tool with the SUS and UEQ questionnaires, obtaining a SUS score of 82.25 and an excellent UEQ benchmark, which are very promising results.

show abstract

“…Besides supporting dynamic subtitles positioning in 360-videos, it also supports navigation among 360-videos, additional media, interactive behaviors such as selection and guided attention. For other case studies not closely related to this dissertation, please check our paper that presents this authoring model (64). This model is supported by a player based on the Unity Game Engine.…”

Section: Discussionmentioning

confidence: 99%

“…As a result of this research, three papers have already been published at relevant multimedia conferences (62,63,64). In (62), we have evaluated video face clustering together with a cluster-matching method for video face recognition.…”

Section: Publicationsmentioning

confidence: 99%

Spatio-Temporal Localization of Actors in Video/360-Video and Its Applications

MENDES¹

View full text Add to dashboard Cite

Thanks to my advisor Prof. Sérgio Colcher for his guidance and support in this journey. Thanks to my family for the endless support. Thanks to my friends from TeleMídia Lab, for their friendship and support. To all colleagues, faculty and staff of the PUC Rio Department of Informatics for the fellowship, learning and support. This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior -Brasil (CAPES) -Finance Code 001.

show abstract

An Authoring Model for Interactive 360 Videos

Cited by 9 publications

References 8 publications

Spatio-temporal Localization of Actors in Video/360-Video and its Applications

Spatio-temporal Localization of Actors in Video/360-Video and its Applications

Immersive Authoring of 360 Degree Interactive Applications

Spatio-Temporal Localization of Actors in Video/360-Video and Its Applications

Contact Info

Product

Resources

About