A mixed reality tele-presence platform to exchange emotion and sensory information based on MPEG-V standard

Lee, Hojun; Ha, Gyutae; Lee, Sang-Ho; Kim, Shiho

doi:10.1109/vr.2017.7892320

Cited by 12 publications

(11 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Current 360-degree capturing cameras (360-cameras) and videos (360videos) allow live capturing, streaming, and visualisation of the omnidirectional view of the surrounding real environment. 360-videos shown in HMDs allow for a high sense of telepresence [39,62], and MR in 360videos enables user interactions in the captured environment [48,52,62]. Recently, augmented virtual teleportation (AVT) [53] presented a platform for remote collaboration in MR using a 360-camera as a teleportal.…”

Section: Motivationmentioning

confidence: 99%

TeleGate: Multi-user Semi-teleportation for Remote Collaboration in Mixed Reality 360-Videos

Kim¹

2021

Preprint

View full text Add to dashboard Cite

Telepresence systems enable people to feel present in a remote space while their bodies remain in their local space. To enhance telepresence, the remote environment needs to be captured and visualised in an immersive way. For instance, 360-degree videos (360-videos) shown on head-mounted displays (HMDs) provide high fidelity telepresence in a remote place. Mixed reality (MR) in 360-videos enables interactions with virtual objects blended in the captured remote environment while it allows telepresence only for a single user wearing HMD. For this reason, it has limitations when multiple users want to experience telepresence together and naturally collaborate within a teleported space. This thesis presents TeleGate, a novel multi-user teleportation platform for remote collaboration in a MR space. TeleGate provides "semi-teleportation" into the MR space using large-scale displays, acting as a bridge between the local physical communication space and the remote collaboration space created by MR with captured 360-videos. Our proposed platform enables multi-user semi-teleportation to perform collaborative tasks in the remote MR collaboration (MRC) space while allowing for natural communication between collaborators in the same local physical space. We implemented a working prototype of TeleGate and then conducted a user study to evaluate our concept of semi-teleportation. We measured the spatial presence, social presence while participants performed remote collaborative tasks in the MRC space. Additionally, we also explored the different control mechanisms within the platform in the remote MR collaboration scenario. In conclusion, TeleGate enabled multiple co-located users to semi-teleport together using large-scale displays for remote collaboration in MR 360-videos.

show abstract

Section: Motivationmentioning

confidence: 99%

TeleGate: Multi-user Semi-teleportation for Remote Collaboration in Mixed Reality 360-Videos

Kim¹

2021

Preprint

View full text Add to dashboard Cite

show abstract

“…In Bielli and Mahmood's research works [12,13], they propose systems that can superimpose players' information on the player's image on a smartphone or tablet.…”

Section: Identification To Players And/or Teamsmentioning

confidence: 99%

“…As an example, Lee's research works [13] present a VR platform for spectators to share their reactions. With this platform, spectators are emerged in a virtual and remoted collective atmosphere, and appeared to be largely satisfied with this system.…”

Section: Reaction Sharingmentioning

confidence: 99%

See 1 more Smart Citation

Toward Augmented Reality Displays for Sports Spectators: A Preliminary Study

Hertzog

Sakurai

Hirota

et al. 2020

The 13th Conference of the International Sports Engineering Association

View full text Add to dashboard Cite

The sports industry and researchers work on improving spectators’ enjoyment to influence their consumption behavior. Many studies evaluated the variables impacting on enjoyment, but they did not consider the recent new technologies popularization. This study aims to update these considerations and reevaluate enjoyment parameters’ impact, considering display technologies use. Most of the previous research works identified identification to the players and teams as the most powerful enjoyment variable, but considering our survey results, participants cared more about the game understanding parameter, and manifested the wish to improve it via a display.

show abstract

“…Multi-user VR applications are designed for more than one user to be present in the virtual space at the same time. There are various parameters to be considered when developing such an application, as multi-user applications introduce challenges related to network performance, synchronisation among users and security to the system [6], [7], [8], [9].…”

Section: Introductionmentioning

confidence: 99%

Performance Evaluation of a Multi-User Virtual Reality Platform

Parthasarathy

Simiscuka

O’Connor

et al. 2020

2020 International Wireless Communications and Mobile Computing (IWCMC)

View full text Add to dashboard Cite

Virtual Reality (VR) popularity is increasing as it is becoming more affordable for end users. Available VR hardware includes low-end inexpensive devices like Google Cardboard and high-end ones like HTC Vive or Oculus Rift, which are more expensive headsets. Using VR as a platform for content delivery allows better user engagement than other traditional methods, as VR headsets remove external distractions. Multiuser VR applications provide shared experiences where users can communicate and interact in the same virtual space. This shared environment, however, introduces challenges regarding network performance, quality of service (QoS) and sessions privacy. This paper presents a multi-user VR application and aims to evaluate network behaviour in a number of scenarios, including real VR headsets (i.e. Oculus Rift), as well as simulated ones. This QoS analysis is important for the understanding of how many VR users can be simultaneously connected with high image quality.

show abstract

A mixed reality tele-presence platform to exchange emotion and sensory information based on MPEG-V standard

Cited by 12 publications

References 1 publication

TeleGate: Multi-user Semi-teleportation for Remote Collaboration in Mixed Reality 360-Videos

TeleGate: Multi-user Semi-teleportation for Remote Collaboration in Mixed Reality 360-Videos

Toward Augmented Reality Displays for Sports Spectators: A Preliminary Study

Performance Evaluation of a Multi-User Virtual Reality Platform

Contact Info

Product

Resources

About