An Immersive Telepresence System Using a Real-Time Omnidirectional Camera and a Virtual Reality Head-Mounted Display

Gaemperle, Luis; Seyid, Kerem; Popović, Vladan; Leblebici, Yusuf

doi:10.1109/ism.2014.62

Cited by 12 publications

(4 citation statements)

References 9 publications

(12 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The user and remote user communicate through voice, and hand gestures of the user can be transmitted to the camera side Immersive telepresence system [70] Fixed panoptic camera Head-mounted display…”

Section: Telepresence Platformsmentioning

confidence: 99%

“…An immersive telepresence system was presented in [70] as a device using an omnidirectional panoptic camera in combination with a VR HMD connected to a client computer. A panoptic camera is a device capable of sensing light from any direction around its center.…”

Section: Immersive Telepresence System [70]mentioning

confidence: 99%

“…Another component of a telepresence application is the delivery of transmitted signals to the user, which can be achieved using a screen and a loudspeaker like in Beam, Ava (Ava-ROBOTS: Your Guide to the World of Robotics, Available: https://robots.ieee.org/ robots/ava/, accessed on 14 March 2023) and QB (QB-ROBOTS: Your Guide to the World of Robotics, Available: https://robots.ieee.org/robots/qb/, accessed on 14 March 2023). Other works have used HMDs [67,68,70,88] like Oculus (Oculus Rift S: PC-Powered VR Gaming Headset | Oculus, Available: https://www.oculus.com/rift-s/, accessed on 14 March 2023), and HTC Vive ( VIVE-VR Headsets, Games, and Metaverse Life | United States, Available: https://www.vive.com/us/, accessed on 14 March 2023). The difference between monitors and HMDs as output media was studied in [89], specifically in the perception of human-like characters.…”

Section: Signal Outputmentioning

confidence: 99%

“…VR sickness is associated with symptoms like disorientation and nausea and is caused by factors like hardware (e.g., field of view and latency) and content (e.g., graphic realism and duration) [108]. Oscillopsia is associated with an instability in the visual world of an observer [109][110][111] and can be seen in applications where a camera transmitting visual information to an observer has to adjust its orientation to follow the observer [70]. Studies have been conducted on ways to reduce these effects [112,113], and they are important to take into account when designing immersive telepresence systems.…”

Section: Noveltiesmentioning

confidence: 99%

See 3 more Smart Citations

Telepresence in the Recent Literature with a Focus on Robotic Platforms, Applications and Challenges

Youssef,

Said,

Al Kork

et al. 2023

Robotics

View full text Add to dashboard Cite

Three decades ago, telepresence was presented as an idea in the context of remote work and manipulation. Since then, it has evolved into a field combining different technologies and allowing users to have more or less realistic perceptions of immersion in remote environments. This paper reviews telepresence and its recent advances. While not covering all the work conducted in telepresence, this paper provides an array of applications for which telepresence can be envisioned, providing a clear view of the differences between components and functionalities of robotic platforms conceived for telepresence and pointing to the dependence of telepresence on several technological areas. Furthermore, challenges faced by telepresence technologies are shown, with consideration of user experiences. We consider telepresence from different perspectives, focusing on specific parts, making it possible to foresee future directions of research and applications. This review will be useful for researchers working in telepresence and related fields.

show abstract

Section: Telepresence Platformsmentioning

confidence: 99%

Section: Immersive Telepresence System [70]mentioning

confidence: 99%

Section: Signal Outputmentioning

confidence: 99%

Section: Noveltiesmentioning

confidence: 99%

See 2 more Smart Citations

Telepresence in the Recent Literature with a Focus on Robotic Platforms, Applications and Challenges

Youssef,

Said,

Al Kork

et al. 2023

Robotics

View full text Add to dashboard Cite

show abstract

Interconnected Network of Cameras

Popović

Seyid²,

Çoğal³

et al. 2017

Design and Implementation of Real-Time Multi-Sensor Vision Systems

Self Cite

View full text Add to dashboard Cite

The real-time development of multi-camera systems is a great challenge. Synchronization and large data rates of the cameras adds to the complexity of these systems as well. The complexity of such system also increases as the number of their incorporating cameras increases. The customary approach to implementation of such system is a central type, where all the raw stream from the camera are first stored then processed for their target application. An alternative approach is to embed smart cameras to these systems instead of ordinary cameras with limited or no processing capability. Smart cameras with intra and inter camera processing capability and programmability at the software and hardware level will offer the right platform for distributed and parallel processing for multicamera systems real-time application development. Inter camera processing requires the interconnection of smart cameras in a network arrangement. A novel hardware emulating platform is introduced for demonstrating the concept of the interconnected network of cameras. A methodology is demonstrated for the interconnection network of camera construction and analysis. A sample application is developed and demonstrated.

show abstract

Intuitive and Interactive Robotic Avatar System for Tele-Existence: TEAM SNU in the ANA Avatar XPRIZE Finals

Park,

Kim,

Lim

et al. 2024

Int J of Soc Robotics

View full text Add to dashboard Cite

Avatar robots enable the teleoperation and telepresence of an operator with a rich and meaningful sense of existence in another location. Robotic avatar systems rely on intuitive interactions to afford operators comfortable and accurate robot control to perform various tasks. The ability of operators to feel immersed within a robot has drawn interest in multiple research fields to explore the future capabilities of such systems. This paper presents a robotic avatar system based on a custom humanoid robot, TOCABI, with a mobile base. Its teleoperation system was developed in response to the ANA Avatar XPRIZE. Combining the life-size humanoid robot and the mobile base allows for improved mobility and dexterous manipulation. The robotic avatar system comprises the robot/base and an operator station that incorporates haptic feedback devices, trackers, a head-mounted display, gloves, and pedals. These devices connect the robot-environment interaction and operator-avatar robot experience through visual, auditory, tactile, haptic, and kinesthetic feedback. Combining the untethered battery-operated and Wi-Fi-enabled robot with these sensory experiences enables intuitive control through the operator’s body movement. The performance of the robotic avatar system was evaluated through user studies and demonstrated in the ANA Avatar XPRIZE Finals, represented by Team SNU, where it completed 8 of the 10 missions, placing the team eighth among the 17 finalists.

show abstract

An Immersive Telepresence System Using a Real-Time Omnidirectional Camera and a Virtual Reality Head-Mounted Display

Cited by 12 publications

References 9 publications

Telepresence in the Recent Literature with a Focus on Robotic Platforms, Applications and Challenges

Telepresence in the Recent Literature with a Focus on Robotic Platforms, Applications and Challenges

Interconnected Network of Cameras

Intuitive and Interactive Robotic Avatar System for Tele-Existence: TEAM SNU in the ANA Avatar XPRIZE Finals

Contact Info

Product

Resources

About