Design of Metaverse for Two-Way Video Conferencing Platform Based on Virtual Reality

Abstract

As non-face-to-face activities have become commonplace, online video conferencing platforms have become popular collaboration tools. However, existing video conferencing platforms have a structure in which one side unilaterally exchanges information, potentially increase the fatigue of meeting participants. In this study, we designed a video conferencing platform utilizing virtual reality (VR), a metaverse technology, to enable various interactions. A virtual conferencing space and realistic VR video conferencing content authoring tool support system were designed using Meta's Oculus Quest 2 hardware, the Unity engine, and 3D Max software. With the Photon software development kit, voice recognition was designed to perform automatic text translation with the Watson application programming interface, allowing the online video conferencing participants to communicate smoothly even if using different languages. It is expected that the proposed video conferencing platform will enable conference participants to interact and improve their work efficiency.

Natural Language Processing Influence on Digital Socialization and Linguistic Interactions in the Integration of the Metaverse in Regular Social Life

“…It makes real-time translation and transcription possible, removing barriers based on language and promoting a more open and international exchange of ideas. Virtual conferences in the Metaverse happen in dynamic 3D environments that can be customized to resemble actual conference spaces, such as networking lounges and auditoriums, rather than being limited to flat screens and still images [104]. Participant engagement is increased by this immersive experience, which gives the impression that attendees are in person.…”

Exploring Current Technologies, Applications, and Challenges in the Metaverse: A Comprehensive Survey

“…In the Metaverse, individuals can engage in virtual meetings where body language and eye contact can be used to convey emotions and intentions, enhancing communication and collaboration. By leveraging the immersive nature of the Metaverse, telecommuting experiences can be significantly improved, allowing coworkers to connect and collaborate seamlessly from diverse perspectives, regardless of physical distance [28][29][30].…”

Exploring the Perception of the Effect of Three-Dimensional Interaction Feedback Types on Immersive Virtual Reality Education

“…Recently, in addition to the experience of a certain educational condition in a real space, students can increase their effectiveness with a highly immersive experience in a mixed-reality (MR) area by providing five types of sensory information rather than learning through 2D textbooks [14]. Educational studies in immersive environments have been conducted on whether the experience of participants in a mixed-reality setting is equivalent to a real-world setting [15]. For example, researchers developed AR education content to visualize virtual examples registered in textbook images, and the AR content was helpful to intuitively learn educational information by using more interactive situations [16].…”