A Proposed Meta-Reality Immersive Development Pipeline: Generative AI Models and Extended Reality (XR) Content for the Metaverse

Ratican, Jeremiah; Hutson, James H.; Wright, Andrew

doi:10.4236/jilsa.2023.151002

Cited by 23 publications

(5 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Virtual environments can be created instantly by utilizing generative models, providing users with countless chances for exploration. These produced worlds enhance the metaverse's richness and diversity, which might be anything from elaborate cityscapes to expansive landscapes (Lv, 2023; Ratican et al, 2023).…”

Section: Literature Reviewmentioning

confidence: 99%

Navigating the metaverse: A technical review of emerging virtual worlds

Herath,

Mittal,

Kataria

2024

WIREs Data Min & Knowl

View full text Add to dashboard Cite

The metaverse, a burgeoning virtual reality realm, has garnered substantial attention owing to its multifaceted applications. Rapid advancements and widespread acceptance of metaverse technologies have birthed a dynamic and intricate digital landscape. As various platforms, virtual worlds, and social networks within the metaverse increase, there is a growing imperative for a comprehensive analysis of its implications across societal, technological, and business dimensions. Notably, existing review studies have, for the past decade, primarily overlooked a metaverse‐based multidomain approach. A meticulous examination encompassing 207 research studies delves into the technological innovation of the metaverse, elucidating its future trajectory and ethical imperatives. Additionally, the article introduces the term “MetaWarria” to conceptualize potential conflicts arising from metaverse dynamics. The study discerns that healthcare (45%) and education (22%) are pivotal sectors steering metaverse developments, while the entertainment sector (9%) reshapes the corporate landscape. Artificial intelligence (AI) plays a 9% role in enhancing the metaverse's marketing and user experience. Security, privacy, and policy concerns (11%) are addressed due to escalating threats, yielding practical solutions. The analysis underscores the metaverse's profound influence (57%) on the digital realm, a phenomenon accelerated by the COVID‐19 pandemic. The article culminates in contemplating the metaverse's role in future warfare and national security, introducing “MetaWarria” as a conceptual framework for such discussions.This article is categorized under: Application Areas > Health Care Application Areas > Science and Technology Fundamental Concepts of Data and Knowledge > Human Centricity and User Interaction

show abstract

Section: Literature Reviewmentioning

confidence: 99%

Navigating the metaverse: A technical review of emerging virtual worlds

Herath,

Mittal,

Kataria

2024

WIREs Data Min & Knowl

View full text Add to dashboard Cite

show abstract

“…The interplay between Virtual Reality (VR) and Artificial Intelligence (AI) presents a unique conjuncture, providing a platform for innovative immersive experiences [59,5,62]. AI has been seamlessly woven into the fabric of VR applications, utilizing its generative ability to create captivating multimedia content, such as images, audio, text, and 3D meshes [52,61,4,57].…”

Section: Introductionmentioning

confidence: 99%

DreamCodeVR: Towards Democratizing Behavior Design in Virtual Reality with Speech-Driven Programming

Giunchi,

Numan,

Gatti

et al. 2024

2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)

View full text Add to dashboard Cite

Virtual Reality (VR) has revolutionized how we interact with digital worlds. However, programming for VR remains a complex and challenging task, requiring specialized skills and knowledge. Powered by large language models (LLMs), DreamCodeVR is designed to assist users, irrespective of their coding skills, in crafting basic object behavior in VR environments by translating spoken language into code within an active application. This approach seeks to simplify the process of defining behaviors visual changes through speech. Our preliminary user study indicated that the system's speech interface supports elementary programming tasks, highlighting its potential to improve accessibility for users with varying technical skills. However, it also uncovered a wide range of challenges and opportunities. In an extensive discussion, we detail the system's strengths, weaknesses, and areas for future research.

show abstract

“…It is a specific category of AI that aims to autonomously generate new content that imitates the content created by humans in different modalities, including images [42,94], audio [101,100], text [32,13], and even 3D objects [81,87]. With the rapid development of GenAI, various applications, such as text-to-image generation [68,116], textto-speech (TTS) synthesis [65,144], chatbot [1,79], and AI-empowered mixed reality (MR) [98,137], have been widely used by consumers. Recently, GenAI models rely on deep neural networks, such as generative adversarial networks (GANs) [39] and large language models (LLMs) [10] because of the higher complexity of the generative tasks.…”

Section: Introductionmentioning

confidence: 99%

An Overview on Generative AI at Scale with Edge-Cloud Computing

Wang¹,

Xue²,

Wei³

et al. 2023

Preprint

View full text Add to dashboard Cite

<p>As a specific category of artificial intelligence (AI), generative artificial intelligence (GenAI) generates new content that resembles what is created by humans. The rapid development of GenAI systems has created a huge amount of new data on the Internet, posing new challenges to current computing and communication frameworks. Currently, GenAI services rely on the traditional cloud computing framework due to the need for large computation resources. However, such services will encounter high latency because of data transmission and a high volume of requests. On the other hand, edge-cloud computing can provide adequate computation power and low latency at the same time through the collaboration between edges and the cloud. Thus, it is attractive to build GenAI systems at scale by leveraging the edge-cloud computing paradigm. In this overview paper, we review recent developments in GenAI and edge-cloud computing, respectively. Then, we use two exemplary GenAI applications to discuss technical challenges in scaling up their solutions using edge-cloud collaborative systems. Finally, we list design considerations for training and deploying GenAI systems at scale and point out future research directions. </p>

show abstract

A Proposed Meta-Reality Immersive Development Pipeline: Generative AI Models and Extended Reality (XR) Content for the Metaverse

Cited by 23 publications

References 28 publications

Navigating the metaverse: A technical review of emerging virtual worlds

Navigating the metaverse: A technical review of emerging virtual worlds

DreamCodeVR: Towards Democratizing Behavior Design in Virtual Reality with Speech-Driven Programming

An Overview on Generative AI at Scale with Edge-Cloud Computing

Contact Info

Product

Resources

About