VR-Based Immersive Service Management in B5G Mobile Systems: A UAV Command and Control Use Case

Taleb, Tarik; Sehad, Nassim; Nadir, Zinelaabidine; Song, JaeSeung

doi:10.1109/jiot.2022.3222282

Cited by 23 publications

(7 citation statements)

References 76 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…As the integration of virtual reality does not change the robot control input, the VR teleoperation platform can also be applied to a wide range of robotic systems such as humanoid robot [41][42] [43] ground mobile robot [44][45] [46], unmanned aerial vehicle [47][48] [49], and cobot [50] [51]. The typical operating software for these robots is Robot Operating System (ROS) thanks to its maturity, standardized framework, and various tools and libraries for robotics development [52] [53].…”

Section: Literature Reviewmentioning

confidence: 99%

Effectiveness of IoT and VR for Real-Time Teleoperation of Industrial Robots

Luu,

Nguyen,

Tran

et al. 2024

Preprint

View full text Add to dashboard Cite

During the early stages of the Industry 4.0 era, teleoperation with human involvement in manufacturing processes and robot operation remained important. The existing teleoperation technologies have limitations in providing operator with spatial awareness and initiative control mechanism, making their applications difficult in tasks with high complexity and precision. This study implements the advancements from the Internet of Things (IoT) and Virtual Reality (VR) technology to improve the real-time teleoperation for industrial robots. The proposed design utilizes the benefits of the Message Queuing Telemetry Transport (MQTT) protocol in conjunction with a cloud broker, which has not been addressed significantly in previous studies for teleoperation. This setup enables the system to efficiently handle substantial amounts of data in short periods of time, allowing for an uninterrupted user experience while maintaining a consistent connection regardless of distance. Real-time robot control is accomplished by tracking the user's hand movements with a VR controller while providing the user with visual feedback from the VR environment. The incorporation of VR technology intends to improve the intuitiveness of controlling robot operations, provide more responsive feedback, and improve the quality of work performed by operators. Practical experiments are conducted with an industrial robot to observe the performance against the system under different internet conditions and different QoS setups. The evaluation criteria primarily concern latency and accuracy. The experiment aims to evaluate the effectiveness and scalability of the suggested system and to offer significant insight into its advantages and limitations relative to existing control system through systematic investigation.

show abstract

Section: Literature Reviewmentioning

confidence: 99%

Effectiveness of IoT and VR for Real-Time Teleoperation of Industrial Robots

Luu,

Nguyen,

Tran

et al. 2024

Preprint

View full text Add to dashboard Cite

show abstract

“…Recently, Taleb et al [18] proposed a complete framework for enabling immersive services in an enhanced teleoperation UAV case, also considering a real-life 5G network. This work examined various KPIs describing the system's performance and excellent in-depth analysis.…”

Section: B Related Work and Contributionmentioning

confidence: 99%

“…There is no congestion control in UDP. Additionally, the use of UDP or TCP is commonly known in the UAV community and the MAVLink protocol [16]- [18], so the proposed solution remains consis- tent with the alternatives in the transport network layer.…”

Section: A System Design and Architecturementioning

confidence: 99%

Toward 5G Edge Computing for Enabling Autonomous Aerial Vehicles

2023

View full text Add to dashboard Cite

Offloading processes responsible for a robot's control operation to external computational resources has been in the spotlight for many years. The vision of having access to a full cloud cluster for any autonomous robot has fueled many scientific fields. Such implementations rely strongly on a robust communication link between the robot and the cloud and have been tested over numerous network architectures. However, various limitations have been highlighted upon the realization of such platforms. For small-scale local deployments, technologies such as Wi-Fi, Zigbee, and blacktooth are inexpensive and easy to use but suffer from low transmit power and outdoor coverage limitations. In this study, the offloading time-critical control operations for an unmanned aerial vehicle (UAV) using cellular network technologies were evaluated and demonstrated experimentally, focusing on the 5G technology. The control process was hosted on an edge server that served as a ground control station (GCS). The server performs all the computations required for the autonomous operation of the UAV and sends the action commands back to the UAV over the 5G interface. This research focuses on analyzing the low-latency needs of a closed-loop control system that is put to the test on a real 5G network. Furthermore, practical limitations, integration challenges, the intended cellular architecture, and the corresponding Key Performance Indicators (KPIs) that correlate to the real-life behavior of the UAV are rigorously studied. INDEX TERMS 5G, Edge computing, Robotics, UAV I. INTRODUCTION A. BACKGROUND & MOTIVATION

show abstract

“…The authors [26] presented an overview of current technologies related to medical healthcare systems and discussed their advantages and limitations. The authors also proposed a framework for using UAVs in disaster relief situations.…”

Section: Related Workmentioning

confidence: 99%

A UAV-Assisted Stackelberg Game Model for Securing loMT Healthcare Networks

Shaikh

Wang

Khan

et al. 2023

Drones

View full text Add to dashboard Cite

On the one hand, the Internet of Medical Things (IoMT) in healthcare systems has emerged as a promising technology to monitor patients’ health and provide reliable medical services, especially in remote and underserved areas. On the other hand, in disaster scenarios, the loss of communication infrastructure can make it challenging to establish reliable communication and to provide timely first aid services. To address this challenge, unmanned aerial vehicles (UAVs) have been adopted to assist hospital centers in delivering medical care to hard-to-reach areas. Despite the potential of UAVs to improve medical services in emergency scenarios, their limited resources make their security critical. Therefore, developing secure and efficient communication protocols for IoMT networks using UAVs is a vital research area that can help ensure reliable and timely medical services. In this paper, we introduce a novel Stackelberg security-based game theory algorithm, named Stackelberg ad hoc on-demand distance vector (SBAODV), to detect and recover data affected by black hole attacks in IoMT networks using UAVs. Our proposed scheme utilizes the substantial Stackelberg equilibrium (SSE) to formulate strategies that protect the system against attacks. We evaluate the performance of our proposed SBAODV scheme and compare it with existing routing schemes. Our results demonstrate that our proposed scheme outperforms existing schemes regarding packet delivery ratio (PDR), networking load, throughput, detection ratio, and end-to-end delay. Specifically, our proposed SBAODV protocol achieves a PDR of 97%, throughput ranging from 77.7 kbps to 87.3 kbps, and up to 95% malicious detection rate at the highest number of nodes. Furthermore, our proposed SBADOV scheme offers significantly lower networking load (7% to 30%) and end-to-end delay (up to 30%) compared to existing routing schemes. These results demonstrate the efficiency and effectiveness of our proposed scheme in ensuring reliable and secure communication in IoMT emergency scenarios using UAVs.

show abstract

VR-Based Immersive Service Management in B5G Mobile Systems: A UAV Command and Control Use Case

Cited by 23 publications

References 76 publications

Effectiveness of IoT and VR for Real-Time Teleoperation of Industrial Robots

Effectiveness of IoT and VR for Real-Time Teleoperation of Industrial Robots

Toward 5G Edge Computing for Enabling Autonomous Aerial Vehicles

A UAV-Assisted Stackelberg Game Model for Securing loMT Healthcare Networks

Contact Info

Product

Resources

About