A Brief Survey of Telerobotic Time Delay Mitigation

Abstract

There is a substantial number of telerobotics and teleoperation applications ranging from space operations, ground/aerial robotics, drive-by-wire systems to medical interventions. Major obstacles for such applications include latency, channel corruptions, and bandwidth which limit teleoperation efficacy. This survey reviews the time delay problem in teleoperation systems. We briefly review different solutions from early approaches which consist of control-theory-based models and user interface designs and focus on newer approaches developed since 2014. Future solutions to the time delay problem will likely be hybrid solutions which include modeling of user intent, prediction of robot movements, and time delay prediction all potentially using time series prediction methods. Hence, we examine methods that are primarily based on time series prediction. Recent prediction approaches take advantage of advances in nonlinear statistical models as well as machine learning and neural network techniques. We review Recurrent Neural Networks, Long Short-Term Memory, Sequence to Sequence, and Generative Adversarial Network models and examine each of these approaches for addressing time delay. As time delay is still an unsolved problem, we suggest some possible future research directions from information-theory-based modeling, which may lead to promising new approaches to advancing the field.

TeleParallax: Low-Motion-Blur Stereoscopic System With Correct Interpupillary Distance for 3D Head Rotations

“…A recent study in medical robotics reported that more than 0.4 s delay affected the surgeon's performance (Madder et al, 2020). Therefore, further study is required to confirm that our system works in high-latency networks and approaches to mitigate time delay should be considered (Farajiparvar et al, 2020).…”

A Survey and Taxonomy of Latency Compensation Techniques for Network Computer Games

“…For topics, we only consider multiplayer interactive systems, so this excludes the related area of tele-operation, which can also sufer from network latency. The interested reader is encouraged to refer to a survey by Farajiparvar et al [44] for more information on this topic.…”

A Perspective on Time Toward Wireless 6G

“…The increased distance between the components, as well as the fact that the infrastructure is shared with other (unknown) users, makes precise control over the timing more challenging. One way to compensate for this is to reduce the frequency of the cycle, provided that the controlled process allows for it, or to adopt predictive strategies [145] that attempt to estimate the state of the remote system and revise control commands accordingly.…”