Intelligent Time Delay Control of Telepresence Robots Using Novel Deep Reinforcement Learning Algorithm to Interact with Patients

Abstract

Telepresence robots are gaining more popularity as a means of remote communication and human–robot interaction, allowing users to control and operate a physical robot remotely. However, controlling these robots can be challenging due to the inherent delays and latency in the communication systems. In this research paper, we propose a novel hybrid algorithm exploiting deep reinforcement learning (DRL) with a dueling double-deep Q-network (DDQN) and a gated recurrent unit (GRU) to assist and maneuver the telepresence robot during the delayed operating signals from the operator. The DDQN is used to learn the optimal control policy for the telepresence robot in a remote healthcare environment during delayed communication signals. In contrast, the GRU is employed to model the control signals’ temporal dependencies and handle the variable time delays in the communication system. The proposed hybrid approach is evaluated analytically and experimentally. The results demonstrate the approach’s effectiveness in improving telepresence robots’ tracking accuracy and stability performance. Multiple experiments show that the proposed technique depicts improved controlling efficiency with no guidance from the teleoperator. It can control and manage the operations of the telepresence robot during the delayed communication of 15 seconds by itself, which is 2.4% better than the existing approaches. Overall, the proposed hybrid approach demonstrates the potential implementation of RL and deep learning techniques in improving the control and stability of the telepresence robot during delayed operating signals from the operator.

Telepresence robots as facilitators of physical exercise during COVID-19: a feasibility and acceptance study

“…Several studies have identified essential considerations around usability, navigation, and control interfaces that broadly influence the acceptance and adoption of telepresence robots (11)(12)(13)(14), which can inform device optimization in exercise contexts. Smooth maneuverability and camera operations impacted the perceived ease of use and the intention to employ healthcare telepresence robots (15).…”

Deep Learning based Enhanced Adaptive Despeckling for Ultrasound Images

“…This style of learning can be trained using supervised or unsupervised methods. The basic building block of the deep residual network [18] is shown in Figure 1: If the input layer of a network is x, the expected output result is 𝐻(𝑥). It is more difficult to directly use the convolutional layer to fit a potential identity map 𝐻(𝑥) = 𝑥.…”

“…The white box is the marked homogeneous region. [18] Random 25 images of.For each image in the experiment, a homogenous area is marked, and the average ENL value for each approach is counted. Table 6 demonstrates that the approach used in this paper can produce a higher equivalent visual index value, which is consistent with the speckle removal effect observed subjectively.…”

Enhancing Rotary Machine Reliability Through Condition-Based Maintenance Optimization

“…In addition, powerful AI algorithms have been applied to identify bearing difficulties across speed and load scenarios [22]. New diagnostic methods use neural networks and transfer learning to detect convolution-bearing flaws [23]. Signal processing methods like variation mode decomposition (VMD) have been extensively studied [24].…”