Novel AR-based interface for human-robot interaction and visualization

Fang, Hongfei; Ong, S. K.; Nee, A. Y. C.

doi:10.1007/s40436-014-0087-9

Cited by 50 publications

(18 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Touchscreen interactions through AR views are very popular egocentric interfaces [19,30,57,67] and have been increasingly applied to drone controllers. exTouch uses a spatially aware egocentric approach to manipulate moving physical objects (e.g., drones) through an ARmediated mobile interface [38].…”

Section: Ar-based Egocentric Drone Interfacementioning

confidence: 99%

PinpointFly: An Egocentric Position-control Drone Interface using Mobile AR

Chen

Takashima

Fujita

et al. 2021

Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Accurate drone positioning is challenging because pilots only have a limited position and direction perception of a fying drone from their perspective. This makes conventional joystick-based speed control inaccurate and more complicated and signifcantly degrades piloting performance. We propose PinpointFly, an egocentric drone interface that allows pilots to arbitrarily position and rotate a drone using position-control direct interactions on a see-through mobile AR where the drone position and direction are visualized with a virtual cast shadow (i.e., the drone's orthogonal projection onto the foor). Pilots can point to the next position or draw the drone's fight trajectory by manipulating the virtual cast shadow and the direction/height slider bar on the touchscreen. We design and implement a prototype of PinpointFly for indoor and visual line of sight scenarios, which are comprised of real-time and predefned motion-control techniques. We conduct two user studies with simple positioning and inspection tasks. Our results demonstrate that PinpointFly makes the drone positioning and inspection operations faster, more accurate, simpler and fewer workload than a conventional joystick interface with a speed-control method. CCS CONCEPTS• Human-centered computing → Human computer interaction (HCI).

show abstract

Section: Ar-based Egocentric Drone Interfacementioning

confidence: 99%

PinpointFly: An Egocentric Position-control Drone Interface using Mobile AR

Chen

Takashima

Fujita

et al. 2021

Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…An AR interface was proposed in [52] that uses a marker cube attached to a probe, which allows a user to guide a virtual robot by setting waypoints and orientations. The AR scene is visualized through a desktop monitor.…”

Section: Augmented Reality-based Approachesmentioning

confidence: 99%

Advanced Robot Programming: a Review

et al. 2020

View full text Add to dashboard Cite

Purpose of Review The review presents an overview of advanced robot programming approaches which aims to ease robot programming and speed up the deployment of industrial robots, and then some considerations are shared with respect to requirements in new trends of manufacturing. Recent Findings The new trend of customization along with Industry 4.0 is appearing which is a challenge for robotized systems. The bottleneck is mainly the efficiency of deployment of industrial robots because traditional programming methods are not intuitive and always time-consuming. Advanced robot programming techniques are expected to ease robot programming and make it accessible for non-experts. Summary A review on advanced robot programming is here presented, firstly introducing the background of this research, followed by reviewing literatures in four categories: programming by demonstration for low-level motion, programming by demonstration for high-level task, speech recognition-based and augmented reality-based programming approaches, and finishing on discussing future works.

show abstract

“…Several works [12]- [18] have explored the idea of visualizing the robot's path using AR systems. In [19], an interactive AR path generation system is proposed. Different interaction modalities have been developed: users can add, remove or modify spatial points directly in the real environment using a custom probe.…”

Section: Related Work a Augmented Reality And Industrial Robotsmentioning

confidence: 99%

An Augmented Reality System to Support Fault Visualization in Industrial Robotic Tasks

et al. 2019

View full text Add to dashboard Cite

The digitalization is transforming the very nature of factories, from automated systems to intelligent ones. In this process, industrial robots play a key role. Even if repeatability, precision and velocity of the industrial manipulators enable reaching considerable production levels, factories are required to face an increasingly competitive market, which requires being able to dynamically adapt to different situations and conditions. Hence, facilities are moving toward systems that rely on the collaboration between humans and machines. Human workers should understand the behavior of the robots, placing trust in them to properly collaborate. If a fault occurs on a manipulator, its movements are suddenly stopped for security reasons, thus workers may not be able to understand what happened to the robot. Therefore, the operators' stress and anxiety may increase, compromising the human-robot collaborative scenario. This work fits in this context and it proposes an adaptive Augmented Reality system to display industrial robot faults by means of the Microsoft HoloLens device. Starting from the methodology employed to identify which virtual metaphors best evoke robot faults, an adaptive modality is presented to dynamically display the metaphors in positions close to the fault location, always visible from the user and not occluded by the manipulator. A comparison with a non adaptive modality is proposed to assess the effectiveness of the adaptive solution. Results show that the adaptive modality allows users to recognize faults faster and with fewer movements than the non adaptive one, thus overcoming the limitation of the narrow field-of-view of the HoloLens device.

show abstract

Novel AR-based interface for human-robot interaction and visualization

Cited by 50 publications

References 39 publications

PinpointFly: An Egocentric Position-control Drone Interface using Mobile AR

PinpointFly: An Egocentric Position-control Drone Interface using Mobile AR

Advanced Robot Programming: a Review

An Augmented Reality System to Support Fault Visualization in Industrial Robotic Tasks

Contact Info

Product

Resources

About