Sensorless Hand Guidance Using Microsoft Hololens

Puljiz, David; Stöhr, Erik; Hein, Björn; Kröger, Torsten

doi:10.1109/hri.2019.8673145

Cited by 6 publications

(2 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Puljiz et al [24] presented a work on programming a collaborative robot using Microsoft Hololens mixed reality HMD with a KUKA KR-5 collaborative robot and ROS as an operating system. Luebbers et al [25] presented a novel augmented reality interface for the visualization and directed control of robot skill learning from demonstration (LfD).…”

Section: State Of the Artmentioning

confidence: 99%

Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot

Pinto

Kildal

Lazkano

2020

MTI

View full text Add to dashboard Cite

In the context of industrial production, a worker that wants to program a robot using the hand-guidance technique needs that the robot is available to be programmed and not in operation. This means that production with that robot is stopped during that time. A way around this constraint is to perform the same manual guidance steps on a holographic representation of the digital twin of the robot, using augmented reality technologies. However, this presents the limitation of a lack of tangibility of the visual holograms that the user tries to grab. We present an interface in which some of the tangibility is provided through ultrasound-based mid-air haptics actuation. We report a user study that evaluates the impact that the presence of such haptic feedback may have on a pick-and-place task of the wrist of a holographic robot arm.

show abstract

Section: State Of the Artmentioning

confidence: 99%

Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot

Pinto

Kildal

Lazkano

2020

MTI

View full text Add to dashboard Cite

show abstract

“…Several other groups have recently exploited the capabilities of the HoloLens as a programming aid. For example, a group from the Karlsruhe Institute of Technology has developed a system consisting of the HoloLens, a PC running the open-source ROS and a Kuka KR-5 robot (Puljiz et al , 2019). The technique allows the programming of collaborative robots without the need for torque/position sensors on the robot and exploits the in-built hand tracking capabilities of the HoloLens, together with its ability to create a holographic robot with the same geometry and kinematics as the real one.…”

Section: Augmented Reality As An Aid To Robot Programmingmentioning

confidence: 99%

The role of augmented reality in robotics

Bogue

2020

View full text Add to dashboard Cite

Purpose The purpose of this paper is to provide an insight into how augmented reality (AR) technologies are being applied to robotics. Design/methodology/approach Following an introduction and a brief historical background to AR, this first provides examples of AR applications in robot programming. It then gives examples of recent research into AR-based robot teleoperation. Research activities involving the virtual fixtures (VF) technique are then discussed and finally, brief conclusions are drawn. Findings Because AR concepts were first investigated in the 1990s, applications involving robotics have been widely studied. Programming with the aid of AR devices, such as the HoloLens headset, can be simplified and AR methods, including the VF technique, can improve the accuracy and speed of teleoperation, manipulation and positional control tasks. They can also provide visual or haptic feedback which leads to more intuitive operation and significantly reduces the cognitive load on the operator. Originality/value This provides an insight into the growing role of AR in robotics by providing examples of recent research in a range of applications.

show abstract

Mixed Reality HMI for Collaborative Robots

Hörbst

Orsolits

2022

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Sensorless Hand Guidance Using Microsoft Hololens

Cited by 6 publications

References 5 publications

Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot

Multimodal Mixed Reality Impact on a Hand Guiding Task with a Holographic Cobot

The role of augmented reality in robotics

Mixed Reality HMI for Collaborative Robots

Contact Info

Product

Resources

About