Building Human Visual Attention Map for Construction Equipment Teleoperation

Abstract

Construction equipment teleoperation is a promising solution when the site environment is hazardous to operators. However, limited situational awareness of the operator exists as one of the major bottlenecks for its implementation. Virtual annotations (VAs) can use symbols to convey information about operating clues, thus improving an operator’s situational awareness without introducing an overwhelming cognitive load. It is of primary importance to understand how an operator’s visual system responds to different VAs from a human-centered perspective. This study investigates the effect of VA on teleoperation performance in excavating tasks. A visual attention map is generated to describe how an operator’s attention is allocated when VAs are presented during operation. The result of this study can improve the understanding of how human vision works in virtual or augmented reality. It also informs the strategies on the practical implication of designing a user-friendly teleoperation system.

Exploring the effects of virtual annotation background display mode and transparency through a 360-degree panorama approach to online shopping

“…In addition, when the text is white and the background is black, the information presentation looks more subtle (Lin and Chen, 2021). Some studies have confirmed that background color and contrast are essential in virtual annotation design (Fan et al. , 2022).…”

“…Because of the many advantages of virtual annotation, it has been widely used in telemedicine (Zhang et al, 2022), tourism and navigation systems (Williams et al, 2018), and architectural fields. It has been pointed out that the visual design features of virtual annotations, such as shape, style, size, and position, somewhat affect the user's perception (Fan et al, 2022). Improperly designed virtual annotations can even seriously hinder users from promptly processing all the information they need (Hong et al, 2020).…”

“…In addition, when the text is white and the background is black, the information presentation looks more subtle (Lin and Chen, 2021). Some studies have confirmed that background color and contrast are essential in virtual annotation design (Fan et al, 2022). However, there is no unified standard for the display mode of the annotation background in virtual environments, so this study focuses on the impact of the virtual annotation background display mode on the user experience in a 3608 panoramic online virtual exhibition.…”

“…, 2018), and architectural fields. It has been pointed out that the visual design features of virtual annotations, such as shape, style, size, and position, somewhat affect the user's perception (Fan et al. , 2022).…”

Operator visual attention allocation prediction in a robotic arm teleoperation interface

“…Chen et al (2016) classified and designed the interface views for a tele‐operated crane based on human attention and conducted experiments in a robotic arm simulation environment to demonstrate the suitability of the interface. Fan et al (2022) established a visual attention map for operators to remotely operate the construction equipment. The study explained the attention allocation mechanism under stressful conditions and provided a basis for optimizing the interactive interface for teleoperation.…”