4D Attention: Comprehensive Framework for Spatio-Temporal Gaze Mapping

Oishi, Shuji; Koide, Kenji; Yokozuka, Masashi; Banno, Atsuhiko

doi:10.1109/lra.2021.3097274

Cited by 7 publications

(2 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Techniques considering 3D eye tracking data were mainly developed for VR scenarios (e.g., Stellmach et al [SND10a]) or were included in desktop applications [OKYB21]. Possible gaze visualizations include 3D scan paths as well as 3D attention maps [SND10b].…”

Section: Related Workmentioning

confidence: 99%

Been There, Seen That: Visualization of Movement and 3D Eye Tracking Data from Real‐World Environments

Pathmanathan

Oney

Becher

et al. 2023

Computer Graphics Forum

View full text Add to dashboard Cite

The distribution of visual attention can be evaluated using eye tracking, providing valuable insights into usability issues and interaction patterns. However, when used in real, augmented, and collaborative environments, new challenges arise that go beyond desktop scenarios and purely virtual environments. Toward addressing these challenges, we present a visualization technique that provides complementary views on the movement and eye tracking data recorded from multiple people in real‐world environments. Our method is based on a space‐time cube visualization and a linked 3D replay of recorded data. We showcase our approach with an experiment that examines how people investigate an artwork collection. The visualization provides insights into how people moved and inspected individual pictures in their spatial context over time. In contrast to existing methods, this analysis is possible for multiple participants without extensive annotation of areas of interest. Our technique was evaluated with a think‐aloud experiment to investigate analysis strategies and an interview with domain experts to examine the applicability in other research fields.

show abstract

Section: Related Workmentioning

confidence: 99%

Been There, Seen That: Visualization of Movement and 3D Eye Tracking Data from Real‐World Environments

Pathmanathan

Oney

Becher

et al. 2023

Computer Graphics Forum

View full text Add to dashboard Cite

show abstract

“…The creation of three-dimensional (3D) building models is an important topic not only in the fields of urban planning, landscaping, disaster management, and urban activity monitoring but also for commercial applications such as movies and virtual reality [1][2][3][4]. In recent years, the development of 3D building models has accelerated worldwide with the emergence of digital twins [5,6].…”

Section: Introductionmentioning

confidence: 99%

End-to-End Framework for the Automatic Matching of Omnidirectional Street Images and Building Data and the Creation of 3D Building Models

Ogawa,

Nakamura,

Sato

et al. 2024

Remote Sensing

View full text Add to dashboard Cite

For accurate urban planning, three-dimensional (3D) building models with a high level of detail (LOD) must be developed. However, most large-scale 3D building models are limited to a low LOD of 1–2, as the creation of higher LOD models requires the modeling of detailed building elements such as walls, windows, doors, and roof shapes. This process is currently not automated and is performed manually. In this study, an end-to-end framework for the creation of 3D building models was proposed by integrating multi-source data such as omnidirectional images, building footprints, and aerial photographs. These different data sources were matched with the building ID considering their spatial location. The building element information related to the exterior of the building was extracted, and detailed LOD3 3D building models were created. Experiments were conducted using data from Kobe, Japan, yielding a high accuracy for the intermediate processes, such as an 86.9% accuracy in building matching, an 88.3% pixel-based accuracy in the building element extraction, and an 89.7% accuracy in the roof type classification. Eighty-one LOD3 3D building models were created in 8 h, demonstrating that our method can create 3D building models that adequately represent the exterior information of actual buildings.

show abstract