A Research Agenda for Mixed Reality in Automated Vehicles

Riegler, Andreas; Riener, Andreas; Holzmann, Clemens

doi:10.1145/3428361.3428390

Cited by 28 publications

(12 citation statements)

References 120 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For example, novel interfaces could support the driver by giving constant feedback to the driver on their driving style (e.g., "ecofriendly"). In this regard, personalization concepts should be explored further, as user experience aspects will become more important in future vehicles (e.g., Riegler et al, 2020b;Lee et al, 2020). Furthermore, the inclusion of elderly drivers should receive more attention, and future in-vehicle interfaces should be tailored to this growing target group (Robertson and Vanlaar, 2008).…”

Section: Discussionmentioning

confidence: 99%

“…In contrast to the recent survey on user studies on automated driving conducted by Frison et al (2020), this work focuses on user studies on vehicles with different levels of driving automation conducted within virtual reality environments. In 2020, Riegler et al (2020b) presented workshop results on grand challenges in mixed reality applications for intelligent vehicles, and thus provides a good overview for future user studies in the form of a research agenda, whereas our view is more focused on VR as a subtopic of mixed reality, and covers both the main research themes of recent user studies and how these studies were conducted. Gabbard et al (2014) focus on driver challenges and opportunities for in-vehicle AR applications.…”

Section: Previous Literature Reviews and User Study Survey Papersmentioning

confidence: 99%

See 1 more Smart Citation

A Systematic Review of Virtual Reality Applications for Automated Driving: 2009–2020

2021

Self Cite

View full text Add to dashboard Cite

While virtual reality (VR) interfaces have been researched extensively over the last decades, studies on their application in vehicles have only recently advanced. In this paper, we systematically review 12 years of VR research in the context of automated driving (AD), from 2009 to 2020. Due to the multitude of possibilities for studies with regard to VR technology, at present, the pool of findings is heterogeneous and non-transparent. We investigated N = 176 scientific papers of relevant journals and conferences with the goal to analyze the status quo of existing VR studies in AD, and to classify the related literature into application areas. We provide insights into the utilization of VR technology which is applicable at specific level of vehicle automation and for different users (drivers, passengers, pedestrians) and tasks. Results show that most studies focused on designing automotive experiences in VR, safety aspects, and vulnerable road users. Trust, simulator and motion sickness, and external human-machine interfaces (eHMIs) also marked a significant portion of the published papers, however a wide range of different parameters was investigated by researchers. Finally, we discuss a set of open challenges, and give recommendation for future research in automated driving at the VR side of the reality-virtuality continuum.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Previous Literature Reviews and User Study Survey Papersmentioning

confidence: 99%

A Systematic Review of Virtual Reality Applications for Automated Driving: 2009–2020

2021

Self Cite

View full text Add to dashboard Cite

show abstract

“…The systematic review of AR applications for automated vehicles by Riegler et al (2021a) shows increasing research efforts for designing driver and passenger experiences. In this research, we focus on automated driving (SAE L3 and higher), because AR features are expected to accompany driving automation (Wiegand et al, 2019;Riegler et al, 2020b), and can help to build trust in automated driving (AD) (Wintersberger et al, 2017b). For now, however, the realization of AR WSDs is impracticable both for technical and financial reasons (Gabbard et al, 2014).…”

Section: Related Workmentioning

confidence: 99%

Towards Personalized 3D Augmented Reality Windshield Displays in the Context of Automated Driving

Riegler

Riener

Holzmann

2022

Front. Future Transp.

Self Cite

View full text Add to dashboard Cite

As vehicle automation advances, drivers of automated vehicles become more disengaged from the primary driving task. Windshield displays provide a large screen space supporting drivers in non-driving related activities. This article presents user preferences as well as task and safety issues for 3D augmented reality windshield displays in automated driving. Participants of a user study (n = 24) customized two modes of content presentation (multiple content-specific windows vs. one main window), and could freely adjust visual parameters for these content windows using a simulated “ideal” windshield display in a virtual reality driving simulator. We found that user preferences differ with respect to contextual aspects. Additionally, using one main content window resulted in better task performance and lower take-over times, but the subjective user experience was higher for the multi-window user interface. These findings help automotive interface designers to improve experiences in automated vehicles.

show abstract

“…Although the first vehicles in the automotive sector are equipped with the AR head-up displays as standard, there is also great industrial interest in research on the application of future AR systems of this kind. [27][28][29][30][31][32] This includes the rapid development and testing of the systems in the moving vehicle in order to make a basis for larger decisions. In this way, the advantages compared to other display types or different symbologies can be examined.…”

Section: Introductionmentioning

confidence: 99%

Flying a helicopter with the HoloLens as head-mounted display

Walko

Maibach

2021

Opt. Eng.

View full text Add to dashboard Cite

We describe the flight testing and the integration process of the Microsoft HoloLens 2 as head-mounted display (HMD) with DLR's research helicopter. In the previous work, the HoloLens was integrated into a helicopter simulator. Now, while migrating the HoloLens into a real helicopter, the main challenge was the head tracking of the HoloLens, because it is not designed to operate on moving vehicles. Therefore, the internal head tracking is operated in a limited rotation-only mode, and resulting drift errors are compensated for with an external tracker, several of which have been tested in advance. The fusion is done with a Kalman filter, which contains a non-linear weighting. Internal tracking errors of the HoloLens caused by vehicle accelerations are mitigated with a system identification approach. For calibration, the virtual world is manually aligned using the helicopter's noseboom. The external head tracker (EHT) is largely automatically calibrated using an optimization approach and therefore, works for all trackers and regardless of its mounting positions on vehicle and head. Most of the pretests were carried out in a car, which indicates the flexibility in terms of vehicle type. The flight tests have shown that the overall quality of this HMD solution is very good. The conformal holograms are almost jitter-free, there is no latency, and errors of lower frequencies are identical with the performance that the EHT can provide, which in combination greatly improves immersion. Profiting from almost all features of the HoloLens 2 is a major advantage, especially for rapid research and development. © The Authors. Published by SPIE under a Creative Commons Attribution 4.0 International License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.

show abstract

A Research Agenda for Mixed Reality in Automated Vehicles

Cited by 28 publications

References 120 publications

A Systematic Review of Virtual Reality Applications for Automated Driving: 2009–2020

A Systematic Review of Virtual Reality Applications for Automated Driving: 2009–2020

Towards Personalized 3D Augmented Reality Windshield Displays in the Context of Automated Driving

Flying a helicopter with the HoloLens as head-mounted display

Contact Info

Product

Resources

About