A Real-Time Three-Dimensional Tracking and Registration Method in the AR-HUD System

An, Zhe; Xu, Xiping; Yang, Jian; Liu, Yang; Yan, Yuxuan

doi:10.1109/access.2018.2864224

Cited by 14 publications

(11 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…[29] The AR-HUD uses optical projection to present virtual information enhancements in the driver's line-of-sight without frequent adjustment between the real world and dashboard/navigation data. [30] Automotive manufacturers have used the windshield of the car as a holographic display unit to provide road intersection guidance, [31] ego-lane analysis, [32] and virtually see through objects that are obstacles in the path. [33] The AR-HUD technology could also find its way to infotainment in future AVs.…”

Section: Vision-based Technologiesmentioning

confidence: 99%

Intelligent In‐Vehicle Interaction Technologies

Murali

Kaboli

Dahiya

2021

Advanced Intelligent Systems

View full text Add to dashboard Cite

Autonomous vehicles (AVs) will soon become a reality with almost every major automotive original equipment manufacturer (OEM) such as Tesla, BMW, Daimler, and big technology giants such as Google's Waymo and Apple Car pushing toward the full self-driving objective. According to the SAE J3016 taxonomy [1] of autonomous driving, there are six levels of automated driving systems ranging from level 0 (completely manual) to level 5 (full selfdriving [FSD]) automated systems that are expected to function in all geographic locations, all weather conditions, and under all conditions. The proposed benefits of intelligent vehicles include fewer road accidents, enhanced safety, reduced traffic congestion, effective commute time usage, and importantly enjoyable and comfortable ride. With increased autonomy, the drivers also assume the role of mere passengers who are engaged in nondriving activities and are unavailable to participate in traffic interactions. This would increase complexity in a mixed-autonomy traffic environment as interactions with pedestrians and cyclists are based on visual cues with the driver. Therefore, intelligent vehicles also need to autonomously interact with other traffic participants such as pedestrians and cyclists and other vehicles.Human-vehicle interaction (HVI) is closely related to the field of human-robot interaction (HRI). It entails the problem of understanding and shaping the interaction dynamics between humans and vehicles. Particularly, the domain of interaction involves the study of sensation, perception, information exchange, inference, and decision-making. [2] With increasing levels of automation, the driver will have more time and choice to perform various tasks other than driving and this opens new avenues for interaction. As a result, a growing number of sensors are being incorporated into the vehicles to understand the driver's and/or passenger's actions, emotions, and personal choices to offer the precise functionalities and services for an enjoyable ride. [3] Figure 1 shows the schematic of in-vehicle interaction consisting of various interactive interfaces and sensing modalities present in the vehicle as well as some modes of interaction such as gestures, speech, and eye gaze.The advances in HVI have been presented in previous review articles, which have mainly focused on the detection of particular characteristics for driving assistance such as driver attention detection, [4] emotion recognition, [5] drowsiness detection, [6] mental workload, [7] and so on. A few other articles have reviewed the interior designs of AVs to better support and interact with drivers and passengers. [8,9] Likewise, the user interfaces (UIs) and user experience (UX) of vehicle interiors have been studied in context with manual as well as automated driving. [10] A number of previous works have also studied the interaction with the external

show abstract

Section: Vision-based Technologiesmentioning

confidence: 99%

Intelligent In‐Vehicle Interaction Technologies

Murali

Kaboli

Dahiya

2021

Advanced Intelligent Systems

View full text Add to dashboard Cite

show abstract

“…Real-time registration is necessary for the actual application process [40]- [42], [44]. In order to ensure the real-time performance of the AR image registration process, the researchers proposed the following research results, including application of preoperative navigation [46], [93]- [98], oral and maxillofacial surgery [99]- [102], and dental training [103]- [107].…”

Section: Real-time Registration Methods Of Augmented Reality In Ormentioning

confidence: 99%

“…In the practical application of oral surgery, real-time is great significance [40], [94]. Suenaga et al has done a lot of research on this field [95]- [99].…”

Section: Real-time Registration Methods Of Augmented Reality In Ormentioning

confidence: 99%

“…The core idea of non-rigid registration is divided into the following three parts: 1) transformation between standard image and floating image; 2) measuring the degree of similarity between the floating image and the reference image; 3) seeking a search strategy for the required transformation parameters in the measurement process [88]- [90]. A number of relatively mature non-rigid registration algorithms have researched, such as spline-based registration methods, physical model-based non-rigid registration methods, and optical flow field model-based registration methods [40]. The basic idea of the registration method according to the spline function is to respectively create a two-dimensional grid on the floating image and the reference image, and regard the grid node as a control point.…”

Section: B: Non-rigid Registration Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Registration Technology of Augmented Reality in Oral Medicine: A Review

et al. 2019

View full text Add to dashboard Cite

Augmented reality (AR) technology, as a computer simulation technology, combines various technologies such as virtual reality, computer vision, computer network, and human-computer interaction. AR has been widely used in medicine. The introduction of AR can effectively help the doctors to complete preoperative planning, intraoperative guidance, postoperative evaluation, and medical training. Oral medicine is a major branch of modern medicine. AR can enhance the doctor's visual system, making the internal structure of the oral clearer and effectively reducing the difficulty of oral repair/surgery. Real-time tracking, registration, display, and interactive technologies for AR will play an important role in oral medicine. Among them, registration technology has become an important indicator for evaluating the AR system, and it is also the main bottleneck restricting the stability and applicability of the current AR system. Therefore, we reviewed the registration technology of AR in oral medicine. First, we conducted a hot spot analysis of AR keywords based on Citespace. And then, the registration technology is divided into static registration and real-time registration according to the actual clinical application, among which static registration is divided into rigid registration and non-rigid registration. We discussed problems and limitations of static registration and real-time registration in oral applications at this stage. Finally, the future direction of AR registration technology in oral medicine is proposed.

show abstract

“…HUDs present augmented machine data usually on the windshield such that drivers do not have to look away from their conventional viewpoints. In practice, a rapid prototype-based development of such HUDs may be expensive or cumbersome [6]. However, a HUD unit can be modeled from a detailed physics-based model of a vehicle using virtual sensing, that is, by incorporating detailed vehicle dynamics.…”

Section: Introductionmentioning

confidence: 99%

Real-Time Multibody Model-Based Heads-Up Display Unit of a Tractor

et al. 2021

View full text Add to dashboard Cite

The concept of heads-up display can be used to provide augmented information onto the windshield of a tractor. The objective of this paper is to introduce a detailed real-time multibody model that is used in the design of a novel heads-up display unit of a tractor. To this end, a tractor is described using a multibody dynamics approach. A heads-up display unit is designed using a series of tasks that are associated with sets of logical conditions and instructions. These conditions and instructions, in turn, determine/design the analog and digital gauges. The gauges are linked with the virtual sensors installed at a number of locations on the tractor. In this study, the heads-up display unit includes elements, such as tachometer, speedometer, roll inclinometer, gear indicator, fuel gauge, and bucket height, tilt, and weight indicators. The effectiveness of the heads-up display unit is determined based on a goal of moving a certain amount of sand from one place to another. The results demonstrate the utility of the heads-up display unit.

show abstract

A Real-Time Three-Dimensional Tracking and Registration Method in the AR-HUD System

Cited by 14 publications

References 33 publications

Intelligent In‐Vehicle Interaction Technologies

Intelligent In‐Vehicle Interaction Technologies

Registration Technology of Augmented Reality in Oral Medicine: A Review

Real-Time Multibody Model-Based Heads-Up Display Unit of a Tractor

Contact Info

Product

Resources

About