Scenarios for ADAS Testing: Modeling and Design

Lyamani, Abderrahmane; Hajji, Tarik; Elhassani, Ibtissam; Masrour, Tawfik

doi:10.1007/978-3-031-01942-5_75

Cited by 1 publication

(1 citation statement)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Recent studies show that researchers are also trying to evaluate the safety of ADAS and AD systems using formal verification methods, which require a lot of effort in terms of time and cost [10], [25], [34], [39] but have a lack of empirical evaluations.…”

Section: Related Workmentioning

confidence: 99%

Metamorphic Testing of Advanced Driver-Assistance Systems: Implementing Euro NCAP Standards on OpenStreetMap

Iqbal

2023

2023 IEEE/ACM 8th International Workshop on Metamorphic Testing (MET)

View full text Add to dashboard Cite

Simulation testing is considered the supplement to ensure the safety of Autonomous driving (AD) and advanced driving assistance (ADAS's) systems in terms of time and costs. However, it is very difficult and challenging when the simulation results are unexpected. This work presents a simulation-based metamorphic testing (MT) approach to test the ADAS system, implementing the European new car assessment program (Euro NCAP) standards on OpenStreetMap (OSM). We first defined input patterns and relations related to autonomous driving, following the principles of MT. To assess the approach, we executed three tests in two steps at both the design and system levels. Our results show that none of the three (source) tests detected any collisions. However, for follow-up test cases, the ego vehicle failed to apply brakes to avoid a collision when the speed changed. A real-life issue in the system was immediately revealed and confirmed by the development team. We then designed a mechanism and continued the test to check whether the recorded collisions were avoidable. Our results (rate of 5.8%) indicate the fault detection effectiveness when testing the ADAS system. Although we applied the approach to testing the ADAS driving performance, it can be applied to other AD systems. This research, therefore, provides a systematic way to design and test autonomous driving technologies and integrate testing standards with metamorphic testing.

show abstract

Section: Related Workmentioning

confidence: 99%

Metamorphic Testing of Advanced Driver-Assistance Systems: Implementing Euro NCAP Standards on OpenStreetMap

Iqbal

2023

2023 IEEE/ACM 8th International Workshop on Metamorphic Testing (MET)

View full text Add to dashboard Cite

show abstract

Scenarios for ADAS Testing: Modeling and Design

Cited by 1 publication

References 15 publications

Metamorphic Testing of Advanced Driver-Assistance Systems: Implementing Euro NCAP Standards on OpenStreetMap

Metamorphic Testing of Advanced Driver-Assistance Systems: Implementing Euro NCAP Standards on OpenStreetMap

Contact Info

Product

Resources

About