SALVO: Automated Generation of Diversified Tests for Self-driving Cars from Existing Maps

Nguyen, Vuong; Huber, Stefan; Gambi, Alessio

doi:10.1109/aitest52744.2021.00033

Cited by 21 publications

(10 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…CPS software developers mainly rely on basic simulation models [15,16], as well as rigid body [17,18] and soft body simulation environments [19,20]. The usage of CPS simulation environments enables automated test generation and execution [20,21]. However, the limited budget allocated for testing activities and the virtually infinite testing space pose challenges for adequately exercising the CPS behavior [21][22][23][24].…”

Section: Physical Systemsmentioning

confidence: 99%

See 1 more Smart Citation

Present Development of Software for Railway Safety

Prochazka,

Prochazkova

2024

Design, Construction, Maintenance

View full text Add to dashboard Cite

Railway is Cyber-Physical System (CPS), which is distributed over a large territory. It requires secure communication not only among various parts of system, but also with operation center. Building its own communication networks by the railway system operator is financially demanding, which is why more or less open communication systems are used. This is connected with higher requirements for the security of applications, operated in a CPS. European project COSMSOS has been creating a tool that applies DevOps development technologies from the IT field to the field of embedded systems, to which railway system belong. The article shows that this very complex software must be adapted to real requirements, which are put on railway operation system safety.

show abstract

Section: Physical Systemsmentioning

confidence: 99%

“…The usage of CPS simulation environments enables automated test generation and execution [20,21]. However, the limited budget allocated for testing activities and the virtually infinite testing space pose challenges for adequately exercising the CPS behavior [21][22][23][24].…”

Section: Physical Systemsmentioning

confidence: 99%

Present Development of Software for Railway Safety

Prochazka,

Prochazkova

2024

Design, Construction, Maintenance

View full text Add to dashboard Cite

show abstract

“…CPS developers mainly rely on basic simulation models [29,67], as well as rigid body [50,86] and soft body simulation environments [25,62]. The usage of CPS simulation environments enables automated test generation and execution [37,54]. However, the limited budget allocated for testing activities and the virtually ininite testing space pose challenges for adequately exercising the CPS behavior [4,20,82].…”

Section: Development Of Cyber-physical Systemsmentioning

confidence: 99%

Continuous Integration and Delivery Practices for Cyber-Physical Systems: An Interview-Based Study

Zampetti

Tamburri

Panichella

et al. 2023

ACM Trans. Softw. Eng. Methodol.

View full text Add to dashboard Cite

Continuous Integration and Delivery (CI/CD) practices have shown several benefits for software development and operations, e.g., faster release cycles and early discovery of defects. For Cyber-Physical System (CPS) development, CI/CD can help achieving required goals, such as high dependability, yet it may be challenging to apply. This paper empirically investigates challenges, barriers, and their mitigation occurring when applying CI/CD practices to develop CPSs in 10 organizations working in 8 different domains. The study has been conducted through semi-structured interviews, by applying an open card sorting procedure together with a member-checking survey within the same organizations, and by validating the results through a further survey involving 55 professional developers. The study reveals several peculiarities in the application of CI/CD to CPSs. These include the need for (i) combining continuous and periodic builds, while balancing the use of Hardware-in-the-Loop (HiL) and simulators; (ii) coping with difficulties in software deployment (iii) accounting for simulators and HiL differing in their behavior; and (vi) combining hardware/software expertise in the development team. Our findings open the road towards recommenders aimed at supporting the setting and evolution of CI/CD pipelines, as well as university curricula requiring interdisciplinarity, such as knowledge about hardware, software, and their interplay.

show abstract

“…Simulation-based testing is a promising direction to improve UAV testing practices [15], [16], [17]. Researchers proposed the use of digital-twins, i.e., virtual representations of real-time, physical objects or processes, to simulate and test CPS in a diversified set of scenarios [18], [19], [20], [21], [22], [23], and support testing automation [24], [25]. However,it is challenging to capture the same bugs as physical tests in simulation [17], [11] and to generate representative simulation-based test cases that expose realistic bugs [15].…”

Section: Introductionmentioning

confidence: 99%

Simulation-based Test Case Generation for Unmanned Aerial Vehicles in the Neighborhood of Real Flights

Khatiri

Panichella

Tonella

2023

2023 IEEE Conference on Software Testing, Verification and Validation (ICST)

View full text Add to dashboard Cite

Unmanned aerial vehicles (UAVs), also known as drones, are acquiring increasing autonomy. With their commercial adoption, the problem of testing their functional and non-functional, and in particular their safety requirements has become a critical concern. Simulation-based testing represents a fundamental practice, but the testing scenarios considered in software-in-the-loop testing may not be representative of the actual scenarios experienced in the field.In this paper, we propose SURREAL (teSting Uavs in the neighboRhood of REAl fLights), a novel search-based approach that analyses logs of real UAV flights and automatically generates simulation-based tests in the neighborhood of such real flights, thereby improving the realism and representativeness of the simulation-based tests. This is done in two steps: first, SURREAL faithfully replicates the given UAV flight in the simulation environment, generating a simulation-based test that mirrors a pre-logged real-world behavior. Then, it smoothly manipulates the replicated flight conditions to discover slightly modified flight scenarios that are challenging or trigger misbehaviors of the UAV under test in simulation. In our experiments, we were able to replicate a real flight accurately in the simulation environment and to expose unstable and potentially unsafe behavior in the neighborhood of a flight, which even led to crashes.

show abstract

SALVO: Automated Generation of Diversified Tests for Self-driving Cars from Existing Maps

Cited by 21 publications

References 16 publications

Present Development of Software for Railway Safety

Present Development of Software for Railway Safety

Continuous Integration and Delivery Practices for Cyber-Physical Systems: An Interview-Based Study

Simulation-based Test Case Generation for Unmanned Aerial Vehicles in the Neighborhood of Real Flights

Contact Info

Product

Resources

About