Enhancing Detection Performance through Sensor Model-based Trajectory Optimization for UAVs

Zwick, Markus; Gerdts, Matthias; Stütz, Peter

doi:10.1109/dasc52595.2021.9594460

Cited by 3 publications

(8 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In contrast, Section 2.2.2 discusses a performance model relying on a machine learning-based object classifier. This performance model has already been introduced in our previous work [ 14 ]. Still, it is briefly explained again in this work as it is applied in Section 3 for the validation of the partially new developed trajectory optimization with dynamic programming ( Section 2.5 ).…”

Section: Materials and Methodsmentioning

confidence: 99%

“…In addition to automated sensory data acquisition and object detection, we also address the optimization of UAV flight trajectories in the following. In this work, we reuse the two optimization methods nonlinear model predictive control (NMPC) and dynamic programming & optimal control (DP&OC), which were proposed in our previous works [ 13 , 14 ]. NMPC is a well-established method for UAV trajectory optimization and is used for example by [ 15 , 16 , 17 , 18 ].…”

Section: Introductionmentioning

confidence: 99%

“…Our innovative contribution to the research problem is the development of a functional concept for sensor-model-based trajectory optimization in the field of unmanned aerial reconnaissance, which we presented for the first time in our previous works [ 13 , 14 ].…”

Section: Introductionmentioning

confidence: 99%

“…The optimization specifically exploits the dependencies of the photographic states elevation angle and ground sample distance (as part of the environmental states) on the detection performance to generate a UAV reference flight trajectory along with a coordinated sensor footprint movement on the ground. In our previous works [ 13 , 14 ], we were able to enhance detection performance resulting from the optimized UAV reference trajectories compared to those of benchmark trajectories. Thus, the validity and capability of our concept could be proven.…”

Section: Introductionmentioning

confidence: 99%

“…An additional novelty is to model the state transitions of the discrete optimization method dynamic programming & optimal control by Dubins paths in order to achieve more realistic UAV dynamics than obtained in our previous work [ 14 ]. With this, it can be guaranteed that UAV reference trajectories are generated that meet predefined roll angle limitations.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Sensor-Model-Based Trajectory Optimization for UAVs to Enhance Detection Performance: An Optimal Control Approach and Experimental Results

Zwick

Gerdts

Stütz

2023

Sensors

Self Cite

View full text Add to dashboard Cite

UAVs are widely used for aerial reconnaissance with imaging sensors. For this, a high detection performance (accuracy of object detection) is desired in order to increase mission success. However, different environmental conditions (negatively) affect sensory data acquisition and automated object detection. For this reason, we present an innovative concept that maps the influence of selected environmental conditions on detection performance utilizing sensor performance models. These models are used in sensor-model-based trajectory optimization to generate optimized reference flight trajectories with aligned sensor control for a fixed-wing UAV in order to increase detection performance. These reference trajectories are calculated using nonlinear model predictive control as well as dynamic programming, both in combination with a newly developed sensor performance model, which is described in this work. To the best of our knowledge, this is the first sensor performance model to be used in unmanned aerial reconnaissance that maps the detection performance for a perception chain with a deep learning-based object detector with respect to selected environmental states. The reference trajectory determines the spatial and temporal positioning of the UAV and its imaging sensor with respect to the reconnaissance object on the ground. The trajectory optimization aims to influence sensor data acquisition by adjusting the sensor position, as part of the environmental states, in such a way that the subsequent automated object detection yields enhanced detection performance. Different constraints derived from perceptual, platform-specific, environmental, and mission-relevant requirements are incorporated into the optimization process. We evaluate the capabilities of the sensor performance model and our approach to sensor-model-based trajectory optimization by a series of simulated aerial reconnaissance tasks for ground vehicle detection. Compared to a variety of benchmark trajectories, our approach achieves an increase in detection performance of 4.48% on average for trajectory optimization with nonlinear model predictive control. With dynamic programming, we achieve even higher performance values that are equal to or close to the theoretical maximum detection performance values.

show abstract

Section: Materials and Methodsmentioning

confidence: 99%