No abstract

Low cost real-time identification of multirotor unmanned aerial vehicle (UAV) dynamics is an active area of research supported by the surge in demand and emerging application domains. Such real-time identification capabilities shorten development time and cost, making UAVs' technology more accessible, and enable a variety of advanced applications. In this paper, we present a novel comprehensive approach, called DNN-MRFT, for real-time identification and tuning of multirotor UAVs using the Modified Relay Feedback Test (MRFT) and Deep Neural Networks (DNN). The first contribution is the development of a generalized framework for the application of DNN-MRFT to higher-order systems. The second contribution is a method for the exact estimation of identified process gain which mitigates the inaccuracies introduced due to the use of the describing function method in approximating the response of Lure's systems. The third contribution is a generalized controller based on DNN-MRFT that takes-off a UAV with unknown dynamics and identifies the inner loops dynamics in-flight. Using the developed generalized framework, DNN-MRFT is sequentially applied to the outer translational loops of the UAV utilizing in-flight results obtained for the inner attitude loops. DNN-MRFT takes on average 15 seconds to get the full knowledge of multirotor UAV dynamics and was tested on multiple designs and sizes. The identification accuracy of DNN-MRFT is demonstrated by the ability of a UAV to pass through a vertical window without any further tuning, calibration, or feedforward terms. Such demonstrated accuracy, speed, and robustness of identification pushes the limits of state-of-the-art in real-time identification of UAVs.

No abstract

Space exploration has witnessed revolutionary changes upon landing of the Perseverance Rover on the Martian surface and demonstrating the first flight beyond Earth by the Mars helicopter, Ingenuity. During their mission on Mars, Perseverance Rover and Ingenuity collaboratively explore the Martian surface, where Ingenuity scouts terrain information for rover's safe traversability. Hence, determining the relative poses between both the platforms is of paramount importance for the success of this mission. Driven by this necessity, this work proposes a robust relative localization system based on a fusion of neuromorphic vision-based measurements (NVBMs) and inertial measurements. The emergence of neuromorphic vision triggered a paradigm shift in the computer vision community, due to its unique working principle delineated with asynchronous events triggered by variations of light intensities occurring in the scene. This implies that observations cannot be acquired in static scenes due to illumination invariance. To circumvent this limitation, high frequency active landmarks are inserted in the scene to guarantee consistent event firing. These landmarks are adopted as salient features to facilitate relative localization. A novel event-based landmark identification algorithm using Gaussian Mixture Models (GMM) is developed for matching the landmarks correspondences formulating our NVBMs. The NVBMs are fused with inertial measurements in proposed state estimators, landmark tracking Kalman filter (LTKF) and translation decoupled Kalman filter (TDKF) for landmark tracking and relative localization, respectively. The proposed system was tested in a variety of experiments and has outperformed state-of-the-art approaches in accuracy and range.

Vision-based control of unmanned aerial vehicles (UAVs) has been adopted in a wide range of applications due to the availability of low-cost onboard sensors and computers. Tuning such systems to work properly requires extensive domain-specific experience, which limits the growth of emerging applications. Moreover, obtaining performance limits for UAVs performing visual servoing is difficult due to the complexity of the models used. In this article, we propose a novel noise-tolerant approach for real-time identification and tuning of visual servoing systems. This is based on the deep neural networks (DNNs) classification of the system response generated by the modified relay feedback test (MRFT). The proposed method, called DNN with noise-protected MRFT (DNN-NP-MRFT), can be used with a multitude of vision sensors and estimation algorithms despite high levels of sensor noise. The response of DNN-NP-MRFT to noise perturbations is investigated and its effect on identification and tuning performance is analyzed. The proposed DNN-NP-MRFT is able to detect performance changes induced by the use of high latency vision sensors or by integrating an inertial measurement unit sensor into the Manuscript