Multimodal Control of UAV Based on Gesture, Eye Movement and Voice Interaction

Zhou, Ao; Han, Lei; Meng, Yuzhen

doi:10.1007/978-981-19-6613-2_366

Cited by 2 publications

(2 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Multi modal control is another technique for overcoming UAV gesture control. A multi modal control system integrates multiple interactions, such as hand gestures, eye movements, and voice interactions [13]. The multi channel joint interaction promotes high UAV control efficiency.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Deep Learning Enhanced Hand Gesture Recognition for Efficient Drone use in Agriculture

Srinil,

Thongnim

2024

ijacsa

View full text Add to dashboard Cite

The use of deep learning in unmanned aerial vehicles (UAVs), or drones, has greatly improved various technologies by making complex tasks easier, faster, and requiring less human help. This study looks into how artificial intelligence (AI) can be used in farming, especially through creating a system where drones can be controlled by hand gestures to support agricultural activities. By using a special type of AI called a Convolutional Neural Network (CNN) with an EfficientNet B3 model, this research developed a gesture recognition system. It was trained on 1,393 pictures of different hand signals taken under various light conditions and from three different people. The system was evaluated based on its training and testing performance, showing very high scores in terms of loss, accuracy, F1 score, and the Area Under the Curve (AUC), which means it can recognize gestures accurately and work well in different situations. This has big implications for farming, as it gives farmers an easy way to control drones for tasks like checking on crops and spraying them precisely, which also helps keep them safe. This study is an important step towards smarter farming practices. Moreover, the system's ability to perform well in different settings shows it could also be useful in other areas like construction, where drones need to operate precisely and flexibly.

show abstract

Section: Introductionmentioning

confidence: 99%

“…In this study, the focus primarily on hand gesture control, as it has shown promising results in previous research [12] [13]. Therefore, this study aims to create a hand gesture recognition system that works effectively in different environmental settings and individuals, such as under direct sunlight, on cloudy days, and shady.…”

Section: Introductionmentioning

confidence: 99%