Animal Detection and Classification from Camera Trap Images Using Different Mainstream Object Detection Architectures

Abstract

Camera traps are widely used in wildlife surveys and biodiversity monitoring. Depending on its triggering mechanism, a large number of images or videos are sometimes accumulated. Some literature has proposed the application of deep learning techniques to automatically identify wildlife in camera trap imagery, which can significantly reduce manual work and speed up analysis processes. However, there are few studies validating and comparing the applicability of different models for object detection in real field monitoring scenarios. In this study, we firstly constructed a wildlife image dataset of the Northeast Tiger and Leopard National Park (NTLNP dataset). Furthermore, we evaluated the recognition performance of three currently mainstream object detection architectures and compared the performance of training models on day and night data separately versus together. In this experiment, we selected YOLOv5 series models (anchor-based one-stage), Cascade R-CNN under feature extractor HRNet32 (anchor-based two-stage), and FCOS under feature extractors ResNet50 and ResNet101 (anchor-free one-stage). The experimental results showed that performance of the object detection models of the day-night joint training is satisfying. Specifically, the average result of our models was 0.98 mAP (mean average precision) in the animal image detection and 88% accuracy in the animal video classification. One-stage YOLOv5m achieved the best recognition accuracy. With the help of AI technology, ecologists can extract information from masses of imagery potentially quickly and efficiently, saving much time.

Herbivorous fish feeding dynamics and energy expenditure on a coral reef: Insights from stereo‐video and AI‐driven 3D tracking

“…However, there's a need for developing innovative, automated approaches and multidimensional data analysis in the fields of ecology and conservation (Besson et al., 2022 ; Nathan et al., 2022 ). Also, classification accuracy still heavily relies on the training data's quality and quantity (Muksit et al., 2022 ; Tan et al., 2022 ). Our automated method detects fish from stereo‐video images on a Red Sea coral reef using YOLOv5.…”

Multi-shift spatio-temporal features assisted deep neural network for detecting the intrusion of wild animals using surveillance cameras

“…The R-CNN algorithms do not employ any hashing or approximation techniques to estimate the regions of the objects. Weighted full convolution layers are used in R-FCN approaches [14] to discover ROI and detect the category of objects as well as the information of their surroundings. With the use of deep learning algorithms, object detection approaches also seem promising for autonomous vehicles [15] and traffic scene object detection [16].…”

Using YOLO Object Detection to Identify Hare and Roe Deer in Thermal Aerial Video Footage—Possible Future Applications in Real-Time Automatic Drone Surveillance and Wildlife Monitoring

“…Over the past decade, artificial intelligence has led to significant progress in the domain of computer vision, automating image and video analysis tasks. Among computer vision methods, Convolutional Neural Networks (CNNs) are particularly promising for future advances in automating wildlife monitoring [6,[12][13][14][15][16][17][18]. Corcoran et al [3] concluded that when implementing automatic detection, fixed-winged drones with RGB sensors were ideal for detecting larger animals in open terrain, whereas, for small, elusive animals in more complex habitats, multi-rotor systems with infrared (IR) or thermal infrared sensors are the better choice, especially when monitoring cryptic and nocturnal animals.…”