Automated pig monitoring is an important issue in the surveillance environment of a pig farm. For a large-scale pig farm in particular, practical issues such as monitoring cost should be considered but such consideration based on low-cost embedded boards has not yet been reported. Since low-cost embedded boards have more limited computing power than typical PCs and have tradeoffs between execution speed and accuracy, achieving fast and accurate detection of individual pigs for “on-device” pig monitoring applications is very challenging. Therefore, in this paper, we propose a method for the fast detection of individual pigs by reducing the computational workload of 3 × 3 convolution in widely-used, deep learning-based object detectors. Then, in order to recover the accuracy of the “light-weight” deep learning-based object detector, we generate a three-channel composite image as its input image, through “simple” image preprocessing techniques. Our experimental results on an NVIDIA Jetson Nano embedded board show that the proposed method can improve the integrated performance of both execution speed and accuracy of widely-used, deep learning-based object detectors, by a factor of up to 8.7.

Automated pig monitoring is important for smart pig farms; thus, several deep-learning-based pig monitoring techniques have been proposed recently. In applying automated pig monitoring techniques to real pig farms, however, practical issues such as detecting pigs from overexposed regions, caused by strong sunlight through a window, should be considered. Another practical issue in applying deep-learning-based techniques to a specific pig monitoring application is the annotation cost for pig data. In this study, we propose a method for managing these two practical issues. Using annotated data obtained from training images without overexposed regions, we first generated augmented data to reduce the effect of overexposure. Then, we trained YOLOv4 with both the annotated and augmented data and combined the test results from two YOLOv4 models in a bounding box level to further improve the detection accuracy. We propose accuracy metrics for pig detection in a closed pig pen to evaluate the accuracy of the detection without box-level annotation. Our experimental results with 216,000 “unseen” test data from overexposed regions in the same pig pen show that the proposed ensemble method can significantly improve the detection accuracy of the baseline YOLOv4, from 79.93% to 94.33%, with additional execution time.

Taking care of individual pigs is important in the management of a group-housed pig farm. However, this is nearly impossible in a large-scale pig farm owing to the shortage of farm workers. Therefore, we propose an automatic monitoring method in this study to solve the management problem of a large-scale pig farm. Particularly, we aim to detect undergrown pigs in group-housed pig rooms by using deep-learning-based computer vision techniques. Because the typical deep learning techniques require a large computational overhead (i.e., Mask-R-CNN), fast and accurate detection of undergrown pigs on an IoT-based embedded device is very challenging. We first obtain the video monitoring data of group-housed pigs by using a top-view camera that is installed in the pig room, and then detect each moving pig by combining image processing and deep learning techniques. Gaussian Mixture Model is used to detect moving frames and moving objects. In embedded device implementations, by applying deep learning (i.e., TinyYOLO3) to a few frames only with a large number of pixel changes, embedded GPUs can be used efficiently, satisfying the real-time requirement. As a subsequent step, we check the acceptable conditions of the posture and separability from each video frame of the continuous video stream. Finally, to compute the relative size of each pig quickly and accurately, we develop image processing steps to complement the result of deep learning with minimum computational overhead. Furthermore, by pipelining the CPU and GPU steps of a continuous video stream, we can hide the additional image processing time. Based on the experimental results obtained from an embedded device, we confirm that the proposed method can automatically detect undergrown pigs in real-time, by working as an early warning system without any human inspection or measurement of actual weight by a farm worker.INDEX TERMS Smart farm, pig monitoring, computer vision, image processing, deep learning.

Failure to quickly and accurately detect abnormal situations, such as the occurrence of infectious diseases, in pig farms can cause significant damage to the pig farms and the pig farming industry of the country. In this study, we propose an economical and lightweight sound-based pig anomaly detection system that can be applicable even in small-scale farms. The system consists of a pipeline structure, starting from sound acquisition to abnormal situation detection, and can be installed and operated in an actual pig farm. It has the following structure that makes it executable on the embedded board TX-2: (1) A module that collects sound signals; (2) A noise-robust preprocessing module that detects sound regions from signals and converts them into spectrograms; and (3) A pig anomaly detection module based on MnasNet, a lightweight deep learning method, to which the 8-bit filter clustering method proposed in this study is applied, reducing its size by 76.3% while maintaining its identification performance. The proposed system recorded an F1-score of 0.947 as a stable pig’s abnormality identification performance, even in various noisy pigpen environments, and the system’s execution time allowed it to perform in real time.