An Automated Framework Based on Deep Learning for Shark Recognition

Abstract

The recent progress in deep learning has given rise to a non-invasive and effective approach for animal biometrics. These modern techniques allow researchers to track animal individuals on a large-scale image database. Typical approaches are suited to a closed-set recognition problem, which is to identify images of known objects only. However, such approaches are not scalable because they mis-classify images of unknown objects. To recognize the images of unknown objects as ‘unknown’, a framework should be able to deal with the open set recognition scenario. This paper proposes a fully automatic, vision-based identification framework capable of recognizing shark individuals including those that are unknown. The framework first detects and extracts the shark from the original image. After that, we develop a deep network to transform the extracted image to an embedding vector in latent space. The proposed network consists of the Visual Geometry Group-UNet (VGG-UNet) and a modified Visual Geometry Group-16 (VGG-16) network. The VGG-UNet is utilized to detect shark bodies, and the modified VGG-16 is used to learn embeddings of shark individuals. For the recognition task, our framework learns a decision boundary using a one-class support vector machine (OSVM) for each shark included in the training phase using a few embedding vectors belonging to them, then it determines whether a new shark image is recognized as belonging to a known shark individual. Our proposed network can recognize shark individuals with high accuracy and can effectively deal with the open set recognition problem with shark images.

Enhanced Karyotyping Through Deep Learning-Assisted Segmentation and Classification of Chromosomal Cells

“…The extracted section will be in the form of binary; therefore, it can be used later for the mining of GLCM and DWT features. Information about the VGG-UNet can be found in the studies [22][23][24][25]. The initial values for VGG-UNet are assigned as follows; Adam optimizer, MaxPooling layer and ReLu.…”

New interactive machine learning tool for marine image analysis

“…Internally, the tool uses a variant of the general-purpose U-Net convolutional neural network [12], chosen for its known competency with roots in soil [13]. U-Net has also demonstrated capabilities with marine objects, including fishes [14], coral reefs [15], demosponges [9] and sharks [16]. As U-Net introduces no requirements on the type of object that a model can be trained to detect, the application of RootPainter is not limited to soil images.…”