Automatic segmentation of fish using deep learning with application to fish size measurement

García, Rafael; Prados, Ricard; Quintana, Josep; Tempelaar, Alexander; Gracias, Nuno; Rosen, Shale; Vågstøl, Håvard; Løvall, Kristoffer

doi:10.1093/icesjms/fsz186

Cited by 120 publications

(76 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…), Atlantic mackerel ( Scomber scombrus ), velvet belly lanternshark ( Etmopterus spinax ), Norway pout ( Trisopterus esmarkii ), Atlantic herring ( Clupea harengus ; Garcia et al . 2019) and European hake (Álvarez‐Ellacuría et al . 2019).…”

Section: Applications Of Deep Learning In Smart Fish Farmingmentioning

confidence: 99%

Deep learning for smart fish farming: applications, opportunities and challenges

Yang

Zhang

Liu

et al. 2020

Reviews in Aquaculture

209

View full text Add to dashboard Cite

The rapid emergence of deep learning (DL) technology has resulted in its successful use in various fields, including aquaculture. DL creates both new opportunities and a series of challenges for information and data processing in smart fish farming. This paper focuses on applications of DL in aquaculture, including live fish identification, species classification, behavioural analysis, feeding decisions, size or biomass estimation, and water quality prediction. The technical details of DL methods applied to smart fish farming are also analysed, including data, algorithms and performance. The review results show that the most significant contribution of DL is its ability to automatically extract features. However, challenges still exist; DL is still in a weak artificial intelligence stage and requires large amounts of labelled data for training, which has become a bottleneck that restricts further DL applications in aquaculture. Nevertheless, DL still offers breakthroughs for addressing complex data in aquaculture. In brief, our purpose is to provide researchers and practitioners with a better understanding of the current state of the art of DL in aquaculture, which can provide strong support for implementing smart fish farming applications.

show abstract

Section: Applications Of Deep Learning In Smart Fish Farmingmentioning

confidence: 99%

Deep learning for smart fish farming: applications, opportunities and challenges

Yang

Zhang

Liu

et al. 2020

Reviews in Aquaculture

209

View full text Add to dashboard Cite

show abstract

“…As a result, the segmentation output can be used to estimate fish sizes, shapes, and their weight as shown in 18 , 20 . These are important statistics that can be useful in applications like commercial trawling 10 .…”

Section: Datasetmentioning

confidence: 99%

A realistic fish-habitat dataset to evaluate algorithms for underwater visual analysis

Saleh

Laradji

Коновалов

et al. 2020

Sci Rep

103

View full text Add to dashboard Cite

Visual analysis of complex fish habitats is an important step towards sustainable fisheries for human consumption and environmental protection. Deep Learning methods have shown great promise for scene analysis when trained on large-scale datasets. However, current datasets for fish analysis tend to focus on the classification task within constrained, plain environments which do not capture the complexity of underwater fish habitats. To address this limitation, we present DeepFish as a benchmark suite with a large-scale dataset to train and test methods for several computer vision tasks. The dataset consists of approximately 40 thousand images collected underwater from 20 habitats in the marine-environments of tropical Australia. The dataset originally contained only classification labels. Thus, we collected point-level and segmentation labels to have a more comprehensive fish analysis benchmark. These labels enable models to learn to automatically monitor fish count, identify their locations, and estimate their sizes. Our experiments provide an in-depth analysis of the dataset characteristics, and the performance evaluation of several state-of-the-art approaches based on our benchmark. Although models pre-trained on ImageNet have successfully performed on this benchmark, there is still room for improvement. Therefore, this benchmark serves as a testbed to motivate further development in this challenging domain of underwater computer vision. Monitoring fish in their natural habitat is an important step towards sustainable fisheries. In the New South Wales state of Australia, for example, fisheries is valued at more than 100 million Australian dollars in 2012-2013 14. Effective monitoring can provide information about which areas require protection and restoration to maintain healthy fish populations for both human consumption and environmental protection. Having a system that can automatically perform comprehensive monitoring can significantly reduce labour costs and increase efficiency. The system can lead to a large positive sustainability impact and improve our ability to maintain a healthy ecosystem. Deep learning methods have consistently achieved state-of-the-art results in image analysis. Many methods based on deep neural networks achieved top performance for a variety of applications, including, ecological monitoring with camera trap data. One reason behind this success is that these methods can leverage largescale, publicly available datasets such as ImageNet 6 and COCO 24 for training before being fine-tuned for a new application. A particularly challenging application involves automatic analysis of underwater fish habitats which demands a comprehensive, accurate computer vision system. Thus, considerable research efforts have been put towards developing systems for the task of understanding complex marine environments and distinguishing between a diverse set of fish species, which are based on publicly available fish datasets 1,3,8,15,35. However, these fish datasets are small and do not fully capture t...

show abstract

“…Catching unwanted fish can lead to more time needed to sort them. It can also lead to more fuel consumption as these fish are extra weight on the boat, and cause long-term negative impact on the fisheries 18 . Thus, acquiring fish size information has many important applications.…”

Section: Full Supervision (Conventional)mentioning

confidence: 99%

Weakly Supervised Underwater Fish Segmentation Using Affinity LCFCN

Saleh

Laradji

Rodríguez

et al. 2021

Preprint

View full text Add to dashboard Cite

Estimating fish body measurements like length, width, and mass has received considerable research due to its potential in boosting productivity in marine and aquaculture applications. Some methods are based on manual collection of these measurements using tools like a ruler which is time consuming and labour intensive. Others rely on fully-supervised segmentation models to automatically acquire these measurements but require collecting per-pixel labels which are also time consuming. It can take up to 2 minutes per fish to acquire accurate segmentation labels. To address this problem, we propose a segmentation model that can efficiently train on images labeled with point-level supervision, where each fish is annotated with a single click. This labeling scheme takes an average of only 1 second per fish. Our model uses a fully convolutional neural network with one branch that outputs per-pixel scores and another that outputs an affinity matrix. These two outputs are aggregated using a random walk to get the final, refined per-pixel output. The whole model is trained end-to-end using the LCFCN loss and thus we call our method Affinity-LCFCN (A-LCFCN). We conduct experiments on the DeepFish dataset, which contains several fish habitats from north-eastern Australia. The results show that A-LCFCN outperforms a fully-supervised segmentation model when the annotation budget is fixed. They also show that A-LCFCN achieves better segmentation results than LCFCN and a standard baseline.

show abstract

Automatic segmentation of fish using deep learning with application to fish size measurement

Cited by 120 publications

References 14 publications

Deep learning for smart fish farming: applications, opportunities and challenges

Deep learning for smart fish farming: applications, opportunities and challenges

A realistic fish-habitat dataset to evaluate algorithms for underwater visual analysis

Weakly Supervised Underwater Fish Segmentation Using Affinity LCFCN

Contact Info

Product

Resources

About