Plant Species Identification Using Computer Vision Techniques: A Systematic Literature Review

Abstract

Species knowledge is essential for protecting biodiversity. The identification of plants by conventional keys is complex, time consuming, and due to the use of specific botanical terms frustrating for non-experts. This creates a hard to overcome hurdle for novices interested in acquiring species knowledge. Today, there is an increasing interest in automating the process of species identification. The availability and ubiquity of relevant technologies, such as, digital cameras and mobile devices, the remote access to databases, new techniques in image processing and pattern recognition let the idea of automated species identification become reality. This paper is the first systematic literature review with the aim of a thorough analysis and comparison of primary studies on computer vision approaches for plant species identification. We identified 120 peer-reviewed studies, selected through a multi-stage process, published in the last 10 years (2005–2015). After a careful analysis of these studies, we describe the applied methods categorized according to the studied plant organ, and the studied features, i.e., shape, texture, color, margin, and vein structure. Furthermore, we compare methods based on classification accuracy achieved on publicly available datasets. Our results are relevant to researches in ecology as well as computer vision for their ongoing research. The systematic and concise overview will also be helpful for beginners in those research fields, as they can use the comparable analyses of applied methods as a guide in this complex activity.

Photo‐sharing platforms key for characterising niche and distribution in poorly studied taxa

“…Fortunately, new technologies are expected to make these tasks easier in the future (e.g. García‐Roselló et al ., ; Hernández‐Serna & Jiménez‐Segura, ; Wäldchen & Mäder, ). Another drawback that might stop researchers from using photo records is that it is impossible to revise the specimens if necessary, in the event of taxonomic revisions (Speed et al ., ).…”

Machine learning for image based species identification

“…Solutions for image based species identification tasks are manifold and were comprehensively surveyed before, e.g. by Cope, Corney, Clark, Remagnino, and Wilkin (); Moniruzzaman, Islam, Bennamoun, and Lavery (); Seeland, Rzanny, Alaqraa, Wäldchen, and Mäder (); Wäldchen and Mäder (); Weinstein ().…”

“…Considerable research in the field of computer vision and machine learning resulted in a plethora of papers proposing and comparing methods on automated species identification (Wäldchen & Mäder, ; Weinstein, ). Most of these studies published were conducted by technical specialists in computer vision, machine learning and multimedia information retrieval making the proposed methods difficult to access for biologists (Wäldchen & Mäder, ).…”

Flora Incognita – wie künstliche Intelligenz die Pflanzenbestimmung revolutioniert

“…Seit mehr als 15 Jahren arbeiten Wissenschaftler und Wissenschaftlerinnen vor allem aus der Informatik an einer Möglichkeit, Pflanzen anhand von Bildern automatisch zu erkennen . Viele Jahre hat man dabei auf Experten mit Erfahrung in digitaler Bildverarbeitung gesetzt, welche Modelle entwickelt haben, um Bildobjekte und deren Eigenschaften zu extrahieren.…”