The Verification of Ecological Citizen Science Data: Current Approaches and Future Possibilities

Abstract

Citizen science schemes enable ecological data collection over very large spatial and temporal scales, producing datasets of high value for both pure and applied research. However, the accuracy of citizen science data is often questioned, owing to issues surrounding data quality and verification, the process by which records are checked after submission for correctness. Verification is a critical process for ensuring data quality and for increasing trust in such datasets, but verification approaches vary considerably between schemes. Here, we systematically review approaches to verification across ecological citizen science schemes that feature in published research, aiming to identify the options available for verification, and to examine factors that influence the approaches used. We reviewed 259 schemes and were able to locate verification information for 142 of those. Expert verification was most widely used, especially among longer-running schemes, followed by community consensus and automated approaches. Expert verification has been the default approach for schemes in the past, but as the volume of data collected through citizen science schemes grows and the potential of automated approaches develops, many schemes might be able to implement approaches that verify data more efficiently. We present an idealised system for data verification, identifying schemes where this system could be applied and the requirements for implementation. We propose a hierarchical approach in which the bulk of records are verified by automation or community consensus, and any flagged records can then undergo additional levels of verification by experts.

Camera trapping with photos and videos: implications for ecology and citizen science

“…particularly for large camera trap datasets (Baker et al, 2021). Community consensus can be used to increase final classification accuracy but requires a large number of participants to gain enough classifications (Hsing et al, 2018;Swanson et al, 2016).…”

COVID-19 Impacts on Beaches and Coastal Water Pollution at Selected Sites in Ecuador, and Management Proposals Post-pandemic

“…Initiating Citizen Science could therefore help to develop a science educated society that will respond more positively to better environmental management. However, there are diverse and important concerns about such "citizen-based" data collection and subsequent interpretation (Baker et al, 2021), and care must be taken with evaluating such data.…”

The role of citizen science in demonstrating the local effects of climate change

“…Extensive, data-intensive research, in addition to their scientific knowledge-enhancing nature, can effectively contribute to better societal decision-making in various areas (CSA, 2021). This scientific research method allows collection of biological and ecological data on a large spatial and temporal scale, producing high-value data sets for basic and applied research (Baker et al, 2021). However, 'knowledge co-production, that is, extended thinking and ultimately the joint creation of shared knowledge, can be valuable and useful at the societal level with the full realization of the scientific requirements of accuracy and reliability as well as comparability and ethics (Rasmussen and Cooper, 2019) and may contribute to increasing climate awareness and sustainability goals (Rambonnet et al, 2019;Fraisl et al, 2020).…”