Consistency of impact assessment protocols for non-native species

Abstract

Standardized tools are needed to identify and prioritize the most harmful non-native species (NNS). A plethora of assessment protocols have been developed to evaluate the current and potential impacts of non-native species, but consistency among them has received limited attention. To estimate the consistency across impact assessment protocols, 89 specialists in biological invasions used 11 protocols to screen 57 NNS (2614 assessments). We tested if the consistency in the impact scoring across assessors, quantified as the coefficient of variation (CV), was dependent on the characteristics of the protocol, the taxonomic group and the expertise of the assessor. Mean CV across assessors was 40%, with a maximum of 223%. CV was lower for protocols with a low number of score levels, which demanded high levels of expertise, and when the assessors had greater expertise on the assessed species. The similarity among protocols with respect to the final scores was higher when the protocols considered the same impact types. We conclude that all protocols led to considerable inconsistency among assessors. In order to improve consistency, we highlight the importance of selecting assessors with high expertise, providing clear guidelines and adequate training but also deriving final decisions collaboratively by consensus.

Assessing the ecological and societal impacts of alien parrots in Europe using a transparent and inclusive evidence-mapping scheme

“…Furthermore, our evidence-mapping scheme needs to be used in tandem with recent recommendations aimed at reducing disagreement between expert assessors (e.g. Turbé et al 2017, Vanderhoeven et al 2017González-Moreno et al 2019), to obtain more comprehensive impact assessments. Altogether, we argue that mapping all of the available evidence allows all the above-mentioned issues to be transparently considered during the decision-making phase of risk management.…”

Identification of the Invasive Form of Corbicula Clams in Ireland

“…The combined methodology of mitochondrial COI sequencing, microsatellite genotyping and morphological analysis has the potential to pick apart the exact identification of genetically complex species groups for which traditional ecological methods may have overlooked complex relationships such as in Corbicula [27] with its highly invasive clonal A/R form. The ability to discriminate between discreet introductions to a geographic area, and secondary spread is an invaluable tool in prioritising AIS biosecurity resources [45] and can inform horizon scanning [46].…”

Non-indigenous Species in the Mediterranean Sea: Turning From Pest to Source by Developing the 8Rs Model, a New Paradigm in Pollution Mitigation

“…According to González-Moreno et al (2019), to identify the most harmful NIS on a larger trans-regional scale, standardized tools are needed, as well as highly skilled experts, to whom adequate training and clear guidelines have been given. In parallel, the mapping and quantification of NIS impacts on a Mediterranean scale, combined with better knowledge about the anthropogenic pressures that have led to the majority of the invasions, would significantly help scientists and policy makers in the preparation of prevention or mitigation actions.…”