Genotypic variability enhances the reproducibility of an ecological study

Abstract

Many scientific disciplines are currently experiencing a 'reproducibility crisis' because numerous scientific findings cannot be repeated consistently. A novel but controversial hypothesis postulates that stringent levels of environmental and biotic standardization in experimental studies reduce reproducibility by amplifying the impacts of laboratory-specific environmental factors not accounted for in study designs. A corollary to this hypothesis is that a deliberate introduction of controlled systematic variability (CSV) in experimental designs may lead to increased reproducibility. To test this hypothesis, we had 14 European laboratories run a simple microcosm experiment using grass (Brachypodium distachyon L.) monocultures and grass and legume (Medicago truncatula Gaertn.) mixtures. Each laboratory introduced environmental and genotypic CSV within and among replicated microcosms established in either growth chambers (with stringent control of environmental conditions) or glasshouses (with more variable environmental conditions). The introduction of genotypic CSV led to 18% lower among-laboratory variability in growth chambers, indicating increased reproducibility, but had no significant effect in glasshouses where reproducibility was generally lower. Environmental CSV had little effect on reproducibility. Although there are multiple causes for the 'reproducibility crisis', deliberately including genetic variability may be a simple solution for increasing the reproducibility of ecological studies performed under stringently controlled environmental conditions.

Nitrogen recycling in coupled green and brown food webs: Weak effects of herbivory and detritivory when nitrogen passes through soil

“…Failing to account for the role and size of these nutrient pools may then lead to inaccurate estimates of the strength of green and brown web interactions. Moreover, our work supports recent calls to introduce variation in initial conditions among the replicates of controlled experimental treatments to ensure that conclusions are reflective of realistic variability in environmental conditions (Milcu et al, ). Finally, our results highlight the importance of quantifying the initial state of an ecosystem when measuring whether perturbations to coupled green and brown food webs cause changes in nutrient cycling and plant–soil feedbacks (Fukami et al, ; Lehmann & Kleber, ; Leopold et al, ).…”

Automated Home-Cage Testing as a Tool to Improve Reproducibility of Behavioral Research?

“…Different colors of mice indicate different groups (e.g., different pharmacological treatments or genotypes). samples has been suggested to make study populations more representative and the results more "meaningful" (Richter et al, 2009(Richter et al, , 2010(Richter et al, , 2011Voelkl and Würbel, 2016;Richter, 2017;Milcu et al, 2018;Voelkl et al, 2018;Bodden et al, 2019). According to this idea, the introduction of variation on a systematic and controlled basis (referred to as "systematic heterogenization" by e.g., Richter et al, 2009Richter et al, , 2010Richter, 2017) predicts increased external validity and hence improved reproducibility.…”

How do climate change experiments alter plot‐scale climate?

“…Milcu et al . ). However, because fine‐scale and temporal variations in warming treatments are rarely analysed explicitly with ecological data, the implications for interpretation of experimental findings are unclear.…”