Consequences of violating assumptions of integrated population models on parameter estimates

Abstract

While ecologists know that models require assumptions, the consequences of their violation become vague as model complexity increases. Integrated population models (IPMs) combine several datasets to inform a population model and to estimate survival and reproduction parameters jointly with higher precision than is possible using independent models. However, accuracy actually depends on an adequate fit of the model to datasets. We first investigated bias of parameters obtained from integrated population models when specific assumptions are violated. For instance, a model may assume that all females reproduce although there are non-breeding females in the population. Our second goal was to identify which diagnostic tests are sensitive to detect violations of the assumptions of IPMs. We simulated data mimicking a short- and a long-lived species under five scenarios in which a specific assumption is violated. For each simulated scenario, we fitted an IPM that violates the assumption (simple IPM) and an IPM that does not violate each specific assumption. We estimated bias and uncertainty of parameters and performed seven diagnostic tests to assess the fit of the models to the data. Our results show that the simple IPM was quite robust to violation of many assumptions and only resulted in small bias of the parameter estimates. Yet, the applied diagnostic tests were not sensitive to detect such small bias. The violation of some assumptions such as the absence of immigrants resulted in larger bias to which diagnostic tests were more sensitive. The parameters informed by the least amount of data were the most biased in all scenarios. We provide guidelines to identify misspecified models and to diagnose the assumption being violated. Simple models should often be sufficient to describe simple population dynamics, and when data are abundant, complex models accounting for specific processes will be able to shed light on specific biological questions.

First demographic insights reveal high extinction risk of an endemic raptor species: the Reunion harrier

“…Furthermore, the sample sizes were modest, making the estimation of hidden parameters (e.g. immigration and emigration), which would be conceptually possible by using an IPM, highly uncertain and possibly even biased (Paquet et al 2021, Plard et al 2021). We have therefore preferred to keep our integrated model relatively simple assuming a population closed to immigration and emigration.…”

Estimating recruitment rate and population dynamics at a migratory stopover site using an integrated population model

“…The ability of IPMs to produce estimates for such parameters that are difficult to empirically measure—often, immigration or juvenile survival—is a key benefit of these models (Abadi et al, 2010). However, such parameters also serve to absorb all unmodeled variation in population growth, making inference about the contribution of these demographic rates to population dynamics misleading if assumptions are violated (Paquet et al, 2021; Plard et al, 2021). Each submodel has associated assumptions.…”

Integrated community models: A framework combining multispecies data sources to estimate the status, trends and dynamics of biodiversity

“…Furthermore, the quantity and types of data available have important implications for the potential structure and complexity of the biological process model. Although the incorporation of mechanistic processes within models is a clear goal within ecological research, if data are unavailable to estimate detailed demographic parameters, no amount of integration will be able to rectify the situation (Plard et al, 2021; Riecke et al, 2019).…”