Effective conservation decision-making requires robust estimates of population trends. It is often assumed that, as long as monitoring methods remain consistent over time, trends in relative abundance are valid proxies for actual abundance. However, if the bias and uncertainty of relative abundance estimates change over time, this can have a serious impact on the validity of monitoring programmes. We developed a simple model for the retrospective assessment of the likely error and bias in abundance estimates from aerial surveys of the saiga antelope. Due to dramatic reductions in group size and density, current estimates of abundance are probably substantially lower than the true population size, and the level of uncertainty surrounding these estimates precludes their use for monitoring trends. This has implications for the Government of Kazakhstan's ability to monitor progress towards their agreed conservation goals. The method is potentially widely applicable to species for which historical data on relative abundance and group size are available.