The paper discusses the problem of a fallible auditor who may classify incorrect values as 'correct', or vice versa. To detect these mistakes, a sample of the auditor's classifications is checked again, now by an infallible expert. From the classifications of both the auditor and the expert the error rate in the population is estimated. We show that classical confidence intervals for the error rate are of limited practical use. Instead, we propose and implement a Bayesian approach.
An important task of auditors is to check whether recorded values are correct. From the number (or total) of the errors found in a sample, upper con®dence limits for the fraction (or total) of the errors in the population are calculated by standard methods.Even auditors are human, however, and may make mistakes: errors may remain unnoticed. As administrative rules and regulations are becoming more and more complicated, this kind of auditors' mistakes tends to occur more frequently. Hence, there is an increasing need to check the auditing process itself. This can be achieved by checking a subsample of audited values a second time, now by an error-free supervisor.This paper investigates the consequences of the (possible) occurrence of errors in this subsample. A simple and analytically attractive model is presented for the number of errors found in this double inspection scheme. Maximum likelihood estimators are derived for the population fraction of errors and the probability of an error remaining unnoticed. Based on that, an exact upper con®dence limit for the population fraction of errors is calculated, treating the probability of an unnoticed error as a nuisance parameter. Our method was originally developed during a recent Dutch case study: in a subsample of already audited values one additional error was found by the supervisor. It is shown that, as a consequence, the upper con®dence limit is increased very sizeably.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.