The impact of statistical methods on the audit practice is growing because of the increasing availability of audit data and the statistical methods to analyze these data. A key aspect in the statistical approach to auditing is assessing the strength of evidence for or against a hypothesis. Unfortunately, the often-used frequentist statistical methods cannot provide the statistical evidence that audit standards demand directly nor easily. In this article we discuss an alternative approach that can provide this evidence: Bayesian inference. Firstly, we explore the philosophical differences between frequentist and Bayesian inference. Secondly, we discuss misconceptions in the interpretation of frequentist statistical evidence, and finally we discuss how Bayesian inference allows the auditor to obtain and interpret statistical evidence in line with audit standards via its alternative to the p value, the Bayes factor.