To answer the question "Are low likelihood ratios reliable?" requires both a definition of reliable and then a test of whether low likelihood ratios (LRs) meet that definition. We offer, from a purely statistical standpoint, that reliability can be determined by assessing whether the rate of inclusionary support for non-donors is not larger than expected from the LR value. Thus, it is not the magnitude of the LR alone that determines reliability. Turing's rule is used to inform the expected rate of non-donor exclusionary support, where the rate of non-donor inclusionary support is at most the reciprocal of the LR, i.e. Pr(LR > x | Ha) < 1/x.There are parallel concerns about whether the value of the evidence can be communicated. We do not discuss that in depth here although it is an important consideration to be addressed with training.In this paper, we use a mixture of real and simulated data to show that the rate of non-donor inclusionary support is significantly lower than the upper bound given by Turing's rule. We take this as strong evidence that low LRs are reliable.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.