Despite our best efforts as evaluators, program implementation failures abound. A wide variety of valuable methodologies have been adopted to explain and evaluate the why of these failures. Yet, typically these methodologies have been employed concurrently (e.g., project monitoring) or to the post-hoc assessment of program activities. What we believe to be missing are methods that will lead to the successful prediction of program implementation failures in advance, methods that will lead us directly to the ''how'' and, especially, the ''how likely'' of program implementation failure. To that end we propose, discuss, and illustrate three such methods that seemingly hold promise -marker analysis, the wisdom of crowds, and ''Big Data.'' Additionally, we call for an expanded role for evaluation -explanation, but also prediction without a total embrace of the need to understand why a prediction works.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.