Models not only represent but may also influence their targets in important ways. While models’ abilities to influence outcomes has been studied in the context of economic models, often under the label ‘performativity’, we argue that this phenomenon also pertains to epidemiological models, such as those used for forecasting the trajectory of the Covid-19 pandemic. After identifying three ways in which a model by the Covid-19 Response Team at Imperial College London (Ferguson et al. 2020) may have influenced scientific advice, policy, and individual responses, we consider the implications of epidemiological models’ performative capacities. We argue, first, that performativity may impair models’ ability to successfully predict the course of an epidemic; but second, that it may provide an additional sense in which these models can be successful, namely by changing the course of an epidemic.
I consider recent strategies proposed by econometricians for extrapolating causal effects from experimental to target populations. I argue that these strategies fall prey to the extrapolator's circle: they require so much knowledge about the target population that the causal effects to be extrapolated can be identified from information about the target alone. I then consider comparative process tracing (CPT) as a potential remedy. Although specifically designed to evade the extrapolator's circle, I argue that CPT is unlikely to facilitate extrapolation in typical econometrics and evidence-based policy applications. To argue this, I offer a distinction between two kinds of extrapolation, attributive and predictive, the latter being prevalent in econometrics and evidence-based policy. I argue that CPT is not helpful for predictive extrapolation when using the kinds of evidence that econometricians and evidence-based policy researchers prefer. I suggest that econometricians may need to consider qualitative evidence to overcome this problem.
Abstract:Proponents of evidence-based policy (EBP) call for public policy to be informed by high-quality evidence from randomized controlled trials. This methodological preference aims to promote several epistemic values, e.g. rigour, unbiasedness, precision, and the ability to obtain causal conclusions. I argue that there is a trade-off between these epistemic values and several non-epistemic, moral and political values. This is because the evidence afforded by standard EBP methods is differentially useful for pursuing different moral and political values. I expand on how this challenges ideals of value-freedom and -neutrality in EBP, and offer suggestions for how EBP methodology might be revised.
In Simulation and Similarity, Michael Weisberg offers a similarity-based account of the model–world relation, which is the relation in virtue of which successful models are successful. Weisberg’s main idea is that models are similar to targets in virtue of sharing features. An important concern about Weisberg’s account is that it remains silent on what it means for models and targets to share features, and consequently on how feature-sharing contributes to models’ epistemic success. I consider three potential ways of concretizing the concept of shared features: as identical, quantitatively sufficiently close, and sufficiently similar features. I argue that each of these concretizations faces significant challenges, leaving unclear how Weisberg’s account substantially contributes to elucidating the relation in virtue of which successful models are successful. Against this background, I outline a pluralistic revision and argue that this revision may not only help Weisberg's account evade several of the problems that I raise, but also offers a novel perspective on the model–world relation more generally. 1Introduction2Weisberg’s Feature-Sharing Account3What Is a Shared Feature? 3.1Identity3.2Sufficient closeness3.3Sufficient similarity4Turning Weisberg’s Account ‘Upside Down’5Conclusion
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.