Bandwidth Selection and the Estimation of Treatment Effects with Unbalanced Data

Abstract

Bandwidth Selection and the Estimation of Treatment Effects with Unbalanced Data *This paper addresses the selection of smoothing parameters for estimating the average treatment effect on the treated using matching methods. Because precise estimation of the expected counterfactual is particularly important in regions containing the mass of the treated units, we define and implement weighted cross-validation approaches that improve over conventional methods by considering the location of the treated units in the selection of the smoothing parameters. We also implement a locally varying bandwidth method that uses larger bandwidths in areas where the mass of the treated units is located. A Monte Carlo study compares our proposed methods to the conventional unweighted method and to a related method inspired by Bergemann et al. (2005). The Monte Carlo analysis indicates efficiency gains from all methods that take account of the location of the treated units. We also apply all five methods to bandwidth selection in the context of the data from LaLonde's (1986) study of the performance of non-experimental estimators using the experimental data from the National Supported Work (NSW) Demonstration program as a benchmark. Overall, both the Monte Carlo analysis and the empirical application show feasible precision gains for the weighted cross-validation and the locally varying bandwidth approaches. JEL Classification:C13, C14

Causal Inference without Balance Checking: Coarsened Exact Matching

“…Genetic matching as defined in Diamond and Sekhon (2005) is not MIB, but by choosing a variableby-variable caliper, it would be; if it were run within CEM strata, it would be MIB and would also meet the congruence principle. Similarly, one could run the basic CEM algorithm and then use either a synthetic matching approach (Abadie and Gardeazabal 2003), nonparametric adjustment (Abadie and Imbens 2007), or weighted cross-validation (Galdo, Smith, and Black 2008) within each stratum and the MIB property would hold.…”

The Effectiveness of Public-Sponsored Training Revisited: The Importance of Data and Methodological Choices

“…The Monte Carlo results reported in Galdo et al (2008) show that it can be useful to base the bandwidth choice on predictions for nontreated individuals who are close to the treated individuals.…”

The Effectiveness of Public Sponsored Training Revisited: The Importance of Data and Methodological Choices

“…Recently, there have been a number of Monte Carlo studies analyzing the performance of various estimators for treatment effects relying on propensity score matching, see Busso, DiNardo, and McCrary (2009, 2011), Galdo, Smith, and Black (2008, and Huber, et al (2010). These studies reassess the conclusions drawn by the earlier Monte Carlo study of Frölich (2004).…”