Using longitudinal data from a cohort of middle school students from a large school district, we estimate separate “value‐added” teacher effects for two subscales of a mathematics assessment under a variety of statistical models varying in form and degree of control for student background characteristics. We find that the variation in estimated effects resulting from the different mathematics achievement measures is large relative to variation resulting from choices about model specification, and that the variation within teachers across achievement measures is larger than the variation across teachers. These results suggest that conclusions about individual teachers' performance based on value‐added models can be sensitive to the ways in which student achievement is measured.
This document and trademark(s) contained herein are protected by law as indicated in a notice appearing later in this work. This electronic representation of RAND intellectual property is provided for non-commercial use only. Unauthorized posting of RAND PDFs to a non-RAND Web site is prohibited. RAND PDFs are protected under copyright law. Permission is required from RAND to reproduce, or reuse in another form, any of our research documents for commercial use. For information on reprint and linking permissions, please see RAND Permissions.
This study drew on teacher survey responses from randomized experiments exploring three different pay-for-performance programs to examine the extent to which these programs motivated teachers to improve student achievement and the impact of such programs on teachers' instruction, number of hours worked, job stress, and collegiality. Results showed that most teachers did not report their program as motivating. Moreover, the survey responses suggest that none of the three programs changed teachers' instruction, increased their number of hours worked or job stress, or damaged their collegiality. Future research needs to further examine the logic model of pay-for-performance programs and test alternative incentive models such as rewarding teachers based on their practices and job responsibilities rather than on student outcomes.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.