Data Collection as Disruption: Insights from a Longitudinal Study of Young Adulthood

Oh, Jeong Hyun; Yeatman, Sara; Trinitapoli, Jenny

doi:10.1177/0003122419859574

Cited by 8 publications

(6 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Another possibility is that participation in the survey itself produces change or stability, a phenomenon referred to as panel conditioning bias (Oh, Yeatman, and Trinitapoli 2019; Warren and Halpern-Manners 2012). Warren and Halpern-Manners (2012) outline several forms of panel conditioning, and we can group these into two broad patterns.…”

Section: Analytic Strategymentioning

confidence: 99%

Measuring Stability and Change in Personal Culture Using Panel Data

2020

View full text Add to dashboard Cite

Models of population-wide cultural change tend to invoke one of two broad models of individual change. One approach theorizes people actively updating their beliefs and behaviors in the face of new information. The other argues that, following early socialization experiences, dispositions are stable. We formalize these two models, elaborate empirical implications of each, and derive a simple combined model for comparing them using panel data. We test this model on 183 attitude and behavior items from the 2006 to 2014 rotating panels of the General Social Survey. The pattern of results is complex but more consistent with the settled dispositions model than with the active updating model. Most of the observed change in the GSS appears to be short-term attitude change or measurement error rather than persisting changes. When persistent change occurs, it is somewhat more likely to occur in younger people and for public behaviors and beliefs about high-profile issues than for private attitudes. We argue that we need both models in our theory of cultural evolution but that we need more research on the circumstances under which each is more likely to apply.

show abstract

Section: Analytic Strategymentioning

confidence: 99%

Measuring Stability and Change in Personal Culture Using Panel Data

2020

View full text Add to dashboard Cite

show abstract

“…Another possibility is that participation in the survey itself produces change or stability, referred to as panel conditioning bias (Warren and Halpern-Manners 2012;Oh, Yeatman, and Trinitapoli 2019). While Warren and Halpern-Manners (2012) outline several forms of panel conditioning, we can group these into two broad patterns.…”

Section: Comparison To Other Approachesmentioning

confidence: 99%

Measuring Stability and Change in Personal Culture Using Panel Data

Kiley¹,

Vaisey²

2020

Preprint

View full text Add to dashboard Cite

Models of population-wide cultural change tend to invoke one of two broad models of individual change. One approach theorizes that people actively update their beliefs and behaviors in the face of new information. The other argues that, following early socialization experiences, dispositions are stable. We formalize these two models, elaborate empirical implications of each, and derive a simple combined model for comparing them using panel data. We test this model on 183 attitude and behavior items from the 2006-14 rotating panels of the General Social Survey. Though the pattern of results is complex, it is somewhat more consistent with the settled dispositions model than the active updating model. Most observed change in the GSS appears to be short-term attitude change or measurement error rather than persisting changes. When persistent change occurs, it is somewhat more likely to occur in younger people than older people and more common for public behaviors and beliefs about high-profile issues than private attitudes. We argue that we need both models in our theory of cultural evolution but that we need more research on the circumstances under which each is more likely to apply.

show abstract

“…(2008) and Oh et al . (2019) comment on the distorting consequences of subjective assessment in empirical appraisals, an issue that is amplified if triple blinding is absent. There is ample evidence of the equivalent benefits of ‘active placebo’ effects in social experiments (Moncrieff et al ., 1998), bringing to light the likely operation of Hawthorne effects in positive experimental findings, yet active placebos are seldom incorporated into experimental research designs in education. Indeed, the whole notion of control and its intended or unintended placebo effects is a moot one (Howe et al ., 2017).…”

Section: Confounders and How Formal Experiments Deals With Themmentioning

confidence: 99%

Experiment’s persistent failure in education inquiry, and why it keeps failing

Thomas

2020

British Educational Res J

View full text Add to dashboard Cite

Natural scientists are relaxed about the multiple forms experiment takes in their various fields. Yet in education we have for many years constrained our notion of experiment. This methodological circumscription has been self‐imposed on the grounds that experiment of a particular, well‐defined form offers the clearest evidence of a link between cause and effect in assessing the impact of interventions. I challenge the legitimacy of this assertion and further argue that the model of intervene‐and‐experiment is ineffective and misleading. There is currently emerging a large body of findings from such experiment, and evaluations of these—like similar evaluations from a wave of experiments in the 1960s and 1970s across education and the applied social sciences—mainly concur on how disappointing the findings from this kind of work are. I argue that interventions are found to have largely nugatory consequences because the influence of independent variables is routinely overwhelmed by powerful contextual influences. I discuss the significance and nature of these contextual influences and question the legitimacy of the idea that one can test interventions with formal experiment in education. I conclude that the assertion that formal experiment can be fruitfully employed may drive policy in unhelpful directions, as models which may be successful in some circumstances are rejected on the basis of low effectiveness scores, while others in which potential effectiveness is indicated are unproductively imposed where circumstances are unpropitious. I suggest that a more unrestricted interpretation of ‘experiment’ needs to return to education discourse.

show abstract

Data Collection as Disruption: Insights from a Longitudinal Study of Young Adulthood

Cited by 8 publications

References 43 publications

Measuring Stability and Change in Personal Culture Using Panel Data

Measuring Stability and Change in Personal Culture Using Panel Data

Measuring Stability and Change in Personal Culture Using Panel Data

Experiment’s persistent failure in education inquiry, and why it keeps failing

Contact Info

Product

Resources

About