An Assessment of the Hawthorne Effect in Practice-based Research

Abstract

Background: Practical studies in real-world settings may be particularly vulnerable to unintended effects on intervention outcomes, including what is commonly known as the Hawthorne Effect. This phenomenon suggests that study subjects' behavior or study results are altered by the subjects' awareness that they are being studied or that they received additional attention. This is especially a concern when subjects are not blinded to randomization or when they participate in studies with observational components. As part of a larger practical intervention designed to improve the clinical management of skin and soft tissue infections (SSTIs), we specifically examined the potential for a Hawthorne Effect from the extra attention some clinicians received when completing follow-up case reviews.Methods: De-identified, electronic data from a larger practical intervention allowed for the comparison of the clinical management of SSTIs among 14 randomly selected clinicians who participated in follow-up case reviews versus 77 clinicians who did not.Results: There were no differences in the management of SSTIs between the 2 groups of clinicians. No evidence of a Hawthorne Effect was observed in this quality-improvement intervention.Conclusion :

The influence of student gender on the assessment of undergraduate student work

“…Research examining self-presentational effects has consistently supported the contention that individuals are more likely to change their behaviour when placed in an evaluative environment (e.g. Fernald et al 2012). For example, the participants in this study may have felt the need to artificially increase the amount of feedback given in order to reduce the likelihood of being evaluated as a lecturer who provides insufficient feedback.…”

The Unanticipated Benefits of Behavioral Assessments and Interviews on Anxiety, Self-Esteem and Depression Among Women Engaging in Transactional Sex

“…Therefore, it is unknown if the improvements in mental health seen here were lasting changes in the mental health of our participants or if it was simply a short term by-product of being under surveillance (Fernald et al 2012;Gittelsohn et al 1997). Future studies can address these limitations by enrolling more participants in studies of longer duration and following participants after the interactions have ended, in order to assess whether any observed changes in mental health were a by-product of being under surveillance.…”

Answers to Common Clinical Questions

“…If this similar effect was operational in practice-based research, where it is often practices rather than individuals who are randomized, it would further complicate how we must undertake some of our most important studies. Fernald et al 13 looked for this phenomena in practice-based research; at least in their circumstance, with the specific trial and practices, they could not (thankfully) detect evidence of a Hawthorne effect.…”