Approaches to measuring use of research evidence in K-12 settings: A systematic review

Lawlor, Jennifer; Mills, Kristen; Neal, Zachary P.; Neal, Jennifer Watling; Wilson, Camren; McAlindon, Kathryn

doi:10.1016/j.edurev.2019.04.002

Cited by 19 publications

(24 citation statements)

References 47 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The observed primacy of validity evidence based on relations to other variables and on content was unsurprising given that other forms are not always applicable; however, multiple reviews highlighted how instruments and measures that supplied such evidence did so in cursory ways (e.g. piloting the tool with a small sample; Lawlor et al, 2019). Reliability evidence, on the other hand, focused almost entirely on internal consistency, which Impact in coproduction has marked deficiencies as a measure of "quality," such as sensitivity to the number of items.…”

Section: Discussionmentioning

confidence: 99%

An overview of quantitative instruments and measures for impact in coproduction

MacGregor

2020

JPCC

View full text Add to dashboard Cite

PurposeThe purpose of this paper is to examine the quantitative measurement tools used in fields of study related to coproduction, as an approach to mobilizing knowledge, in order to inform the measurement of impact.Design/methodology/approachAn overview methodology was used to synthesize the findings from prior instrument reviews, focusing on the contexts in which measurement tools have been used, the main constructs and content themes of the tools, and the extent to which the tools display promising psychometric and pragmatic qualities.FindingsEight identified reviews described 441 instruments and measures designed to capture various aspects of knowledge being mobilized among diverse research stakeholders, with 291 (66%) exhibiting relevance for impact measurement.Research limitations/implicationsFuture studies that measure aspects of coproduction need to engage more openly and critically with psychometric and pragmatic considerations when designing, implementing and reporting on measurement tools.Practical implicationsTwenty-seven tools with strong measurement properties for evidencing impact in coproduction were identified, offering a starting point for scholars and practitioners engaging in partnered approaches to research, such as in professional learning networks.Originality/valueCurrent quantitative approaches to measuring the impacts of coproduction are failing to do so in ways that are meaningful, consistent, rigorous, reproducible and equitable. This paper provides a first step to addressing this issue by exploring promising measurement tools from fields of study with theoretical similarities to coproduction.

show abstract

Section: Discussionmentioning

confidence: 99%

An overview of quantitative instruments and measures for impact in coproduction

MacGregor

2020

JPCC

View full text Add to dashboard Cite

show abstract

“…On the one hand, more rigorous quasi-experimental studies and randomized controls are needed [8]. In this sense, it is also necessary to use evaluation measures within a psychometric analysis framework (i.e., validity, reliability, and responsiveness) [43] to evaluate the effects of WSRA and the use of blind raters to evaluate their effects to minimize biases. We also recommend a high degree of fidelity to the implementation of WSRA controlling the challenges that are involved (e.g., lack of staff buy-in) [8], as only a few studies did so since poor implementation may yield mixed outcomes [44].…”

Section: Discussionmentioning

confidence: 99%

Implementation of Whole School Restorative Approaches to Promote Positive Youth Development: Review of Relevant Literature and Practice Guidelines

et al. 2022

View full text Add to dashboard Cite

Positive youth development highlights the promotion of skills through engaging and caring settings and building opportunities for bidirectional and constructive relationships. Whole School Restorative Approaches (WSRA) promote school community relationships and social and emotional skills which are core components for positive youth development. To our knowledge, the literature reviews on the implementation of restorative practice approaches in schools do not focus specifically on WSRA and are not comprehensive. This study carries out a systematic review of the empirical evidence on the effectiveness of WSRA and develops some evidence-based practice guidelines on their effects. Thirteen studies met the inclusion criteria and we developed 10 evidence-based practice guidelines on the implementation of WSRA. There were many studies with WSRA showing positive results related to improving social and emotional skills and behavior. The highest level of scientific evidence is for secondary education where two WSRA are recommended. Although our review suggests that more rigorous methodological research is necessary, it also points out that the evidence available on WSRA implementation is encouraging. They could be used through all educational stages to deal with diversity and inclusion while promoting a school culture of peace based on the positive management of relationships and conflicts.

show abstract

“…Entretanto, é sabido que o aumento exponencial na publicação de pesquisas científicas nem sempre representa uma aplicação imediata ou eficaz das descobertas. Isso é especialmente evidente no que diz respeito à educação, em que a lacuna entre a pesquisa e a prática é ainda mais evidente (Lawlor et al, 2019).…”

Section: Versas Denúncias Apontam Para As Piores Condições De Vida Do...unclassified

Mapeando a Pesquisa Em Educação Das Relações Étnico-Raciais

2022

View full text Add to dashboard Cite

Resumo O objetivo da pesquisa foi realizar uma análise bibliométrica da produção científica sobre a Educação das Relações Étnico-Raciais na base de dados Web of Science (WoS). A amostra foi composta por 2.916 artigos, publicados em 384 fontes, no período de 1945 a 2019. Eles foram exportados da base WoS para o software RStudio, onde foi utilizado o pacote Bibliometrix. Junto à perspectiva quantitativa, foi aplicada uma análise qualitativa, baseada na análise de conteúdo de Bardin, considerando os artigos mais citados dos últimos 20 anos. A principal contribuição do artigo foi oferecer informações interessantes sobre a evolução do campo em âmbito internacional, por meio de um desenho quantitativo, possibilitando aos pesquisadores o reconhecimento de possíveis lacunas na área.

show abstract

Approaches to measuring use of research evidence in K-12 settings: A systematic review

Cited by 19 publications

References 47 publications

An overview of quantitative instruments and measures for impact in coproduction

An overview of quantitative instruments and measures for impact in coproduction

Implementation of Whole School Restorative Approaches to Promote Positive Youth Development: Review of Relevant Literature and Practice Guidelines

Mapeando a Pesquisa Em Educação Das Relações Étnico-Raciais

Contact Info

Product

Resources

About