Data Aggregation in Multilevel Research: Best Practice Recommendations and Tools for Moving Forward

LeBreton, James M.; Moeller, Amanda; Wittmer, Jenell Lynn-Senter

doi:10.1007/s10869-022-09853-9

Cited by 8 publications

(3 citation statements)

References 97 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This pattern indicates that there was substantial within-group agreement in ratings of leader empathy, meeting commonly accepted criteria for justifying aggregation (cf. Bliese, 2000; LeBreton & Senter, 2008; LeBreton et al, 2023).…”

Section: Methodsmentioning

confidence: 99%

“…Figure 1 The "Too Little/Too Much" Rating Scale Used in the Leadership Versatility Index 360-Degree Feedback Instrument recommended that researchers also examine interrater reliability using intraclass correlation coefficients (ICC): specifically, ICC(1), an estimate of the reliability of a single rater, and ICC(2), an estimate of the reliability of the mean rating aggregated across raters for each leader. Because ICC(2) varies as a function of group size, a general ICC(2) was estimated based on the median number of direct reports per leader (Mdn = 5) as recommended by LeBreton et al (2023). For the overall research sample, the mean r wg value was .90, ICC(1) was .17, and ICC(2) was .51.…”

Section: Changes In Leader Empathymentioning

confidence: 99%

See 1 more Smart Citation

Has empathy really become more important to leadership since the COVID-19 pandemic?

Kaiser

2024

Consulting Psychology Journal

View full text Add to dashboard Cite

Section: Methodsmentioning

confidence: 99%

Section: Changes In Leader Empathymentioning

confidence: 99%

Has empathy really become more important to leadership since the COVID-19 pandemic?

Kaiser

2024

Consulting Psychology Journal

View full text Add to dashboard Cite

“…Best practice guidelines [ 73 – 76 ] recommend clinician ratings of first-level leadership and clinic implementation climate be aggregated and analyzed at the clinic level. To justify aggregation, guidelines recommend that researchers test the level of inter-rater agreement among clinicians within each clinic to confirm there is evidence of shared experience.…”

Section: Methodsmentioning

confidence: 99%

Improving measurement-based care implementation in youth mental health through organizational leadership and climate: a mechanistic analysis within a randomized trial

Williams,

Ehrhart,

Aarons

et al. 2024

Implementation Sci

View full text Add to dashboard Cite

Background Theory and correlational research indicate organizational leadership and climate are important for successful implementation of evidence-based practices (EBPs) in healthcare settings; however, experimental evidence is lacking. We addressed this gap using data from the WISDOM (Working to Implement and Sustain Digital Outcome Measures) hybrid type III effectiveness-implementation trial. Primary outcomes from WISDOM indicated the Leadership and Organizational Change for Implementation (LOCI) strategy improved fidelity to measurement-based care (MBC) in youth mental health services. In this study, we tested LOCI’s hypothesized mechanisms of change, namely: (1) LOCI will improve implementation and transformational leadership, which in turn will (2) mediate LOCI’s effect on implementation climate, which in turn will (3) mediate LOCI’s effect on MBC fidelity. Methods Twenty-one outpatient mental health clinics serving youth were randomly assigned to LOCI plus MBC training and technical assistance or MBC training and technical assistance only. Clinicians rated their leaders’ implementation leadership, transformational leadership, and clinic implementation climate for MBC at five time points (baseline, 4-, 8-, 12-, and 18-months post-baseline). MBC fidelity was assessed using electronic metadata for youth outpatients who initiated treatment in the 12 months following MBC training. Hypotheses were tested using longitudinal mixed-effects models and multilevel mediation analyses. Results LOCI significantly improved implementation leadership and implementation climate from baseline to follow-up at 4-, 8-, 12-, and 18-month post-baseline (all ps < .01), producing large effects (range of ds = 0.76 to 1.34). LOCI’s effects on transformational leadership were small at 4 months (d = 0.31, p = .019) and nonsignificant thereafter (ps > .05). LOCI’s improvement of clinic implementation climate from baseline to 12 months was mediated by improvement in implementation leadership from baseline to 4 months (proportion mediated [pm] = 0.82, p = .004). Transformational leadership did not mediate LOCI’s effect on implementation climate (p = 0.136). Improvement in clinic implementation climate from baseline to 12 months mediated LOCI’s effect on MBC fidelity during the same period (pm = 0.71, p = .045). Conclusions LOCI improved MBC fidelity in youth mental health services by improving clinic implementation climate, which was itself improved by increased implementation leadership. Fidelity to EBPs in healthcare settings can be improved by developing organizational leaders and strong implementation climates. Trial registration ClinicalTrials.gov identifier: NCT04096274. Registered September 18, 2019.

show abstract

Managerial coaching and subordinates’ psychological distress: a cross-level moderated mediation study

Song,

2023

Curr Psychol

View full text Add to dashboard Cite

Data Aggregation in Multilevel Research: Best Practice Recommendations and Tools for Moving Forward

Cited by 8 publications

References 97 publications

Has empathy really become more important to leadership since the COVID-19 pandemic?

Has empathy really become more important to leadership since the COVID-19 pandemic?

Improving measurement-based care implementation in youth mental health through organizational leadership and climate: a mechanistic analysis within a randomized trial

Managerial coaching and subordinates’ psychological distress: a cross-level moderated mediation study

Contact Info

Product

Resources

About