Evaluation of statistical methods used to meta‐analyse results from interrupted time series studies: A simulation study

Korevaar, Elizabeth; Turner, Simon L.; Forbes, Andrew B.; Karahalios, Amalia; Taljaard, Monica; McKenzie, Joanne E.

doi:10.1002/jrsm.1669

Cited by 4 publications

(1 citation statement)

References 76 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It is the ability that must be learned in order to integrate the speaking ability. According to Korevaar et al, (2023), this skill is so usual and daily, then it is important to develop it in early ages, because it is nearly linked to speaking. Sometimes, reading is being performed in pre-k then, hence some children begin "to read" so fast.…”

Section: Reading As a Remarkable Skillmentioning

confidence: 99%

Students’ reading comprehension: an educational case about a methodological proposal in education

Jaramillo Valencia,

Larrea Fernández,

Ossa Cuartas

2024

penamer

View full text Add to dashboard Cite

Introduction: The intention of this article is to show the experience of an eclectic proposal implementation in first grade students. Objective: To deeply know how in elementary school students are beginning to work on an ability that will become very important during their learning process, which will be the reading skill in a second language. Method: As they are developing this skill through the use of reproductive skills, in this study it is proposed to use an alternative methodology to this language development, which will be an eclectic methodological proposal with a qualitative approach, in order to take advantage of this skill acquisition process to begin growing reading comprehension and second language learning as well. Results: It could be demonstrated that an eclectic methodological proposal could help students to improve their reading comprehension. Conclusion: Teachers can feel confident about using eclectic methodologies in the classroom as it can become a success along the learning sessions.

show abstract

Section: Reading As a Remarkable Skillmentioning

confidence: 99%

Students’ reading comprehension: an educational case about a methodological proposal in education

Jaramillo Valencia,

Larrea Fernández,

Ossa Cuartas

2024

penamer

View full text Add to dashboard Cite

show abstract

Comparison of statistical methods used to meta-analyse results from interrupted time series studies: an empirical study

Korevaar,

Turner,

Forbes

et al. 2024

BMC Med Res Methodol

View full text Add to dashboard Cite

Background The Interrupted Time Series (ITS) is a robust design for evaluating public health and policy interventions or exposures when randomisation may be infeasible. Several statistical methods are available for the analysis and meta-analysis of ITS studies. We sought to empirically compare available methods when applied to real-world ITS data. Methods We sourced ITS data from published meta-analyses to create an online data repository. Each dataset was re-analysed using two ITS estimation methods. The level- and slope-change effect estimates (and standard errors) were calculated and combined using fixed-effect and four random-effects meta-analysis methods. We examined differences in meta-analytic level- and slope-change estimates, their 95% confidence intervals, p-values, and estimates of heterogeneity across the statistical methods. Results Of 40 eligible meta-analyses, data from 17 meta-analyses including 282 ITS studies were obtained (predominantly investigating the effects of public health interruptions (88%)) and analysed. We found that on average, the meta-analytic effect estimates, their standard errors and between-study variances were not sensitive to meta-analysis method choice, irrespective of the ITS analysis method. However, across ITS analysis methods, for any given meta-analysis, there could be small to moderate differences in meta-analytic effect estimates, and important differences in the meta-analytic standard errors. Furthermore, the confidence interval widths and p-values for the meta-analytic effect estimates varied depending on the choice of confidence interval method and ITS analysis method. Conclusions Our empirical study showed that meta-analysis effect estimates, their standard errors, confidence interval widths and p-values can be affected by statistical method choice. These differences may importantly impact interpretations and conclusions of a meta-analysis and suggest that the statistical methods are not interchangeable in practice.

show abstract

Interrupted time series datasets from studies investigating the impact of interventions or exposures in public health and social science: A data note

Turner,

Korevaar,

Karahalios

et al. 2023

Preprint

Self Cite

View full text Add to dashboard Cite

Objectives: The interrupted time series (ITS) design is commonly used to investigate the impact of an intervention or exposure in public health. There are many statistical methods that can be used to analyse ITS data and to meta-analyse their results. We undertook two empirical studies to investigate: i) how effect estimates (and associated statistics) compared when six statistical methods were applied to 190 real-world datasets; and ii) how meta-analysis effect estimates (and associated statistics) compared when the combinations of two ITS analysis methods and five meta-analysis methods were applied to 17 real-world meta-analyses including 283 ITS datasets. Here we present a curated repository of a subset of ITS datasets from these studies. Data description: The repository includes 430 ITS datasets curated from the two empirical studies. The datasets are diverse in the populations, interruptions and outcomes examined, and are methodologically diverse in the outcome types, aggregation time intervals, number of timepoints and segments. Most of the datasets are from public health. For each dataset, we provide the outcome value at each timepoint and the segment (indicating different interruptions), along with characteristics of the dataset. This repository may be of value for future research of ITS studies, and as a source of examples of ITS for use in teaching.

show abstract

Evaluation of statistical methods used to meta‐analyse results from interrupted time series studies: A simulation study

Cited by 4 publications

References 76 publications

Students’ reading comprehension: an educational case about a methodological proposal in education

Students’ reading comprehension: an educational case about a methodological proposal in education

Comparison of statistical methods used to meta-analyse results from interrupted time series studies: an empirical study

Interrupted time series datasets from studies investigating the impact of interventions or exposures in public health and social science: A data note

Contact Info

Product

Resources

About