Estimating publication bias in <scp>meta‐analyses</scp> of <scp>peer‐reviewed</scp> studies: A <scp>meta‐meta‐analysis</scp> across disciplines and journal tiers

Mathur, Maya B.; VanderWeele, Tyler J.

doi:10.1002/jrsm.1464

Cited by 48 publications

(74 citation statements)

References 67 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…(1.001-1.029). More broadly, in a large-scale analysis of meta-analyses in psychology and medicine, van Aert, Wicherts, and van Assen (2019) conclude that "Overestimation was minimal but statistically significant" (van Aert, Wicherts, and van Assen 2019, 22); while Mathur and VanderWeele (2020) find that publication bias can be mitigated in a meta-analysis so long as "a large number of studies (at least 40)" are included.…”

Section: A Replication Crisis In Environmental Public Health?mentioning

confidence: 99%

“…This might give us (indirect or direct) empirical evidence for the replicability of these associations; but not whether there is a problem of mass irreplicability across an entire field. A systematic review of meta-analyses -sometimes called a "meta-metaanalysis" -might provide such evidence (Dumas-Mallet et al 2017;Mathur and VanderWeele 2020). A PubMed search for the query meta-meta-analysis (https://pubmed.ncbi.nlm.nih.gov/?term=meta-meta-analysis) returned 29 results, only one of which appeared to be specific to environmental public health (Spitzer 1991 is a commentary on a critique of a meta-analysis of environmental tobacco smoke and lung cancer); though this lack of results might just be due to lack of adoption of the "metameta-analysis" term.…”

Section: A Replication Crisis In Environmental Public Health?mentioning

confidence: 99%

See 1 more Smart Citation

Open science, the replication crisis, and environmental public health

Hicks

2021

Accountability in Research

View full text Add to dashboard Cite

the replication crisis, and environmental public health Concerns about a crisis of mass irreplicability across scientific fields ("the replication crisis") have stimulated a movement for open science, encouraging or even requiring researchers to publish their raw data and analysis code. Recently, a rule at the US Environmental Protection Agency (US EPA) would have imposed a strong open data requirement. The rule prompted significant public discussion about whether open science practices are appropriate for fields of environmental public health. The aims of this paper are to assess (1) whether the replication crisis extends to fields of environmental public health; and (2) in general whether open science requirements can address the replication crisis. There is little empirical evidence for or against mass irreplicability in environmental public health specifically. Without such evidence, strong claims about whether the replication crisis extends to environmental public health -or not -seem premature. By distinguishing three concepts -reproducibility, replicability, and robustness -it is clear that open data initiatives can promote reproducibility and robustness but do little to promote replicability. I conclude by reviewing some of the other benefits of open science, and offer some suggestions for funding streams to mitigate the costs of adoption of open science practices in environmental public health.

show abstract

Section: A Replication Crisis In Environmental Public Health?mentioning

confidence: 99%

Section: A Replication Crisis In Environmental Public Health?mentioning

confidence: 99%

Open science, the replication crisis, and environmental public health

Hicks

2021

Accountability in Research

View full text Add to dashboard Cite

show abstract

“…Not all criteria have been shown to decrease bias in conclusions. For example, in many cases, large meta-analyses may to some extent mitigate publication bias without explicitly correcting for it (Mathur & VanderWeele, 2020b). Nevertheless, all are 'good practice' and conclusions should be drawn in light of the quality of the reviews.…”

Section: Quality Assessmentmentioning

confidence: 99%

Interventions that Influence Animal-Product Consumption: A Meta-Review

Grundy¹,

Slattery²,

Saeri³

et al. 2021

Preprint

View full text Add to dashboard Cite

Transitioning toward more plant-based diets can alleviate health and sustainability challenges. However, research on interventions that influence animal-product consumption remains fragmented and inaccessible to researchers and practitioners. We conducted an overview of systematic reviews, also known as a meta-review. We searched five databases for reviews that examined interventions that influence (increase or decrease) the consumption of animal products. We quantitatively summarised results using individual studies' directions of effect because reviews rarely reported effect sizes of primary studies. We also discussed the contexts in which the evidence for interventions appeared strongest in light of the broader literature on behaviour change. Eighteen systematic reviews met inclusion criteria, 12 of which examined interventions intended to decrease animal-product consumption and 6 of which examined interventions intended to increase animal-product consumption. In total, only two reviews conducted quantitative meta-analyses. Across all reviews, vote counting based on the direction of individual studies’ estimates indicated that providing information on the environmental impact of meat consumption may reduce consumption, with 10 of 11 estimates suggesting reduced consumption (91% [95% CI 62.3%, 98.4%]; p = .012). Providing information on the health consequences of meat consumption, emphasising social norms, and reducing meat portion sizes also appeared promising, albeit with more limited strength of evidence. Reviews examining interventions that decreased consumption predominately focused on meat (10/12 reviews). Future reviews should conduct quantitative syntheses where appropriate and could more frequently examine interventions that influence the consumption of animal products other than meat.

show abstract

“…In systematic reviews and meta-analysis, publication bias is unavoidable [40]- [42]. It is also one of the key threats to the cogency of meta-analysis.…”

Section: Publication Biasmentioning

confidence: 99%

A meta-analysis of channel switching approaches for reducing zapping delay in internet protocol television

Adeliyi

Ogunsakin²,

Adebiyi³

et al. 2021

IJEECS

View full text Add to dashboard Cite

Channel zapping delays are inconveniences that are often experienced by the subscribers of Internet protocol television (IPTV). It is a major bottleneck in the IPTV channels switching system that affect the quality of experience of users. Consequently, numerous channels switching approaches to minimize zapping delay in IPTV have been suggested. However, there is little knowledge reported in the literature on the determination of the strength of the evidence presented on the approaches of reducing zapping delay in IPTV, which is the prime purpose of this study. The extraction of the relevant articles was designed following the technique of preferred reporting items for systematic reviews and meta-analyses (PRISMA). All the included research articles were searched from the widely used databases of Google Scholar, and Web of Science. All statistical analyses were performed with the aid of the random-effects model implementation in Stata version 15. The overall pooled estimated delay component was presented in forest plots. Overall, thirteen studies were included in the meta-analysis and the overall pooled estimate was 10% (95% CI: 7%, 30%)). Experimental studies have shown that virtual elimination of IPTV zapping delay is possible for a relevant chunk of channel switching requests.

show abstract

Estimating publication bias in meta‐analyses of peer‐reviewed studies: A meta‐meta‐analysis across disciplines and journal tiers

Abstract: Mathur MB & VanderWeele TJ (in press). Estimating publication bias in meta-analyses of peer-reviewed studies: a meta-meta-analysis across disciplines and journal tiers. Research Synthesis Methods.

Cited by 48 publications

References 67 publications

Open science, the replication crisis, and environmental public health

Open science, the replication crisis, and environmental public health

Interventions that Influence Animal-Product Consumption: A Meta-Review

A meta-analysis of channel switching approaches for reducing zapping delay in internet protocol television

Contact Info

Product

Resources

About