Adjusting for Publication Bias in JASP and R: Selection Models, PET-PEESE, and Robust Bayesian Meta-Analysis

Bartoš, František; Maier, Maximilian; Quintana, Daniel; Wagenmakers, Eric‐Jan

doi:10.1177/25152459221109259

Cited by 55 publications

(62 citation statements)

References 112 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The Rank correlation test and the Egger statistical test were used to confirm or not the asymmetry of the funnel plot. Moreover, according to [ 63 ] selection model, PET PEESE analysis, and Robust Bayesian Meta-Analysis (RoBMA) were performed to further confirm publication bias. All statistical analyses were performed using JASP software version JASP (version 0.16.3, University of Amsterdam, Amsterdam, The Netherlands).…”

Section: Geographical Distribution Viral Prevalence and Seroprevalencementioning

confidence: 99%

Equine Hepacivirus: A Systematic Review and a Meta-Analysis of Serological and Biomolecular Prevalence and a Phylogenetic Update

Pacchiarotti

Nardini

Scicluna

2022

Animals

View full text Add to dashboard Cite

Viral hepatitis has recently assumed relevance for equine veterinary medicine since a variety of new viruses have been discovered. Equine Hepacivirus (EqHV) is an RNA virus belonging to the Flaviviridae family that can cause subclinical hepatitis in horses, occasionally evolving into a chronic disease. EqHV, to date, is considered the closest known relative of human HCV. EqHV has been reported worldwide therefore assessing its features is relevant, considering both the wide use of blood products and transfusions in veterinary therapies and its similitude to HCV. The present review resumes the actual knowledge on EqHV epidemiology, risk factors and immunology, together with potential diagnostics and good practices for prevention. Moreover, adhering to PRISMA guidelines for systematic reviews a meta-analysis of serological and biomolecular prevalence and an updated phylogenetic description is presented as a benchmark for further studies.

show abstract

Section: Geographical Distribution Viral Prevalence and Seroprevalencementioning

confidence: 99%

Equine Hepacivirus: A Systematic Review and a Meta-Analysis of Serological and Biomolecular Prevalence and a Phylogenetic Update

Pacchiarotti

Nardini

Scicluna

2022

Animals

View full text Add to dashboard Cite

show abstract

“…For any cell in the table that had three or more studies in it, we conducted a robust Bayesian, model-averaged meta-analysis. We input the correlation coefficients and sample sizes into the RoBMA() function in the RoBMA package (Bartoš & Maier, 2020), using default priors (standard normal distribution on effect sizes, inverse gamma distribution with α = 1 and β = 0.15 on heterogeneity, two two-sided weight functions with cut-points at (0.05) and (0.05, 0.10) and parameters α = (1, 1) and (1, 1, 1), and the default point priors on the null hypotheses) (Bartoš et al, 2022). This function allows us to test not only if there is evidence of an effect but also evidence for between-study heterogeneity (whether there is variation in true effect sizes across studies) and publication bias (Maier et al, 2022).…”

Section: Discussionmentioning

confidence: 99%

Impulsivity as a trait in domestic dogs (Canis familiaris): A systematic review and meta-analysis

Barela¹,

Worth²,

Stevens³

2023

Preprint

View full text Add to dashboard Cite

Impulsivity is a critical component of dog (Canis familiaris) behavior that owners often want to curtail. Though studies of dog impulsivity have examined their inability to wait and to inhibit inappropriate behaviors, it is not clear whether impulsivity is a behavioral trait with consistent characteristics across contexts. For this project, we conducted a systematic review and meta-analysis to investigate whether impulsivity exists as a behavioral trait in domestic dogs. Under a pre-registered protocol, we processed over 10,000 bibliographic database records to uncover 13 articles with multiple impulsivity tasks assessed in the same subjects. Across 31 pairs of impulsivity tasks, 28 failed to detect a correlation in performance between tasks and 3 detected a correlation. For 15 correlations of impulsivity tasks with the owner's perception of their dog's impulsivity, 10 were not correlated, while 5 were correlated. A formal meta-analysis on one pair of tasks (A-not-B task and Cylinder task) tested across seven different studies showed no overall correlation between the tasks. Our systematic review and meta-analysis found little indication of consistent relationships between impulsivity levels across tasks for dogs. Therefore, at the moment, we do not have good evidence of impulsivity as a behavioral trait that transfers across contexts, suggesting that perhaps we should focus on the context-specific nature of impulsivity in dogs.

show abstract

“…There are also Bayesian publication bias adjustment methods that allow simultaneous application of recent extensions to funnel plot methods and selection models (Bartoš et al, 2021; Maier et al, 2022). While the discussion of these methods is beyond the scope of this manuscript, Bartoš et al (2020) provided a tutorial paper with accompanying videos. Finally, some researchers have criticized selection models because published meta‐analyses adjusted via selection models can yield differing results from preregistered replication studies on the same topic (Kvarven et al, 2020).…”

Section: Discussionmentioning

confidence: 99%

Using selection models to assess sensitivity to publication bias: A tutorial and call for more routine use

Maier

VanderWeele

Mathur

2022

Campbell Systematic Reviews

Self Cite

View full text Add to dashboard Cite

In meta-analyses, it is critical to assess the extent to which publication bias might have compromised the results. Classical methods based on the funnel plot, including Egger's test and Trim-and-Fill, have become the de facto default methods to do so, with a large majority of recent meta-analyses in top medical journals (85%) assessing for publication bias exclusively using these methods. However, these classical funnel plot methods have important limitations when used as the sole means of assessing publication bias: they essentially assume that the publication process favors large point estimates for small studies and does not affect the largest studies, and they can perform poorly when effects are heterogeneous. In light of these limitations, we recommend that meta-analyses routinely apply other publication bias methods in addition to or instead of classical funnel plot methods. To this end, we describe how to use and interpret selection models. These methods make the often more realistic assumption that publication bias favors "statistically significant" results and that also directly accommodate effect heterogeneity.Selection models are well-established in the statistics literature and are supported by user-friendly software, yet remain rarely reported in many disciplines. We use previously published meta-analyses to demonstrate that selection models can yield insights that extend beyond those provided by funnel plot methods, suggesting the importance of establishing more comprehensive reporting practices for publication bias assessment.

show abstract

Adjusting for Publication Bias in JASP and R: Selection Models, PET-PEESE, and Robust Bayesian Meta-Analysis

Cited by 55 publications

References 112 publications

Equine Hepacivirus: A Systematic Review and a Meta-Analysis of Serological and Biomolecular Prevalence and a Phylogenetic Update

Equine Hepacivirus: A Systematic Review and a Meta-Analysis of Serological and Biomolecular Prevalence and a Phylogenetic Update

Impulsivity as a trait in domestic dogs (Canis familiaris): A systematic review and meta-analysis

Using selection models to assess sensitivity to publication bias: A tutorial and call for more routine use

Contact Info

Product

Resources

About