What Makes Experts Reliable?

Marquardt, Kyle L.; Pemstein, Daniel; Seim, Brigitte; Wang, Yiting

doi:10.2139/ssrn.3190946

Cited by 3 publications

(1 citation statement)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, it would be far more consequential if such dynamics would increase response likelihoods among certain subgroups implying that scholars with limited context-specific expertise tend to self-select in the pool of respondents. This reassuring finding aligns with the results of a recent study on the correlates of expert reliability in the V-Dem project finding little evidence of theoretically untenable bias due to expert characteristics (Marquardt et al 2018).…”

Section: Discussionsupporting

confidence: 88%

Who are Our Experts? Predictors of Participation in Expert Surveys

Steinert

Ruggeri

2020

Peace Economics, Peace Science and Public Policy

View full text Add to dashboard Cite

Who are the colleagues participating when asked to complete expert surveys? This research note investigates which individuals’ characteristics associate with positive responses. Drawing on an expert survey dedicated to post-conflict trials, we collect data on various attributes of both respondents and non-respondents such as their age, sex, academic positions, disciplines, and research outputs. We expect that decisions to participate result from an interplay of (1) individuals’ levels of context-specific expertise, (2) the value attached to their expert role, (3) their confidence in making authoritative statements, and (4) resource constraints. Employing logistic regression models and statistical simulations (n = 414), we find that context-specific expertise is the primary, but not the only determinant of participation. On the one hand and luckily, individuals whose research corresponds closely to the object of study are most likely to participate. On the other hand and unfortunately, individuals with high citation outputs, female experts, and Area Studies-scholars are less likely to respond. Consequently, certain groups are under-represented in expert evaluations frequently considered as authoritative source of knowledge.

show abstract

Section: Discussionsupporting

confidence: 88%

Who are Our Experts? Predictors of Participation in Expert Surveys

Steinert

Ruggeri

2020

Peace Economics, Peace Science and Public Policy

View full text Add to dashboard Cite

show abstract

Coherence objectivity and measurement: the example of democracy

Crasnow

2020

Synthese

View full text Add to dashboard Cite

Conceptualizing and Measuring Democracy

Crasnow

2023

The Oxford Handbook of Philosophy of Political Science

View full text Add to dashboard Cite

Research on democracy frequently depends on indices that can be understood as representing measures of democracy. Because democracy is an abstract, contested, and value-laden concept, as are many concepts in the social sciences, any project that seeks to provide its measure must face a number of challenges. This chapter explores the extent to which the Varieties of Democracy Project (V-Dem) is able to meet those challenges through the use of several key conceptual tools from the research on measurement in philosophy of science.

show abstract

What Makes Experts Reliable?

Cited by 3 publications

References 12 publications

Who are Our Experts? Predictors of Participation in Expert Surveys

Who are Our Experts? Predictors of Participation in Expert Surveys

Coherence objectivity and measurement: the example of democracy

Conceptualizing and Measuring Democracy

Contact Info

Product

Resources

About