2019
DOI: 10.5334/labphon.147
|View full text |Cite
|
Sign up to set email alerts
|

Researcher degrees of freedom in phonetic research

Abstract: The results of published research critically depend on methodological decisions that have been made during data analysis. These so-called 'researcher degrees of freedom' (Simmons, Nelson, & Simonsohn, 2011) can affect the results and the conclusions researchers draw from it. It is argued that phonetic research faces a large number of researcher degrees of freedom due to its scientific object-speech-being inherently multidimensional and exhibiting complex interactions between multiple covariates. A Type-I error… Show more

Help me understand this report
View preprint versions

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1
1

Citation Types

2
32
0

Year Published

2019
2019
2022
2022

Publication Types

Select...
6
1

Relationship

0
7

Authors

Journals

citations
Cited by 50 publications
(34 citation statements)
references
References 90 publications
2
32
0
Order By: Relevance
“…the data according to post hoc exclusion criteria in order to avoid exploitation of researcher degrees of freedom (Roettger, 2019). We operate within the Bayesian inferential framework (rather than within a frequentist framework) for two reasons:…”
Section: Discussionmentioning
confidence: 99%
See 1 more Smart Citation
“…the data according to post hoc exclusion criteria in order to avoid exploitation of researcher degrees of freedom (Roettger, 2019). We operate within the Bayesian inferential framework (rather than within a frequentist framework) for two reasons:…”
Section: Discussionmentioning
confidence: 99%
“…low probability of a statistical test to reject a false null hypothesis, e.g. for recent discussion of power in speech research see Kirby & Sonderegger, 2018;Nicenboim, Roettger, & Vasishth, 2018), violation of the independence assumption Winter, 2011Winter, , 2015, exploitation of researcher degrees of freedom (Roettger, 2019) and the 'significance' filter (i.e. treating results as publishable because p < 0.05 leads to over optimistic expectations of replicability, see Vasishth, Mertzen, Jäger, & Gelman, 2018) can lead to biased results.…”
Section: Background 21 the 'Replication Crisis' And Why We Should Bementioning
confidence: 99%
“…What might be more relevant, though, is that the estimates of the difference in vowel duration are generally very low, between 3.5 and 15 ms. Given the small magnitude of the difference, it is likely that the failure to obtain significant p-values in some studies are due to low statistical power, rather than because of absence of the effect (as also hinted in Beguš 2017, see arguments in Roettger 2019 andNicenboim et al 2018).…”
Section: The Present Studymentioning
confidence: 97%
“…Some of the proposed mechanisms for the emergence of the voicing effect refer to properties of speech production. A notable production account, which will be the focus of this study, is based on compensatory temporal adjustments (Lindblom 1967;Slis & Cohen 1969a;b;Lehiste 1970a;b). According to this account, the voicing effect follows from the reorganisation of gestures within a unit of speech the duration of which is not affected by stop voicing.…”
Section: Introductionmentioning
confidence: 99%
See 1 more Smart Citation