Recent empirical studies have highlighted the large degree of analytic flexibility in data analysis that can lead to substantially different conclusions based on the same data set. Thus, researchers have expressed their concerns that these researcher degrees of freedom might facilitate bias and can lead to claims that do not stand the test of time. Even greater flexibility is to be expected in fields in which the primary data lend themselves to a variety of possible operationalizations. The multidimensional, temporally extended nature of speech constitutes an ideal testing ground for assessing the variability in analytic approaches, which derives not only from aspects of statistical modeling but also from decisions regarding the quantification of the measured behavior. In this study, we gave the same speech-production data set to 46 teams of researchers and asked them to answer the same research question, resulting in substantial variability in reported effect sizes and their interpretation. Using Bayesian meta-analytic tools, we further found little to no evidence that the observed variability can be explained by analysts’ prior beliefs, expertise, or the perceived quality of their analyses. In light of this idiosyncratic variability, we recommend that researchers more transparently share details of their analysis, strengthen the link between theoretical construct and quantitative system, and calibrate their (un)certainty in their conclusions.
Mycock, Xu, and Lahiri provide LFG analyses of multiple multi-clause constituent ‘wh’- question intonation patterns in Standard Colloquial Bengali (the Bengali dialect spoken in Kolkata), capturing the intonational tune–text mapping which crucially interacts with syntax, pragmatics, and semantics. Based on a new set of data, they identify the intonational contours used with ‘wh’-questions that include multiple question words and/or that comprise multiple clauses. These data reveal that a Focus accent can be ‘shared’ across a sequence of question words and that a subordinate clause forms a separate intonational unit (an Intonational Phrase) when it contains question words that take scope over a higher clause but not when they only take scope over the clause in which they appear.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.