Observation, experimentation, and replication in linguistics

Grieve, Jack

doi:10.1515/ling-2021-0094

Cited by 21 publications

(14 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The low rate of data sharing for primary analyses in linguistics is in line with evidence that data underlying scientific claims are rarely shared (60,61). 7 Sharing raw data is nevertheless critical: it enables the evaluation and verification of underlying claims and allows for the evaluation of empirical, computational and statistical reproducibility (64). It allows for alternative analyses to establish analytic robustness (65) and strengthens attempts to synthesize evidence via metaanalyses (31).…”

Section: Raw Data Processed Data and Script Sharingmentioning

confidence: 99%

“…It informs psychological and neural models of communication, categorization, and memory (1,2); it guides methods for diagnosis and therapy of speech, development, and aging disorders (3,4); it informs methods for educational improvements and facilitate advancement in new technological solutions such as speech recognition and speech synthesis (5,6). Spanning across many subfields, linguistics is also a particularly variegated field when it comes to its methods and the nature of the empirical studies conducted, a field that -while historically observational (7) -is increasingly shaped by quantitative data analysis. As such, linguistics, along with its neighboring fields, is undergoing a sea of change in the way research is conducted and shared.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Reproducible research practices and transparency across linguistics

Bochynska¹,

Keeble²,

Halfacre³

et al. 2023

Preprint

View full text Add to dashboard Cite

Scientific studies of language span across many disciplines and provide evidence for social, cultural, cognitive, technological, and biomedical studies of human nature and behavior. By becoming increasingly empirical and quantitative, linguistics has been facing challenges and limitations of the scientific practices that pose barriers to reproducibility and replicability. One of the proposed solutions to the widely acknowledged reproducibility and replicability crisis has been the implementation of transparency practices, e.g. open access publishing, preregistrations, sharing study materials, data, and analyses, performing study replications and declaring conflicts of interest. Here, we have assessed the prevalence of these practices in randomly sampled 600 journal articles from linguistics across two time points. In line with similar studies in other disciplines, we found a moderate amount of articles published open access, but overall low rates of sharing materials, data, and protocols, no preregistrations, very few replications and low rates of conflict of interest reports. These low rates have not increased noticeably between 2008/2009 and 2018/2019, pointing to remaining barriers and slow adoption of open and reproducible research practices in linguistics. As linguistics has not yet firmly established transparency and reproducibility as guiding principles in research, we provide recommendations and solutions for facilitating the adoption of these practices.

show abstract

Section: Raw Data Processed Data and Script Sharingmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Reproducible research practices and transparency across linguistics

Bochynska¹,

Keeble²,

Halfacre³

et al. 2023

Preprint

View full text Add to dashboard Cite

show abstract

“…The starting point of the open science movement is transparency and replicability of analysis (Grieve, 2021): does the data actually exist? If another researcher replicates the same procedures, will they achieve the same results?…”

Section: Management Plan For Brazilian Sociolinguistic Documentation ...mentioning

confidence: 99%

Sociolinguistic repositories as asset: challenges and difficulties in Brazil

Freitag

2022

View full text Add to dashboard Cite

Purpose This paper aims to provide a context for Brazilian Portuguese language documentation and its data collection to establish linguistic repositories from a sociolinguistic overview. Design/methodology/approach The main sociolinguistic projects that have generated collections of Brazilian Portuguese language data are presented. Findings The comparison with another situation of repositories (seed vaults) and with the accounting concept of assets is evocated to map the challenges to be overcome in proposing a standardized and professional language repository to host the collections of linguistic data arising from the reported projects and others, in the accordance with the principles of the open science movement. Originality/value Thinking about the sustainability of projects to build linguistic documentation repositories, partnerships with the information technology area, or even with private companies, could minimize problems of obsolescence and safeguarding of data, by promoting the circulation and automation of analysis through natural language processing algorithms. These planning actions may help to promote the longevity of the linguistic documentation repositories of Brazilian sociolinguistic research.

show abstract

“…Unfortunately, creating a clear taxonomy of constructs is easier said than done. One reason it is difficult to declare which constructs provide unique vs. redundant information is that context influences (i) how specific operationalizations map onto the underlying affect dynamics they aim to measure, (ii) how different measures relate to each other, and (iii) how these measures relate to outcomes of interest (Aldao, 2013;Lapate and Heller, 2020; see also Grieve, 2021). This makes it difficult to conclude from any single study-which only captures a single or a small set of contexts-what the taxonomy ought to be.…”

Section: Gaining Consensus On What We're Measuring and How To Measure Itmentioning

confidence: 99%

“…Similarly, one would imagine that the literal situations in which one measures participants' emotional responses would affect emotion differentiation scores and how well they predict psychopathology (e.g., people who avoid fear-inducing situations during sampling periods may never have the opportunity to endorse feeling fear, even though measuring differentiation in these settings might be the most powerful assay of symptom levels). Consequently, further descriptive evidence is needed to fill in the many unknowns of how these factors influence mappings between measures, constructs, and outcomes if we are to develop a replicable and accurate taxonomy for affective dynamics measures that are not confounded by these contextual factors (see Grieve, 2021 for a related argument in linguistics). Once these patterns have been documented, we can work toward a datadriven taxonomy that accurately situates emotion differentiation within the broader network of other constructs.…”

Section: Gaining Consensus On What We're Measuring and How To Measure Itmentioning

confidence: 99%

Emotion Differentiation and Youth Mental Health: Current Understanding and Open Questions

Nook

2021

Front. Psychol.

View full text Add to dashboard Cite

A growing body of research identifies emotion differentiation—the ability to specifically identify one’s emotions—as a key skill for well-being. High emotion differentiation is associated with healthier and more effective regulation of one’s emotions, and low emotion differentiation has been documented in several forms of psychopathology. However, the lion’s share of this research has focused on adult samples, even though approximately 50% of mental disorders onset before age 18. This review curates what we know about the development of emotion differentiation and its implications for youth mental health. I first review published studies investigating how emotion differentiation develops across childhood and adolescence, as well as studies testing relations between emotion differentiation and mental health in youth samples. Emerging evidence suggests that emotion differentiation actually falls across childhood and adolescence, a counterintuitive pattern that merits further investigation. Additionally, several studies find relations between emotion differentiation and youth mental health, but some instability in results emerged. I then identify open questions that limit our current understanding of emotion differentiation, including (i) lack of clarity as to the valid measurement of emotion differentiation, (ii) potential third variables that could explain relations between emotion differentiation and mental-health (e.g., mean negative affect, IQ, personality, and circularity with outcomes), and (iii) lack of clear mechanistic models regarding the development of emotion differentiation and how it facilitates well-being. I conclude with a discussion of future directions that can address open questions and work toward interventions that treat (or even prevent) psychopathology.

show abstract

Observation, experimentation, and replication in linguistics

Cited by 21 publications

References 36 publications

Reproducible research practices and transparency across linguistics

Reproducible research practices and transparency across linguistics

Sociolinguistic repositories as asset: challenges and difficulties in Brazil

Emotion Differentiation and Youth Mental Health: Current Understanding and Open Questions

Contact Info

Product

Resources

About