2022
DOI: 10.1177/16094069221075860
|View full text |Cite
|
Sign up to set email alerts
|

Coding Qualitative Data at Scale: Guidance for Large Coder Teams Based on 18 Studies

Abstract: We outline a process for using large coder teams (10 + coders) to code large-scale qualitative data sets. The process reflects experience recruiting and managing large teams of novice and trainee coders for 18 projects in the last decade, each engaging a coding team of 12 (minimum) to 54 (maximum) coders. We identify four unique challenges to large coder teams that are not presently discussed in the methodological literature: (1) recruiting and training coders, (2) providing coder compensation and incentives, … Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

0
4
0

Year Published

2023
2023
2024
2024

Publication Types

Select...
6

Relationship

0
6

Authors

Journals

citations
Cited by 10 publications
(4 citation statements)
references
References 55 publications
0
4
0
Order By: Relevance
“…Thus, further line-by-line coding was necessary to extract more codes, which were then uploaded to NVivo. Many qualitative researchers find that human coders can detect subtle and contextualized themes that are often of interest in the analysis, even with the advancement of computational techniques that use computers to code via keywords ( Beresford et al, 2022 ). Thus, coding by hand proved to be more efficient.…”
Section: Methodsmentioning
confidence: 99%
“…Thus, further line-by-line coding was necessary to extract more codes, which were then uploaded to NVivo. Many qualitative researchers find that human coders can detect subtle and contextualized themes that are often of interest in the analysis, even with the advancement of computational techniques that use computers to code via keywords ( Beresford et al, 2022 ). Thus, coding by hand proved to be more efficient.…”
Section: Methodsmentioning
confidence: 99%
“…The data analysis of the views on Powerful Parenting involved the two authors following the resources available at the time of the study. However, including a third judge or coder could help ensure coding reliability and establish the validity of the findings (Hruschka et al, 2004;Beresford et al, 2022). Triangulation by asking the study participants to review the findings and using different collection methods or data sources could also contribute to the validation of the analysis.…”
Section: Limitationsmentioning
confidence: 99%
“…Another common suggestion, like in the quote by Maslen (2016) above, is collaborative coding and analysing with multiple coders. This can help identify and overcome personal biases and personal interpretation, but can come with its own challenges, both in metaphor coding and beyond (Beresford et al, 2022). In most cases, it requires a strong and supportive management structure (Giesen & Roeser, 2020), and extensive documentation (Giesen & Roeser, 2020; Hemmler et al, 2022).…”
Section: Literature Reviewmentioning
confidence: 99%