Reliability in Software Engineering Qualitative Research through Inter-Coder Agreement: A guide using Krippendorff's $α$ &amp; Atlas.ti

González-Prieto, Ángel; Pérez, Jorge; Díaz, Jessica; López-Fernández, Daniel

doi:10.48550/arxiv.2008.00977

Cited by 3 publications

(4 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Collaboration is a property of cross-functional teams (density=8) -[6: [16][17][18]] "Collaboration and communications among team members can considerably increase by establishing cross-functional teams".…”

Section: Sorting Proceduresmentioning

confidence: 99%

Harmonizing Devops Taxonomies – a Grounded Theory Study

Díaz¹,

Pérez

Alves

et al. 2023

Preprint

View full text Add to dashboard Cite

Section: Sorting Proceduresmentioning

confidence: 99%

Harmonizing Devops Taxonomies – a Grounded Theory Study

Díaz¹,

Pérez

Alves

et al. 2023

Preprint

View full text Add to dashboard Cite

“…After completing the coding process, Krippendorff's α coefficients [26,32] were computed (see also [18] for a thorough introduction to these techniques). Specifically, Cu-α 4 and cu-α 5 coefficients were computed and their values are shown in Table 3.…”

Section: Iterationmentioning

confidence: 99%

Edge computing

et al. 2022

Self Cite

View full text Add to dashboard Cite

IoT edge computing is a new computing paradigm “in the IoT domain” for performing calculations and processing at the edge of the network, closer to the user and the source of the data. This paradigm is relatively recent, and, together with cloud and fog computing, there may be some confusion about its meaning and implications. This paper aims to help practitioners and researchers better understand what the industry thinks about what IoT edge computing is, and the expected benefits and challenges associated with this paradigm. We conducted a survey using a semi-structured in-depth questionnaire to collect qualitative data from relevant stakeholders from 29 multinational companies and qualitatively analyzed these data using the Constructivist Grounded Theory (Charmaz) method. Several researchers participated in the coding process (collaborative coding). To ensure consensus on the constructs that support the theory and thus improve the rigor of qualitative research, we conducted an intercoder agreement analysis. From the analysis, we have derived a substantive and analytic theory of what companies perceive about IoT edge computing, its benefits and challenges. The theory is substantive in that the scope of validity refers to the 29 surveys processed and analytic in that it analyzes “what is” rather than explaining causality or attempting predictive generalizations. A public repository with all the data related to the information capture process and the products resulting from the analysis of this information is publicly available. This study aims to strengthen the evidence and support practitioners in making better informed decisions about why companies are adopting edge computing and the current challenges they face. Additionally, the testing theory phase shows that the results are aligned with the ISO/IEC TR 30164 standard.

show abstract

Section: Sorting Proceduresmentioning

confidence: 99%

“…Subsequently, R2 received this initial codebook and quotations, and assigned codes to the quotations as well as created or modified codes when necessary. After completion of the two rounds of coding, Krippendorff's coefficients α [23,26] were computed (see [18] for a detailed description of the use of these techniques in qualitative research). Specifically, Cu-α 3 and cu-α 4 coefficients were computed, and their values are shown in Table 2.…”

Section: Iterationmentioning

confidence: 99%

Harmonizing DevOps Taxonomies - A Grounded Theory Study

Díaz

Pérez

Alves³

et al. 2022

Preprint

View full text Add to dashboard Cite

Context: DevOps responds to the growing need of companies to streamline the software development process and, thus, have experienced a widespread adoption in the past few years. However, successful adoption of DevOps requires companies to address important cultural and organizational changes. Understanding the organizational structure and characteristics of teams adopting DevOps is key, and comprehending the existing theories and representations of team taxonomies is critical to guide companies in a more systematic and structured DevOps adoption process. Objective: This paper presents empirical research on the structure of DevOps teams in software-producing organizations. The goal is to better understand the organizational structure and characteristics of teams adopting DevOps by harmonizing the existing knowledge. Method: To do this, we conducted a grounded theory study, analyzing existing studies on DevOps teams and taxonomies. Results: From the analysis, we built a substantive and analytic theory of DevOps taxonomies. The theory is substantive in that the scope of validity refers to the ten primary studies processed and analytic in that it analyzes “what is” rather than explaining causality or attempting predictive generalizations. A public repository with all the data related to the products resulting from the analysis and generation of the theory is available. Conclusions: We built a theory on DevOps taxonomies and tested whether it harmonizes the existing taxonomies, i.e., whether our theory can instantiate the others. This is the first step to define which taxonomies are best suited to approach DevOps culture and practices according to the companies’ objectives and capabilities.

show abstract

Reliability in Software Engineering Qualitative Research through Inter-Coder Agreement: A guide using Krippendorff's $α$ & Atlas.ti

Cited by 3 publications

References 0 publications

Harmonizing Devops Taxonomies – a Grounded Theory Study

Harmonizing Devops Taxonomies – a Grounded Theory Study

Edge computing

Harmonizing DevOps Taxonomies - A Grounded Theory Study

Contact Info

Product

Resources

About