Views on Internal and External Validity in Empirical Software Engineering

Siegmund, Janet; Siegmund, Norbert; Apel, Sven

doi:10.1109/icse.2015.24

Cited by 139 publications

(85 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…This is called external validity which is used to test the generalizability of the model across different software applications [3]. All the models show the similar result as Mozilla Firefox.…”

Section: External Validitysupporting

confidence: 50%

Analysis of Temporal Bug Patterns in Open Source Software Using Hidden Markov Model

Pati¹,

Shukla²

2017

IJSEIA

View full text Add to dashboard Cite

show abstract

Section: External Validitysupporting

confidence: 50%

Analysis of Temporal Bug Patterns in Open Source Software Using Hidden Markov Model

Pati¹,

Shukla²

2017

IJSEIA

View full text Add to dashboard Cite

show abstract

“…By conducting controlled experiments, the feasibility of using the TTV KB is verified. With a focus on the tradeoff between internal validity, external validity and replication, Siegmund et al asked the community how empirical research should take place in software engineering and complemented with a literature review [10]. They found that the opinions differ considerably, and that there is no consensus in the community when to focus on internal or external validity and how to conduct and review replications.…”

Section: Related Workmentioning

confidence: 99%

A Map of Threats to Validity of Systematic Literature Reviews in Software Engineering

Zhou

Yu-qin²,

Zhang

et al. 2016

2016 23rd Asia-Pacific Software Engineering Conference (APSEC)

170

127

View full text Add to dashboard Cite

Context: The assessment of Threats to Validity (TTVs) is critical to secure the quality of empirical studies in Software Engineering (SE). In the recent decade, Systematic Literature Review (SLR) was becoming an increasingly important empirical research method in SE. One of the mechanisms of insuring the level of scientific value in the findings of an SLR is to rigorously assess its validity. Hence, it is necessary to realize the status quo and issues of TTVs of SLRs in SE. Objective: This study aims to investigate thestate-of-the-practice of TTVs of the SLRs published in SE, and further support SE researchers to improve the assessment and strategies against TTVs in order to increase the quality of SLRs in SE. Method: We conducted a tertiary study by reviewing the SLRs in SE that report the assessment of TTVs. Results: We identified 316 SLRs published from 2004 to the first half of 2015, in which TTVs are discussed. The issues associated to TTVs were also summarized and categorized. Conclusion: The common TTVs related to SLR research, such as internal validity and reliability, were thoroughly discussed in most SLRs. The threats to construct validity and external validity drew less attention. Moreover, there are few strategies and tactics being reported to cope with the various TTVs.

show abstract

“…For K aRCI both U PCC and ∆ω G1 are influenced. As a matter of fact, it human testing [22] so that appropriate guidelines are valuable for the CPES community.…”

Section: B Screening Simulation Resultsmentioning

confidence: 99%

Design of experiments aided holistic testing of cyber-physical energy systems

Meer

Steinbrink

Heussen

et al. 2018

2018 Workshop on Modeling and Simulation of Cyber-Physical Energy Systems (MSCPES)

View full text Add to dashboard Cite

The complex and often safety-critical nature of cyber-physical energy systems makes validation a key challenge in facilitating the energy transition, especially when it comes to the testing on system level. Reliable and reproducible validation experiments can be guided by the concept of design of experiments, which is, however, so far not fully adopted by researchers. This paper suggests a structured guideline for design of experiments application within the holistic testing procedure suggested by the European ERIGrid project. In this paper, a general workflow as well as a practical example are provided with the aim to give domain experts a basic understanding of design of experiments compliant testing.Index Terms-Design of experiments, cyber-physical energy systems, holistic testing, research infrastructure.

show abstract

Views on Internal and External Validity in Empirical Software Engineering

Cited by 139 publications

References 32 publications

Analysis of Temporal Bug Patterns in Open Source Software Using Hidden Markov Model

Analysis of Temporal Bug Patterns in Open Source Software Using Hidden Markov Model

A Map of Threats to Validity of Systematic Literature Reviews in Software Engineering

Design of experiments aided holistic testing of cyber-physical energy systems

Contact Info

Product

Resources

About