Trends in the Quality of Human-Centric Software Engineering Experiments--A Quasi-Experiment

Kitchenham, Barbara; Sjøberg, Dag I. K.; Dybå, Tore; Brereton, O. P.; Budgen, David; Höst, Martin; Runeson, Per

doi:10.1109/tse.2012.76

Cited by 19 publications

(28 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Based on our findings, we recommend researchers to report their IaC-related research findings by following the best practices suggested by Kitchenham et al. [14].…”

Section: Resultsmentioning

confidence: 84%

“…We also evaluate the publications' quality using the guidelines provided by Kitchenham et al [14]. We report our findings in Table 2.…”

Section: Resultsmentioning

confidence: 99%

“…Kitchenham et al [14] proposed a set of criteria to evaluate the quality of software engineering publications. In their study, they used this criteria to assess if the quality of software engineering publications are increasing or decreasing as time progresses.…”

Section: Phase Three: Quality Analysismentioning

confidence: 99%

“…A publication's higher quality score indicates that the publication of interest has stated their objectives clearly, has actionable findings, has discussed the limitations, and has clear presentation structure. We used Kitchenham et al [14]'s criteria set to assess the quality of our set of publications related to IaC:…”

Section: Phase Three: Quality Analysismentioning

confidence: 99%

See 3 more Smart Citations

A systematic mapping study of infrastructure as code research

Rahman¹,

Mahdavi-Hezaveh²,

Williams³

2019

Information and Software Technology

View full text Add to dashboard Cite

Context: Infrastructure as code (IaC) is the practice to automatically configure system dependencies and to provision local and remote instances. Practitioners consider IaC as a fundamental pillar to implement DevOps practices, which helps them to rapidly deliver software and services to end-users. Information technology (IT) organizations, such as Github, Mozilla, Facebook, Google and Netflix have adopted IaC. A systematic mapping study on existing IaC research can help researchers to identify potential research areas related to IaC, for example, the areas of defects and security flaws that may occur in IaC scripts.Objective: The objective of this paper is to help researchers identify research areas related to infrastructure as code (IaC) by conducting a systematic mapping study of IaC-related research.Methodology: We conduct our research study by searching six scholar databases.We collect a set of 33,887 publications by using seven search strings. By systematically applying inclusion and exclusion criteria, we identify 31 publications related to IaC. We identify topics addressed in these publications by applying qualitative analysis. Results:We identify four topics studied in IaC-related publications: (i) framework/tool for infrastructure as code; (ii) use of infrastructure as code; (iii) em-pirical study related to infrastructure as code; and (iv) testing in infrastructure as code. According to our analysis, 52% of the studied 31 publications propose a framework or tool to implement the practice of IaC or extend the functionality of an existing IaC tool.Conclusion: Our findings suggest that framework or tools is a well-studied topic in IaC research. As defects and security flaws can have serious consequences for the deployment and development environments in DevOps, along with other topics, we observe the need for research studies that will study defects and security flaws for IaC.

show abstract

“…Based on our findings, we recommend researchers to report their IaC-related research findings by following the best practices suggested by Kitchenham et al. [14].…”

Section: Resultsmentioning

confidence: 84%

“…We also evaluate the publications' quality using the guidelines provided by Kitchenham et al [14]. We report our findings in Table 2.…”

Section: Resultsmentioning

confidence: 99%

Section: Phase Three: Quality Analysismentioning

confidence: 99%

Section: Phase Three: Quality Analysismentioning

confidence: 99%

See 2 more Smart Citations

A systematic mapping study of infrastructure as code research

Rahman¹,

Mahdavi-Hezaveh²,

Williams³

2019

Information and Software Technology

View full text Add to dashboard Cite

show abstract

“…SE is becoming mature. Over the past few decades, the SE community has developed better understanding of scientific methodology [13], better definitions of core concepts, and most importantly, numerous (at least implicit) theories. The workshop demonstrated two important thingsfirst, that there are today many potential candidates for or embryos of a general theory of SE.…”

Section: Discussionmentioning

confidence: 99%

Report on the first SEMAT workshop on general theory of software engineering (GTSE 2012)

Johnson

Ralph

Goedicke

et al. 2013

SIGSOFT Softw. Eng. Notes

View full text Add to dashboard Cite

Many academic disciplines have general theories, which apply across the discipline and underlie much of its research. Examples include the Big Bang theory (cosmology), Maxwell's equations (electrodynamics), the theories of the cell and evolution (biology), the theory of supply and demand (economics), and the general theory of crime (criminology). Software engineering, in contrast, has no widely-accepted general theory. Consequently, the SEMAT Initiative organized a workshop to encourage development of general theory in software engineering. Workshop participants reached broad consensus that software engineering would benefit from better theoretical foundations, which require diverse theoretical approaches, consensus on a primary dependent variable and better instrumentation and descriptive research.

show abstract

What Do We Know and How Well Do We Know It? Current Knowledge About Software Engineering Practices

Budgen

2016

Communications in Computer and Information Science

View full text Add to dashboard Cite

Trends in the Quality of Human-Centric Software Engineering Experiments--A Quasi-Experiment

Cited by 19 publications

References 18 publications

A systematic mapping study of infrastructure as code research

A systematic mapping study of infrastructure as code research

Report on the first SEMAT workshop on general theory of software engineering (GTSE 2012)

What Do We Know and How Well Do We Know It? Current Knowledge About Software Engineering Practices

Contact Info

Product

Resources

About