Towards Multi-Method Research Approach in Empirical Software Engineering

Mandić, Vladimir; Markkula, Jouni; Oivo, Markku

doi:10.1007/978-3-642-02152-7_9

Cited by 7 publications

(9 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Mandic´ et al's [45] exact/partial replications are comparable with our literal replications, and their replications that improve the original experiment are equivalent to our operational and conceptual replications.…”

Section: Comparing the Proposed Classification With Other Se Classifisupporting

confidence: 72%

“…Shull et al [63] discuss some replication types (exact, independent, dependent and conceptual replication) to describe the role that replication plays in SE. Finally, Lung et al [42] mention two types of replication (literal and theoretical replication) to explain the replication type that they conducted, and Mandic et al [45] discuss two replication types: exact or partial replications and replications designed to improve the original experiment.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Understanding replication of experiments in software engineering: A classification

Gómez

Juristo

Vegas

2014

Information and Software Technology

110

117

View full text Add to dashboard Cite

Context: Replication plays an important role in experimental disciplines. There are still many uncertain-ties about how to proceed with replications of SE experiments. Should replicators reuse the baseline experiment materials? How much liaison should there be among the original and replicating experiment-ers, if any? What elements of the experimental configuration can be changed for the experiment to be considered a replication rather than a new experiment? Objective: To improve our understanding of SE experiment replication, in this work we propose a classi-fication which is intend to provide experimenters with guidance about what types of replication they can perform. Method: The research approach followed is structured according to the following activities: (1) a litera-ture review of experiment replication in SE and in other disciplines, (2) identification of typical elements that compose an experimental configuration, (3) identification of different replications purposes and (4) development of a classification of experiment replications for SE. Results: We propose a classification of replications which provides experimenters in SE with guidance about what changes can they make in a replication and, based on these, what verification purposes such a replication can serve. The proposed classification helped to accommodate opposing views within a broader framework, it is capable of accounting for less similar replications to more similar ones regarding the baseline experiment. Conclusion: The aim of replication is to verify results, but different types of replication serve special ver-ification purposes and afford different degrees of change. Each replication type helps to discover partic-ular experimental conditions that might influence the results. The proposed classification can be used to identify changes in a replication and, based on these, understand the level of verification.

show abstract

Section: Comparing the Proposed Classification With Other Se Classifisupporting

confidence: 72%

Section: Related Workmentioning

confidence: 99%

Understanding replication of experiments in software engineering: A classification

Gómez

Juristo

Vegas

2014

Information and Software Technology

110

117

View full text Add to dashboard Cite

show abstract

“…methods are applied in parallel with results provided to each other; dominant, that states one method is used as a main method with a share of others; multimethodology, that combines methods from different paradigms specifically to serve the purpose of the study; multilevel in which different methods are applied simultaneously at different levels of an organization. In [10] the results of a literature analysis are presented which analyzed the empirical research approaches in software engineering. Researchers in the field of software engineering have no consensus yet that mixed methods studies are beneficial [10].…”

Section: -Qualitative Quantitative and Mixed Research Methodsmentioning

confidence: 99%

“…In [10] the results of a literature analysis are presented which analyzed the empirical research approaches in software engineering. Researchers in the field of software engineering have no consensus yet that mixed methods studies are beneficial [10]. An example of mixed method studies in software engineering can be found in [15], where an investigation of object orientation is made using a survey questionnaire, a structured interview and controlled laboratory experiments.…”

Section: -Qualitative Quantitative and Mixed Research Methodsmentioning

confidence: 99%

“…The mixed method approach may help to limit the experimental validity threats in software engineering [15]. In [10] it is stated that the empirical evidences have a psychological effect on the researchers and practitioners which help to convince them that the results are useful and correct. Mixed method research in software engineering helps to improve the impact of results by increasing the confidence in the findings.…”

Section: -Qualitative Quantitative and Mixed Research Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Proposal for evaluation of software reusability assessment approach employing a mixed method

Amin

Mahmood

Oxley

2010

SIGSOFT Softw. Eng. Notes

View full text Add to dashboard Cite

Software engineering, as an engineering discipline, is still quite young as compared to other engineering disciplines. The software engineering research community has made enormous contributions in past decades to lay down its foundations. However, the research methodologies in software engineering are still not mature. One of the reasons in this regard is the inherent complexity of this field. In this paper, we focus on one aspect of this field -the evaluation of reusability assessment approaches. We begin by reviewing existing ways of comparing reusability assessment approaches. Following this we propose a different approach. This includes a mixture of both subjective and objective evaluation of a reusability assessment approach. This is novel in that we feel that subjective evaluation has been neglected by other approaches.

show abstract

Replication of Software Engineering Experiments

Juristo

Gómez

2012

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Towards Multi-Method Research Approach in Empirical Software Engineering

Cited by 7 publications

References 29 publications

Understanding replication of experiments in software engineering: A classification

Understanding replication of experiments in software engineering: A classification

Proposal for evaluation of software reusability assessment approach employing a mixed method

Replication of Software Engineering Experiments

Contact Info

Product

Resources

About