Knowledge-Sharing Issues in Experimental Software Engineering

Shull, Forrest; Mendoncça, Manoel G.; Basili, Victor R.; Carver, Jeffrey C.; Maldonado, José Carlos; Fabbri, Sandra; Travassos, Guilherme Horta; Ferreira, Maria Cristina

doi:10.1023/b:emse.0000013516.80487.33

Cited by 117 publications

(86 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Issues such as documentation [73] and communication between experimenters [76] may influence the success of a replication. Deficiencies in documentation and laboratory packages are one of the biggest reading the pattern description for the questions regarding the patterns and before the first measurement for the questions regarding the metrics.…”

Section: Documentation and Communicationmentioning

confidence: 99%

Validating a model-driven software architecture evaluation and improvement method: A family of experiments

González-Huerta

Insfrán

Abrahão

et al. 2015

Information and Software Technology

View full text Add to dashboard Cite

ElsevierGonzález Huerta, J.; Insfrán Pelozo, CE.; Abrahao Gonzales, SM.; Scanniello, G. (2015 Context: Software architectures should be evaluated during the early stages of software development in order to verify whether the Non-Functional Requirements (NFRs) of the product can be fulfilled. This activity is even more crucial in Software Product Line (SPL) development, since it is also necessary to identify whether the NFRs of a particular product can be achieved by exercising the variation mechanisms provided by the product line architecture or whether additional transformations are required. These issues have motivated us to propose QuaDAI, a method for the derivation, evaluation and improvement of software architectures in model-driven SPL development.Objective: We present in this paper the results of a family of four experiments carried out to empirically validate the evaluation and improvement strategy of QuaDAI. Method:The family of experiments was carried out by 92 participants: Computer Science Master's and undergraduate students from Spain and Italy. The goal was to compare the effectiveness, efficiency, perceived ease of use, perceived usefulness and intention to use with regard to participants using the evaluation and improvement strategy of QuaDAI as opposed to the Architecture Tradeoff Analysis Method (ATAM). Results:The main result was that the participants produced their best results when applying QuaDAI, signifying that the participants obtained architectures with better values for the NFRs faster, and that they found the method easier to use, more useful and more likely to be used. The results of the meta-analysis carried out to aggregate the results obtained in the individual experiments also confirmed these results. Conclusions:The results support the hypothesis that QuaDAI would achieve better results than ATAM in the experiments and that QuaDAI can be considered as a promising approach with which to perform architectural evaluations that occur after the product architecture derivation in model-driven SPL development processes when carried out by novice software evaluators.

show abstract

Section: Documentation and Communicationmentioning

confidence: 99%

Validating a model-driven software architecture evaluation and improvement method: A family of experiments

González-Huerta

Insfrán

Abrahão

et al. 2015

Information and Software Technology

View full text Add to dashboard Cite

show abstract

“…Other researchers have reported problems related to running replications (see for example [10] or [13]). In this article, however, we focus specifically on our experience of running experiment replications in the past.…”

Section: Related Work: Prevous Experiencementioning

confidence: 99%

“…Not even the most comprehensive replication package will contain all the information required to run the replication. This is a notorious problem in experiment replication in other fields apart from SE and is known as the tacit knowledge problem [13]. It is very hard, if not impossible, to find two contexts sharing exactly the same characteristics.…”

Section: Related Work: Prevous Experiencementioning

confidence: 99%

Design Patterns in Software Maintenance: An Experiment Replication at UPM - Experiences with the RESER'11 Joint Replication Project

Juristo

Vegas

2011

2011 Second International Workshop on Replication in Empirical Software Engineering Research

View full text Add to dashboard Cite

Abstract-Replication of software engineering experiments is crucial for dealing with validity threats to experiments in this area. Even though the empirical software engineering community is aware of the importance of replication, the replication rate is still very low. The RESER'11 Joint Replication Project aims to tackle this problem by simultaneously running a series of several replications of the same experiment. In this article, we report the results of the replication run at the Universidad Politécnica de Madrid. Our results are inconsistent with the original experiment. However, we have identified possible causes for them. We also discuss our experiences (in terms of pros and cons) during the replication.

show abstract

“…A visão de mundo sistêmica adotada neste trabalho é baseada no modelo CESM 2 de Bunge (2003). O autor analisa diversas definições de sistemas e considera a necessidade de um conceito científico abrangente.…”

Section: Um Modelo Sociotecnológico Da Engenharia De Requisitosunclassified

Uma análise sistêmica sociotecnológica da engenharia de requisitos

2010

View full text Add to dashboard Cite

A engenharia de requisitos, etapa inicial da construção de sistemas de informação, requer intenso intercâmbio de informação entre profissionais de tecnologias da informação e comunicação, e peritos no negócio. A teoria e a prática comum da engenharia de requisitos, no entanto, são tecnocêntricas e caracterizadas por dificuldade de comunicação. A literatura recente aborda a concepção de sistemas sociotecnológicos, cujas propriedades emergem por meio da colaboração dinâmica entre pessoas e agentes artificiais. Este artigo apresenta um modelo sistêmico sociotecnológico da engenharia de requisitos com base no modelo CESM de Mario Bunge, segundo o qual todo sistema concreto pode ser representado segundo seus componentes, ambiente, estrutura e mecanismo. Entre os componentes, estão os peritos no negócio, profissionais de TIC, agentes artificiais e os objetos da colaboração dinâmica -modelo de domínio e requisitos. O mecanismo é essencialmente um processo de comunicação, com intercâmbio de informações e compartilhamento de conhecimento. Essa descrição presta-se à compreensão sistêmica da engenharia de requisitos, visando à intervenção para aliviar os problemas comunicacionais do processo e promover a emergência de requisitos que representem as reais necessidades do sistema. PALAVRAS-CHAVE:Sistemas de informação. Sistemas sociotecnológicos. Engenharia de requisitos. Compartilhamento do conhecimento. Visão sistêmica. INTRODUÇÃOMcGee e Prusak (1994) afirmam que, na economia da informação, o diferencial competitivo das organizações está na sua capacidade de adquirir, tratar, interpretar e utilizar a informação de forma eficaz. Os sistemas de informação são auxiliares neste processo.Esta obra está licenciada sob uma Licença Creative Commons.

show abstract

Knowledge-Sharing Issues in Experimental Software Engineering

Cited by 117 publications

References 13 publications

Validating a model-driven software architecture evaluation and improvement method: A family of experiments

Validating a model-driven software architecture evaluation and improvement method: A family of experiments

Design Patterns in Software Maintenance: An Experiment Replication at UPM - Experiences with the RESER'11 Joint Replication Project

Uma análise sistêmica sociotecnológica da engenharia de requisitos

Contact Info

Product

Resources

About