Toward the characterization of software testing practices in South America: looking at Brazil and Uruguay

Dias-Neto, Arilo Cláudio; Matalonga, Santiago; Solari, Martín; Robiolo, Gabriela; Travassos, Guilherme Horta

doi:10.1007/s11219-016-9329-3

Cited by 25 publications

(48 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For changes, testers prefer to run the smaller scope (selected test cases), Table 6. Considering the results of a survey-based study conducted by Dias-Neto et al [13] in which authors surveyed the overall software testing practices we can conclude that practices identified in our study are purely regression testing related. As opposed to the survey conducted by Engström and Runeson [20] where authors specified that the practices identified in their survey are general testing practices.…”

Section: Regression Testing Practices (Rq2)mentioning

confidence: 54%

“…There is only little work on the perspectives of testing practitioners in industry on regression testing. We found only 13 articles [4,5,[13][14][15][16][17][18][19][20][21][22][23] related to our work, which we discuss further below. Out of these 13 studies, eight deal specifically with regression testing, whereas five have a broader focus.…”

Section: Related Workmentioning

confidence: 99%

“…Two studies, both of them surveys, investigated general testing practices ( [13,14]). Dias-Neto et al [13] conducted a survey-based study to identify the software testing practices in South America. The study was carried out with the practitioners from Brazil and Uruguay.…”

Section: Related Workmentioning

confidence: 99%

See 2 more Smart Citations

Regression testing for large-scale embedded software development – Exploring the state of practice

Minhas

Petersen

Börstler

et al. 2020

Information and Software Technology

View full text Add to dashboard Cite

Context. A majority of the regression testing techniques proposed by the research have not been adopted in industry. To increase adoption rates, we need to better understand the practitioners' perspectives on regression testing. Objective. This study aims at exploring the regression testing state of practice in the large-scale embedded software development. The study has two objectives, 1) to highlight the potential challenges in practice, and 2) to identify the industry-relevant research areas regarding regression testing. Method. We conducted a qualitative study in two large-scale embedded software development companies, where we carried out semi-structured interviews with representatives from five software testing teams. We did conduct the detailed review of the process documentation of the companies to complement/validate the findings of the interviews. Results. Mostly, the practitioners run regression testing with a selected scope, the selection of scope depends upon the size, complexity, and location of the change. Test cases are prioritized on the basis of risk and critical functionality. The practitioners rely on their knowledge and experience for the decision making regarding selection and prioritization of test cases. The companies are using both automated and manual regression testing, and mainly they rely on inhouse developed tools for test automation. The challenges identified in the companies are: time to test, information management, test suite maintenance, lack of communication, test selection/prioritization, lack of assessment, etc. The proposed improvements are in line with the identified challenges. Regression testing goals identified in this study are customer satisfaction, critical defect detection, confidence, effectiveness, efficiency, and controlled slip through of faults. Conclusions. Considering the current state of practice and identified challenges we conclude that there is a need to reconsider the regression test strategy in the Preprint submitted to Information and Software Technology November 29, 2018 companies. Researchers need to analyze the industry perspective while proposing new regression testing techniques. The industry-academia collaboration projects would be a good platform in this regard.

show abstract

Section: Regression Testing Practices (Rq2)mentioning

confidence: 54%

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Regression testing for large-scale embedded software development – Exploring the state of practice

Minhas

Petersen

Börstler

et al. 2020

Information and Software Technology

View full text Add to dashboard Cite

show abstract

“…Such sources may be useful for identifying tools, but the contents are neither generalizable nor validated for tool selection. There are software testing related academic studies which rely on surveys as the key methodology, e.g., [8,11,13,16,24,32,41,44], but only a few report software test tools (used by the practitioners) by name (e.g., [8,16,17]).…”

Section: Software Test Tool Selectionmentioning

confidence: 99%

Practitioner Evaluations on Software Testing Tools

Raulamo-Jurvanen

Hosio

Mäntylä

2019

Proceedings of the Evaluation and Assessment on Software Engineering

View full text Add to dashboard Cite

In software engineering practice, evaluating and selecting the software testing tools that best fit the project at hand is an important and challenging task. In scientific studies of software engineering, practitioner evaluations and beliefs have recently gained interest, and some studies suggest that practitioners find beliefs of peers more credible than empirical evidence. To study how software practitioners evaluate testing tools, we applied online opinion surveys (n=89). We analyzed the reliability of the opinions utilizing Krippendorff's alpha, intra-class correlation coefficient (ICC), and coefficients of variation (CV). Negative binomial regression was used to evaluate the effect of demographics. We find that opinions towards a specific tool can be conflicting. We show how increasing the number of respondents improves the reliability of the estimates measured with ICC. Our results indicate that on average, opinions from seven experts provide a moderate level of reliability. From demographics, we find that technical seniority leads to more negative evaluations. To improve the understanding, robustness, and impact of the findings, we need to conduct further studies by utilizing diverse sources and complementary methods.

show abstract

“…Some works available in the technical literature aim to characterize the software verification state of the practice. Most of them generically characterize software verification [15] [16] [17], including a family of surveys [18] [19] [20][20] [21] and studies regarding verification in the context of specific software categories, such as distributed and heterogeneous systems [22], android applications [23], and safety-critical systems [24]. However, as far as we could investigate, few studies specifically discuss the state of the practice of security verification and no study relates to performance verification.…”

Section: Introductionmentioning

confidence: 99%

A Perception of the Practice of Software Security and Performance Verification

Ribeiro¹,

Cruzes²,

Travassos³

2018

2018 25th Australasian Software Engineering Conference (ASWEC)

Self Cite

View full text Add to dashboard Cite

Security and performance are critical nonfunctional requirements for software systems. Thus, it is crucial to include verification activities during software development to identify defects related to such requirements, avoiding their occurrence after release. Software verification, including testing and reviews, encompasses a set of activities that have a purpose of analyzing the software searching for defects. Security and performance verification are activities that look at defects related to these specific quality attributes. Few empirical studies have been focused on how is the state of the practice in security and performance verification. This paper presents the results of a case study performed in the context of Brazilian organizations aiming to characterize security and performance verification practices. Additionally, it provides a set of conjectures indicating recommendations to improve security and performance verification activities.

show abstract

Toward the characterization of software testing practices in South America: looking at Brazil and Uruguay

Cited by 25 publications

References 33 publications

Regression testing for large-scale embedded software development – Exploring the state of practice

Regression testing for large-scale embedded software development – Exploring the state of practice

Practitioner Evaluations on Software Testing Tools

A Perception of the Practice of Software Security and Performance Verification

Contact Info

Product

Resources

About