Using Process Simulation to Assess the Test Design Effort Reduction of a Model-Based Testing Approach

Aranha, E.; Borba, Paulo

doi:10.1007/978-3-540-79588-9_25

Cited by 6 publications

(3 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Furthermore, improvements have been evaluated by varying a number of parameters in the process to determine the best alternatives one ought to strive for (cf. [144,96,107]), as well as investigating specific technology adoptions to the [76], or use of different quality assurance approaches or architectural styles [84]. Training and Learning: In training and learning the majority of the studies aimed to explore or understand a phenomena from a scientific point of view to provide some recommendations and guidelines to practitioners (cf.…”

Section: Purposementioning

confidence: 99%

“…A Portion of the Lifecycle: Studies looking at a portion of a lifecycle investigated focused on the maintenance process solely [81,124,131], software reliability life cycle [141], requirements and test [73], quality assurance processes [76,128], requirements [85], release processes [95], and processes for components off the shelf (COTS) selection and use [134].…”

Section: Scopementioning

confidence: 99%

See 1 more Smart Citation

A systematic literature review on the industrial use of software process simulation

Ali

Petersen

Wohlin

2014

Journal of Systems and Software

View full text Add to dashboard Cite

Context -Software process simulation modelling (SPSM) captures the dynamic behavior and uncertainty in the software process. Existing literature has conflicting claims about the practical usefulness of SPSM: SPSM is useful and has an industrial impact; SPSM is useful and has no industrial impact yet; SPSM is not useful and has little potential for industry. Objective -To assess the conflicting standpoints on the usefulness of SPSM. Method -A systematic literature review was performed to identify, assess and aggregate empirical evidence on the usefulness of SPSM. Results -In the primary studies, to date, the persistent trend is that of proof-of-concept applications of software process simulation for various purposes (e.g. estimation, training, process improvement, etc.). They score poorly on the stated quality criteria. Also only a few studies report some initial evaluation of the simulation models for the intended purposes. Conclusion -There is a lack of conclusive evidence to substantiate the claimed usefulness of SPSM for any of the intended purposes. A few studies that report the cost of applying simulation do not support the claim that it is an inexpensive method. Furthermore, there is a paramount need for improvement in conducting and reporting simulation studies with an emphasis on evaluation against the intended purpose.

show abstract

Section: Purposementioning

confidence: 99%

Section: Scopementioning

confidence: 99%

A systematic literature review on the industrial use of software process simulation

Ali

Petersen

Wohlin

2014

Journal of Systems and Software

View full text Add to dashboard Cite

show abstract

“…The cost to execute each test case of the functional suite was measured by the Test Execution Effort Estimation Tool, developed by [Aranha and Borba 2008]. The effort represents the cost (in time) needed to manually execute each test case on a particular mobile device.…”

Section: Experiments Preparationmentioning

confidence: 99%

Multi-Objective Test Case Selection: A study of the influence of the Catfish effect on PSO based strategies

Souza

Prudêncio²,

Barros³

2014

Anais Do XV Workshop De Testes E Tolerância a Falhas (WTF 2014)

View full text Add to dashboard Cite

During the software testing process many test suites can be generated in order to evaluate and assure the quality of the products. In some cases, the execution of all suites can not fit the available resources (time, people, etc). Hence, automatic Test Case (TC) selection could be used to reduce the suites based on some selection criterion. This process can be treated as an optimization problem, aiming to find a subset of TCs which optimizes one or more objective functions (i.e., selection criteria). In this light, we developed mechanisms for TC selection in context of structural and functional testing. The proposed algorithms consider two objectives simultaneously: maximize branch coverage (or functional requirements coverage) while minimizing execution cost (time). These mechanisms were implemented by deploying multi-objective techniques based on Particle Swarm Optimization (PSO). Additionally, we added the so-called catfish effect into the multi-objective selection algorithms in order to improve their results. The performed experiments revealed the feasibility of the proposed strategies.

show abstract

Metrics for software process simulation modeling

Liu,

Zhang,

Dong

et al. 2024

J Software Evolu Process

View full text Add to dashboard Cite

Software process simulation (SPS) has become an effective tool for software process management and improvement. However, its adoption in industry is less than what the research community expected due to the burden of measurement cost and the high demand for domain knowledge. The difficulty of extracting appropriate metrics with real data from process enactment is one of the great challenges. We aim to provide evidence‐based support of the process metrics for software process (simulation) modeling. A systematic literature review was performed by extending our previous review series to draw a comprehensive understanding of the metrics for process modeling following our proposed ontology of metrics in SPS. We identify 131 process modeling studies that collectively involve 1975 raw metrics and classified them into 21 categories using the coding technique. We found product and process external metrics are not used frequently in SPS modeling while resource external metrics are widely used. We analyze the causal relationships between metrics. We find that the models exhibit significant diversity, as no pairwise relationship between metrics accounts for more than 10% SPS models. We identify 17 data issues may encounter in measurement and 10 coping strategies. The results of this study provide process modelers with an evidence‐based reference of the identification and the use of metrics in SPS modeling and further contribute to the development of the body of knowledge on software metrics in the context of process modeling. Furthermore, this study is not limited to process simulation but can be extended to software process modeling, in general. Taking simulation metrics as standards and references can further motivate and guide software developers to improve the collection, governance, and application of process data in practice.

show abstract

Using Process Simulation to Assess the Test Design Effort Reduction of a Model-Based Testing Approach

Cited by 6 publications

References 8 publications

A systematic literature review on the industrial use of software process simulation

A systematic literature review on the industrial use of software process simulation

Multi-Objective Test Case Selection: A study of the influence of the Catfish effect on PSO based strategies

Metrics for software process simulation modeling

Contact Info

Product

Resources

About