Literature Review of Empirical Research Studies within the Domain of Acceptance Testing

Weiß, Johannes; Schill, Alexander; Richter, Ingo; Mandl, Peter

doi:10.1109/seaa.2016.33

Cited by 3 publications

(10 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The acceptance tests are derived from the customer requirements, and their focus is to verify the completeness of the implementation of requirements [22]. It was proposed that customers specify these acceptance tests, and these tests can be used as a form of requirements [7]. In a literature review [5], Haugset and Hanssen found the following benefits associated with AATs: -AATs improve the understanding of the domain and product.…”

Section: Automated Acceptance Tests (Aats)mentioning

confidence: 99%

“…These types of acceptance tests can be written using the existing practices and tools used for product development [26]. However, a drawback with this format is the difficulty for a customer to be part of the development of the acceptance test process [7].…”

Section: Automated Acceptance Tests (Aats)mentioning

confidence: 99%

“…FitNesse 2 is the most commonly used framework for data-driven acceptance testing. A literature review on AATs identified that most of the studies present in literature are on the FitNesse (21 out of 26 identified studies) [7]. The data-driven formats are also useful when performing regression testing on systems with varying input and output values [28].…”

Section: Automated Acceptance Tests (Aats)mentioning

confidence: 99%

“…Existing studies on AATs have discussed code--based and FIT tables (as an AAT format); little work is done on the text-based automated acceptance tests [7]. An example of a text-based automated acceptance test (a customer buying a mobile phone) is shown below using behavior-driven development format: Scenario 1: A customer buys a mobile phone.…”

Section: Automated Acceptance Tests (Aats)mentioning

confidence: 99%

“…In agile development methodologies development of AATs starts much early and these AATs are executed frequently [6]. Empirical studies on AATs have established that AATs facilitate the organization's knowledge transfer by describing business requirements as test cases [7].…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

A systematic reuse process for automated acceptance tests: Construction and elementary evaluation

Irshad¹,

Petersen²

2021

EISEJ

View full text Add to dashboard Cite

Context: Automated acceptance testing validates a product's functionality from the customer's perspective. Text-based automated acceptance tests (AATs) have gained popularity because they link requirements and testing. Objective: To propose and evaluate a cost-effective systematic reuse process for automated acceptance tests. Method: A systematic approach, method engineering, is used to construct a systematic reuse process for automated acceptance tests. The techniques to support searching, assessing, adapting the reusable tests are proposed and evaluated. The constructed process is evaluated using (i) qualitative feedback from software practitioners and (ii) a demonstration of the process in an industry setting. The process was evaluated for three constraints: performance expectancy, effort expectancy, and facilitating conditions. Results: The process consists of eleven activities that support development for reuse, development with reuse, and assessment of the costs and benefits of reuse. During the evaluation, practitioners found the process a useful method to support reuse. In the industrial demonstration, it was noted that the activities in the solution helped in developing an automated acceptance test with reuse faster than creating a test from scratch i.e., searching, assessment and adaptation parts. Conclusion:The process is found to be useful and relevant to the industry during the preliminary investigation.

show abstract

Section: Automated Acceptance Tests (Aats)mentioning

confidence: 99%

Section: Automated Acceptance Tests (Aats)mentioning

confidence: 99%

Section: Automated Acceptance Tests (Aats)mentioning

confidence: 99%

Section: Automated Acceptance Tests (Aats)mentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

A systematic reuse process for automated acceptance tests: Construction and elementary evaluation

Irshad¹,

Petersen²

2021

EISEJ

View full text Add to dashboard Cite

show abstract

Choosing the Right Test Automation Tool

Raulamo-Jurvanen

Mäntylä

Garousi

2017

Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering

View full text Add to dashboard Cite

Test case prioritization for acceptance testing of cyber physical systems: a multi-objective search-based approach

Shin

Nejati

Sabetzadeh

et al. 2018

Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis

View full text Add to dashboard Cite

Acceptance testing validates that a system meets its requirements and determines whether it can be sufficiently trusted and put into operation. For cyber physical systems (CPS), acceptance testing is a hardware-in-the-loop process conducted in a (near-)operational environment. Acceptance testing of a CPS often necessitates that the test cases be prioritized, as there are usually too many scenarios to consider given time constraints. CPS acceptance testing is further complicated by the uncertainty in the environment and the impact of testing on hardware. We propose an automated test case prioritization approach for CPS acceptance testing, accounting for time budget constraints, uncertainty, and hardware damage risks. Our approach is based on multi-objective search, combined with a test case minimization algorithm that eliminates redundant operations from an ordered sequence of test cases. We evaluate our approach on a representative case study from the satellite domain.The results indicate that, compared to test cases that are prioritized manually by satellite engineers, our automated approach more than doubles the number of test cases that fit into a given time frame, while reducing to less than one third the number of operations that entail the risk of damage to key hardware components.

show abstract

Literature Review of Empirical Research Studies within the Domain of Acceptance Testing

Cited by 3 publications

References 30 publications

A systematic reuse process for automated acceptance tests: Construction and elementary evaluation

A systematic reuse process for automated acceptance tests: Construction and elementary evaluation

Choosing the Right Test Automation Tool

Test case prioritization for acceptance testing of cyber physical systems: a multi-objective search-based approach

Contact Info

Product

Resources

About