Cost-Benefit Analysis of Using Dependency Knowledge at Integration Testing

Tahvili, Sahar; Bohlin, Markus; Saadatmand, Mehrdad; Larsson, Stig; Afzal, Wasif; Sundmark, Daniel

doi:10.1007/978-3-319-49094-6_17

Cited by 11 publications

(8 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this article, we quote some relatively simple BPEL workflow applications to test the effectiveness of our proposed method, and the results also show that our improved method is a new way worth trying. In the following exploration, we need to further optimize the algorithm to achieve a trade-off between program detection effectiveness and work efficiency [37]. Secondly, in the quantitative calculation of test case importance, we assume that all activities can be modified or affected; and assume that errors or modifications of an activity will be 100% propagated to all activities that directly and indirectly depend on this activity in the activity dependence graph.…”

Section: Discussionmentioning

confidence: 99%

Test Case Prioritization for Service-Oriented Workflow Applications: A Perspective of Modification Impact Analysis

Wang¹,

Yang²,

Li-hua³

et al. 2020

IEEE Access

View full text Add to dashboard Cite

Test case prioritization is a method to prioritize test cases to improve the testing efficiency of service-oriented workflow applications. Existing prioritization methods prioritize test cases in different application environments according to different metrics (for example, statement coverage, and path coverage). Web services are orchestrated by service-oriented workflow applications to provide different functions, especially in cloud-based mobile systems. As a result, those applications need more precise scheduling to run test cases that can detect faults earlier. Unfortunately, most regression test case prioritization studies in service-oriented workflow applications neglect the use of activity dependency, which is an important factor that affects test case prioritization. By analyzing the dependences between activities, the modification effects of activities on the modified version of service-oriented workflow applications are calculated. On this basis, this paper proposes a new prioritization method for regression test cases. Experimental results show that our method is more effective than the traditional coverage-based technique in testing case priority.

show abstract

Section: Discussionmentioning

confidence: 99%

Test Case Prioritization for Service-Oriented Workflow Applications: A Perspective of Modification Impact Analysis

Wang¹,

Yang²,

Li-hua³

et al. 2020

IEEE Access

View full text Add to dashboard Cite

show abstract

“…It should be noted, however, that automating the testing process itself is in general a costly process and investment. Therefore, a careful cost-benefit analysis and evaluating where and when test automation can pay off, particularly in industrial contexts, is crucial [20], [21]. For instance, if a test is only executed once then perhaps investing to build an automatic test framework may not be worth the effort and cost.…”

Section: Discussion and Future Workmentioning

confidence: 99%

IntegrationDistiller: Automating Integration Analysis and Testing of Object-Oriented Applications

Saadatmand

2019

2019 IEEE International Conference on Industrial Technology (ICIT)

Self Cite

View full text Add to dashboard Cite

Software systems typically consist of various interacting components and units. While these components can be tested and shown to work correctly in isolation, when integrated and start interacting with each other, they may fail to produce the desired behaviors and results. Integration testing plays an important role in revealing issues in interactions among cooperating components. Identifying different interaction scenarios, however, is not a trivial task when performing integration testing. On the other hand, most of the integration testing solutions proposed in the literature are manual which hinders their scalability and applicability when it comes to large industrial systems. In this paper we introduce IntegrationDistiller as an automated solution and tool to identify integration scenarios and generate test cases (in the form of method call sequences) for .NET applications. It works by analyzing the code and automatically identifying class couplings, interacting methods, as well as invocation points. Moreover, the tool also helps and supports testers in identifying timing issues at integration level by automatic code instrumentation at invocation points. The code analysis engine of IntegrationDistiller is built and automated using .NET compiler platform, known as Roslyn. Hence, this work is the first in utilizing Roslyn features for automatic integration analysis and integration test case generation. This work has been done as part of our collaboration with ABB Industrial Automation Control Technologies (IACT) in Västerås-Sweden to address the integration testing challenges of the software part of the ABB Ability™ 800xA distributed control systems.

show abstract

“…Paying no attention to dependencies between test cases may lead to sequential failure of them and thereby waste of testing resources. In [13] we showed that the dependencies among test Derive similarity vectors from the Doc2Vec model Test specifications (*. docx files)…”

Section: Background and Related Workmentioning

confidence: 99%

Cluster-based test scheduling strategies using semantic relationships between test specifications

Tahvili

Hatvani

Felderer

et al. 2018

Proceedings of the 5th International Workshop on Requirements Engineering and Testing

Self Cite

View full text Add to dashboard Cite

One of the challenging issues in improving the test efficiency is that of achieving a balance between testing goals and testing resources. Test execution scheduling is one way of saving time and budget, where a set of test cases are grouped and tested at the same time. To have an optimal test execution schedule, all related information of a test case (e.g. execution time, functionality to be tested, dependency and similarity with other test cases) need to be analyzed. Test scheduling problem becomes more complicated at high-level testing, such as integration testing and especially in manual testing procedure. Test specifications are generally written in natural text by humans and usually contain ambiguity and uncertainty. Therefore, analyzing a test specification demands a strong learning algorithm. In this position paper, we propose a natural language processing-based approach that, given test specifications at the integration level, allows automatic detection of test cases semantic dependencies. The proposed approach utilizes the Doc2Vec algorithm and converts each test case into a vector in n-dimensional space. These vectors are then grouped using the HDBSCAN clustering algorithm into semantic clusters. Finally, a set of cluster-based test scheduling strategies are proposed for execution. The proposed approach has been applied in a subsystem from the railway domain by analyzing an ongoing testing project at Bombardier Transportation AB, Sweden.

show abstract

Cost-Benefit Analysis of Using Dependency Knowledge at Integration Testing

Cited by 11 publications

References 22 publications

Test Case Prioritization for Service-Oriented Workflow Applications: A Perspective of Modification Impact Analysis

Test Case Prioritization for Service-Oriented Workflow Applications: A Perspective of Modification Impact Analysis

IntegrationDistiller: Automating Integration Analysis and Testing of Object-Oriented Applications

Cluster-based test scheduling strategies using semantic relationships between test specifications

Contact Info

Product

Resources

About