Using Test Cases as Contract to Ensure Service Compliance Across Releases

Bruno, Marcello; Canfora, Gerardo; Penta, Massimiliano Di; Esposito, Gianpiero; Mazza, Valentina

doi:10.1007/11596141_8

Cited by 39 publications

(29 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Providers do not have a standardized way to notify the consumers about changes and corrections performed in the service. This implies that the consumer cannot decide a strategy to migrate to a new service version and, as a consequence, to perform regression testing (Bruno et al, 2005) 10 ;…”

Section: Service Testingmentioning

confidence: 99%

Model based testing of service oriented applications

Endo¹

View full text Add to dashboard Cite

Section: Service Testingmentioning

confidence: 99%

Model based testing of service oriented applications

Endo¹

View full text Add to dashboard Cite

“…Analysis of white and black box approaches are provided in the paper. In [2], Bruno et al make use of regression testing to ensure that an evolving service maintains the functional and QoS assumptions. The service consistency verification due to evolution is done by executing test suites contained in a XML encoded facet attached to the service.…”

Section: Related Workmentioning

confidence: 99%

Pairwise testing of dynamic composite services

Kattepur

Sen

Baudry

et al. 2011

Proceedings of the 6th International Symposium on Software Engineering for Adaptive and Self-Managing Systems

View full text Add to dashboard Cite

Online services encapsulate enterprises, people, software systems and often operate in poorly understood environments. Using such services in tandem to predictably orchestrate a complex task is one of the principal challenges of serviceoriented computing. A composite service orchestration soliciting multiple atomic services is plagued by a number of sources of variation. For instance, availability of an atomic service and its response time are two important sources of variation. Moreover, the number of possible variations in a composite service increases exponentially with increase in the number of atomic services. Testing such a composite service presents a crucial challenge as its often very expensive to exhaustively examine the variation space. Can we effectively test the dynamic behavior of a composite service using only a subset of these variations? This is the question that intrigues us. In this paper, we first model composite service variability as a feature diagram (FD) that captures all valid configurations of its orchestration. Second, we apply pairwise testing to sample the set of all possible configurations to obtain a concise subset. Finally, we test the composite service for selected pairwise configurations for a variety of QoS metrics such as response time, data quality, and availability. Using two case studies, Car crash crisis management and eHealth management, we demonstrate that pairwise generation effectively samples the full range of QoS variations in a dynamic orchestration. The pairwise sampling technique eliminates over 99% redundancy in configurations, while still calling all atomic services at least once. We rigorously evaluate pairwise testing for the criteria such as: a) ability to sample the extreme QoS metrics of the service b) stable behavior of the extracted configurations c) compact set of configurations that can help evaluate QoS tradeoffs and d) comparison with random sampling.

show abstract

“…Analysis of white and black box approaches are provided in the paper. In [21], Bruno et al make use of regression testing to ensure that an evolving service maintains the functional and QoS assumptions. The service consistency verification due to evolution is done by executing test suites contained in a XML encoded facet attached to the service.…”

Section: Evaluating the Pairwise Sampling Techniquementioning

confidence: 99%

Variability Modeling and QoS Analysis of Web Services Orchestrations

Kattepur

Sen

Baudry

et al. 2010

2010 IEEE International Conference on Web Services

View full text Add to dashboard Cite

Abstract-The ever-growing choice in diverse services is making service orchestration variability an essential aspect of a composite web service. Influence of this variation on the Quality of Service (QoS) of a composite service is critical and the focus of our work. In this paper, we present a methodology to first model orchestration variability using a feature diagram (FD). The FD specifies a product line of orchestrations represented as configurations of invoked/rejected atomic services. Second, due to the potentially large set of configurations we employ combinatorial testing techniques to automatically generate configurations covering all valid pairwise interactions between services. Third, we analyze QoS variation for each configuration using probabilistic models of QoS. Using a crisis management system case study we experimentally show that pairwise generation covers all QoS outliers and eliminates analysis of > 75% of all possible configurations. The QoS analysis of the pairwise configurations reveals unsafe/ineffective configurations, helps determine realistic Service Level Agreements (SLAs), and provides valuable feedback to help remodel an orchestration.

show abstract

Using Test Cases as Contract to Ensure Service Compliance Across Releases

Cited by 39 publications

References 14 publications

Model based testing of service oriented applications

Model based testing of service oriented applications

Pairwise testing of dynamic composite services

Variability Modeling and QoS Analysis of Web Services Orchestrations

Contact Info

Product

Resources

About