Property-based testing of web services by deriving properties from business-rule models

Abstract

Property-based testing is well suited for web-service applications, which was already shown in various case studies. For example, it has been demonstrated that JSON schemas can be used to automatically derive test case generators for web forms. In this work, we present a test case generation approach for a rule engine-driven web-service application. Business-rule models serve us as input for property-based testing. We parse these models to automatically derive generators for sequences of web-service requests together with their required form data. Property-based testing is mostly applied in the context of functional programming. Here, we define our properties in an object-oriented style in C# and its tool FsCheck. We apply our method to the business-rule models of an industrial web-service application in the automotive domain.

Learning and statistical model checking of system response times

“…We evaluated our method for a web-service application from the automotive domain, which was explained in Section 2.1 and we applied it to two major modules of this application, the Test Order Manager and the Test Equipment Manager. Their descriptions are based on a previous work (Aichernig and Schumi 2017b), where we performed classical PBT for these modules and we also presented the functional models in detail. Now, we present a performance evaluation of this system.…”

“…TFMS captures test-bed data, activities, resources, and workflows. A variety of activities can be realized with the system, like test definition, planning, preparation, execution, data management, and analysis (Aichernig and Schumi 2017b).…”

“…Modules can be seen as groups of functionality and they consist of multiple business-rule models which describe what tasks can be performed by a user and how they look like, e. g., what data can be modified. Only one business-rule model can be active at the same time and it determines, which forms can be opened in the current state of the system (Aichernig and Schumi 2017b).…”

“…Hence, this functional model is an EFSM. In our previous work, we have demonstrated how such functional models can be derived from business-rule models of the server implementation (Aichernig and Schumi 2017b). In this article, we assume the functional models as given.…”

QuickREST: Property-based Test Generation of OpenAPI-Described RESTful APIs

“…While JSON Schema is considering only data, OpenAPI also includes the service model. Aichernig et al proposes an approach to use business rules in the form of XML, and from those create extended finite state machines used in PBT tests [31]. This is an automatic approach and has some level of intelligence, by walking the FSM, but requires that the services behaviour is available as such an XML artifact.…”