Ranking programs using black box testing

We present PrologCheck, an automatic tool for propertybased testing of programs in the logic programming language Prolog with randomised test data generation. The tool is inspired by the well known QuickCheck, originally designed for the functional programming language Haskell. It includes features that deal with specific characteristics of Prolog such as its relational nature (as opposed to Haskell) and the absence of a strong type discipline. PrologCheck expressiveness stems from describing properties as Prolog goals. It enables the definition of custom test data generators for random testing tailored for the property to be tested. Further, it allows the use of a predicate specification language that supports types, modes and constraints on the number of successful computations. We evaluate our tool on a number of examples and apply it successfully to debug a Prolog library for AVL search trees.

show abstract

“…?-prologcheck ( m: prop ( wrong_dr )). A counterexample is found and shrunk to the presented counter-example [0,6].…”

Section: List Reversementioning

confidence: 99%

“…Feedback is given to the user about their evaluation. Property-based testing applications include black-box, white-box, unit, integration and system testing [3] [6,7].…”

Section: Introductionmentioning

confidence: 99%

PrologCheck – Property-Based Testing in Prolog

Amaral

Florido

Costa

2014

Functional and Logic Programming

View full text Add to dashboard Cite

show abstract

Automatic Grading of Programming Exercises using Property-Based Testing

Earle

Fredlund

Hughes

2016

Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education

View full text Add to dashboard Cite

Teaching Property-Based Testing

Azevedo

Malheiro

2020

Software Engineering for Agile Application Development

View full text Add to dashboard Cite

Given the large dimensions of software algorithms, the creation of unit test sets is both very difficult to use as an assurance of software quality and also very resource consuming. Some of the industry has already focused on this issue, and several methods are being used to cope with traditional testing shortcomings. Property-based testing has been one of these techniques and has been gaining traction, mainly due to the shift to functional programming techniques which can be seen in most of the popular languages and platforms. To give students tools that can increase the quality of their production as software developers, property-based testing has been taught in the Advanced Programming Techniques course of the master's program in Informatics Engineering of the Instituto Superior de Engenharia do Porto.

show abstract

Ranking programs using black box testing

Cited by 3 publications

References 17 publications

PrologCheck – Property-Based Testing in Prolog

PrologCheck – Property-Based Testing in Prolog

Automatic Grading of Programming Exercises using Property-Based Testing

Teaching Property-Based Testing

Contact Info

Product

Resources

About