Combinatorial Testing

Kuhn, D. Richard; Bryce, Renée; Duan, Feng; Ghandehari, Laleh Shikh Gholamhossein; Lei, Yu; Kacker, Raghu N.

doi:10.1016/bs.adcom.2015.05.003

Cited by 53 publications

(5 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Specifically, these are used to orient an event on a timeline, specify the duration of an event, and determine the order of an event to other events. There are two main types of temporal constraints, sequencing and real-time (Kuhn et al, 2015 ). Sequencing constraints specify the order in which a sequence of actions or events is allowed to take place.…”

Section: Discussionmentioning

confidence: 99%

Mind the gap: a review of optimisation in mental healthcare service delivery

Noorain¹,

Scaparra²,

Kotiadis³

2022

Health Systems

View full text Add to dashboard Cite

Well-planned care arrangements with effective distribution of available resources have the potential to address inefficiencies in mental health services. We begin by exploring the complexities associated with mental health and describe how these influence service delivery. We then conduct a scoping literature review of studies employing optimisation techniques that address service delivery issues in mental healthcare. Studies are classified based on criteria such as the type of planning decision addressed, the purpose of the study and care setting. We analyse the modelling methodologies used, objectives, constraints and model solutions. We find that the application of optimisation to mental healthcare is in its early stages compared to the rest of healthcare. Commonalities between mental healthcare service provision and other services are discussed, and the future research agenda is outlined. We find that the existing application of optimisation in specific healthcare settings can be transferred to mental healthcare. Also highlighted are opportunities for addressing specific issues faced by mental healthcare services.

show abstract

Section: Discussionmentioning

confidence: 99%

Mind the gap: a review of optimisation in mental healthcare service delivery

Noorain¹,

Scaparra²,

Kotiadis³

2022

Health Systems

View full text Add to dashboard Cite

show abstract

“…[1, p. 26, Sec. 2.4] An example of testing based on input domains is combinatorial testing [12,13], which partitions the input space into groups and tests all n-way combinations of the groups. Block, branch, and data flow coverage are graph coverage criteria.…”

Section: Supplemental: Coverage Metricsmentioning

confidence: 99%

“…• General security principles-find security vulnerabilities, such as failure to check credentials, since these often do not cause operational failures (crashes or incorrect output), • Negative tests-make sure that software behaves reasonably for invalid inputs and that it does not do what it should not do, for instance ensure that a user cannot perform operations for which they are not authorized [11,Sec. 8.B], • Combinatorial testing-find errors occurring when handling certain n-tuples of kinds of input [12,13], and • Denial of service and overload-make sure software is resilient.…”

Section: Supplemental: Sources Of Test Casesmentioning

confidence: 99%

Guidelines on minimum standards for developer verification of software

Black¹,

Guttman²,

Okun³

2021

View full text Add to dashboard Cite

Executive Order (EO) 14028, Improving the Nation's Cybersecurity, 12 May 2021, directs the National Institute of Standards and Technology (NIST) to recommend minimum standards for software testing within 60 days. This document describes eleven recommendations for software verification techniques as well as providing supplemental information about the techniques and references for further information. It recommends the following techniques:• Threat modeling to look for design-level security issues • Automated testing for consistency and to minimize human effort • Static code scanning to look for top bugs • Heuristic tools to look for possible hardcoded secrets • Use of built-in checks and protections • "Black box" test cases • Code-based structural test cases • Historical test cases • Fuzzing • Web app scanners, if applicable • Address included code (libraries, packages, services)The document does not address the totality of software verification, but instead, recommends techniques that are broadly applicable and form the minimum standards.The document was developed by NIST in consultation with the National Security Agency (NSA). Additionally, we received input from numerous outside organizations through papers submitted to a NIST workshop on the Executive Order held in early June 2021, discussion at the workshop, as well as follow up with several of the submitters.

show abstract

“…There are various techniques to build a covering array [3]: algebraic techniques, greedy algorithms, heuristic search, and constraint satisfaction. Greedy algorithms can work onerow-at-a-time, like AETG [4], or horizontally and vertically expanding the solution, like IPOG [5].…”

Section: Introductionmentioning

confidence: 99%

Pairwise Testing Revisited for Structured Data With Constraints

Sartori

Waeselynck

Guiochet

2023

2023 IEEE Conference on Software Testing, Verification and Validation (ICST)

View full text Add to dashboard Cite

Pairwise testing (PT) exercises the interactions of pairs of input parameters. The approach is classically defined for a flat set of parameters, the number of which is fixed. Such a definition does not fit well with applications that process structured data like XML and JSON documents. This paper revisits the PT concepts to accommodate hierarchical data structures. The choices and pairs are created by considering the multiplicity of data instances, their access paths and common ancestors. The revised PT approach is implemented on top of on a recent data generation tool, TAF. TAF mixes random sampling and constraint solving to produce diverse data from XML-based models. Our PT implementation interacts with TAF by inserting pair coverage constraints into the models. It monitors overall coverage progress by XPath queries on the data returned by TAF. The approach is demonstrated for two data models: a 3D scene for an agricultural robot, and a population of taxpayers for a tax management system.

show abstract

Combinatorial Testing

Cited by 53 publications

References 29 publications

Mind the gap: a review of optimisation in mental healthcare service delivery

Mind the gap: a review of optimisation in mental healthcare service delivery

Guidelines on minimum standards for developer verification of software

Pairwise Testing Revisited for Structured Data With Constraints

Contact Info

Product

Resources

About