Jumble Java Byte Code to Measure the Effectiveness of Unit Tests

Irvine, Sean A.; Pavlinic, T.; Trigg, Leonard E.; Cleary, John G.; Inglis, Stuart J.; Utting, Mark

doi:10.1109/taic.part.2007.38

Cited by 42 publications

(22 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In order to apply mutation analysis to the policy evaluation engine we selected a set of mutation operators for the Java code considering the mutation operators addressed in the most commonly used object-oriented mutation tools such as Jumble [12], MuJava [13], Judy [14] and JavaMut [15]. We refer to [16] for a comparison of Java based mutation testing tools.…”

Section: B Mutation Testingmentioning

confidence: 99%

Assessment of Access Control Systems Using Mutation Testing

Daoudagh

Lonetti

Marchetti

2015

2015 IEEE/ACM 1st International Workshop on TEchnical and LEgal Aspects of Data pRivacy and SEcurity

View full text Add to dashboard Cite

In modern pervasive applications, it is important to validate access control mechanisms that are usually defined by means of the standard XACML language. Mutation analysis has been applied on access control policies for measuring the adequacy of a test suite. In this paper, we present a testing framework aimed at applying mutation analysis at the level of the Java based policy evaluation engine. A set of Java based mutation operators is selected and applied to the code of the Policy Decision Point (PDP). A first experiment shows the effectiveness of the proposed framework in assessing the fault detection of XACML test suites and confirms the efficacy of the application of codebased mutation operators to the PDP.

show abstract

Section: B Mutation Testingmentioning

confidence: 99%

Assessment of Access Control Systems Using Mutation Testing

Daoudagh

Lonetti

Marchetti

2015

2015 IEEE/ACM 1st International Workshop on TEchnical and LEgal Aspects of Data pRivacy and SEcurity

View full text Add to dashboard Cite

show abstract

“…Mothra [30] and Proteum [31] were developed for Fortran and C, respectively. Jester [32], Jumble [33], MuJava [8,34,35], JavaMut [36] and Response Injection (RI) [37], as well as the tool presented in this paper, are dedicated to the Java language. A comparison of mutation testing tools for Java is presented in Section 3.…”

Section: Related Workmentioning

confidence: 99%

“…Jumble operates directly at a bytecode level to speed up mutation testing, it supports JUnit and it has been deployed in an industrial setting [33]. It was therefore worthy of further investigation.…”

Section: Jumblementioning

confidence: 99%

Judy – a mutation testing tool for Java

Madeyski

Radyk

2010

IET Softw.

View full text Add to dashboard Cite

Popular code coverage measures, such as branch coverage, are indicators of the thoroughness rather than the fault detection capability of test suites. Mutation testing is a fault-based technique that measures the effectiveness of test suites for fault localization. Unfortunately, use of mutation testing in the software industry is rare because generating and running vast numbers of mutants against the test cases is time-consuming and difficult to do without an automated, fast and reliable tool. Our objective is to present an innovative approach to mutation testing that takes advantage of a novel aspect-oriented programming mechanism, called "pointcut and advice", to avoid multiple compilation of mutants and, therefore, to speed up mutation testing. An empirical comparison of the performance of the developed tool, called Judy, with the MuJava mutation testing tool on 24 open-source projects demonstrates the value of the presented approach. The results show that there is a statistically significant (t(23) = −12.28, p < .0005, effect size d = 3.43) difference in the number of mutants generated per second between MuJava (M = 4.15, SD = 1.42) and Judy (M = 52.05, SD = 19.69). Apart from being statistically significant, this effect is considered very large and, therefore, represents a substantive finding. This therefore allows us to estimate the fault detection effectiveness of test suites of much larger systems.

show abstract

“…The name MAJOR is an acronym reflecting that it is a tool for mutation analysis in a Java compiler. In contrast to existing tools such as Jumble [4], MuJava [7], or Javalanche [9], MAJOR is integrated into the Java compiler and does not require a specific mutation analysis framework. Hence, it can be used in any Java-based environment.…”

Section: Introductionmentioning

confidence: 99%

MAJOR: An efficient and extensible tool for mutation analysis in a Java compiler

Just

Schweiggert

Kapfhammer

2011

2011 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011)

114

View full text Add to dashboard Cite

Mutation analysis is an effective, yet often timeconsuming and difficult-to-use method for the evaluation of testing strategies. In response to these and other challenges, this paper presents MAJOR, a fault seeding and mutation analysis tool that is integrated into the Java Standard Edition compiler as a non-invasive enhancement for use in any Javabased development environment. MAJOR reduces the mutant generation time and enables efficient mutation analysis. It has already been successfully applied to large applications with up to 373,000 lines of code and 406,000 mutants. Moreover, MAJOR's domain specific language for specifying and adapting mutation operators also makes it extensible. Due to its ease-ofuse, efficiency, and extensibility, MAJOR is an ideal platform for the study and application of mutation analysis.

show abstract

Jumble Java Byte Code to Measure the Effectiveness of Unit Tests

Abstract: Abstract

Cited by 42 publications

References 6 publications

Assessment of Access Control Systems Using Mutation Testing

Assessment of Access Control Systems Using Mutation Testing

Judy – a mutation testing tool for Java

MAJOR: An efficient and extensible tool for mutation analysis in a Java compiler

Contact Info

Product

Resources

About