Establishing structural testing criteria for Java bytecode

Vincenzi, Auri Marcelo Rizzo; Delamaro, Márcio Eduardo; Maldonado, José Carlos; Wong, W. Eric

doi:10.1002/spe.726

Cited by 29 publications

(66 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Notice that nodes 2-6 have edges to nodes 8, 9, and 11; we use only one edge from the try box for improving the legibility of the graph. The exception handling notation we use is adapted from the notations proposed by Sinha and Harrold [13] and Vincenzi et al [14].…”

Section: ¦ ¥mentioning

confidence: 99%

“…For instance, a block that declares a NullPointerException will be executed only when such an exception is thrown. However, in general, there are no constraint indicating in which condition such an exception will be thrown.We classify paths that depend on an exception being thrown as exception-dependent paths (EDPs) [7], as oppose to exception-free paths (EFPs) [14]. According to an analysis performed over a sample of 100 open source projects called SF100 [8] 1 , we discovered that almost one third of the methods have at least one EDP [7].…”

mentioning

confidence: 99%

See 1 more Smart Citation

Analyzing Exceptions in the Context of Test Data Generation Based on Symbolic Execution

Eler

Durelli

Endo

2015

International Conferences on Software Engineering and Knowledge Engineering

View full text Add to dashboard Cite

Abstract-Testing exception scenarios is a challenging task in the context of test data generation based on symbolic execution. In such a context, test data is generated based on constraints explicitly declared in the code. However, constraints required to activate specific exceptions may not be directly declared in the code. In such a case, implicit constraints have to be inferred from exception handling mechanisms. Given that exceptions can be raised in several situations, finding constraints to generate test data to exercise all possible faulty scenarios can significantly increase the number of paths and constraints, which can cause or aggravate path explosion issues. This paper reports on an investigation that we carried out to gauge the cost (i.e., number of path constraints) of four data generation approaches aimed at covering exception dependent paths.Keywords -Exception handling; symbolic execution; test data generation; software analysisAutomatic test data generation is a notorious complex problem. Symbolic execution and constraint solving have been used as an approach to generate test data that achieve high control-flow coverage [5,9]. During symbolic execution, program elements are represented as functions of symbolic input values [5,9]. Each path is represented by a path constraint, which is a sequence of constraints that should be satisfied so that the underlying path can be traversed. Constraint solvers are thus used to generate concrete input values (i.e., test data) that satisfy each set of constraints.Often, the constraints required to traverse a path are explicitly declared in the code by means of control-flow statements, such as if and while. However, some constraints are not explicitly declared in the code because they do not stem from conventional control-flow statements. Some of these constraints implicitly derive from exception handling mechanisms such as Java's try-catch-finally blocks. For instance, a block that declares a NullPointerException will be executed only when such an exception is thrown. However, in general, there are no constraint indicating in which condition such an exception will be thrown.We classify paths that depend on an exception being thrown as exception-dependent paths (EDPs) [7], as oppose to exception-free paths (EFPs) [14]. According to an analysis performed over a sample of 100 open source projects called SF100 [8] 1 , we discovered that almost one third of the methods have at least one EDP [7]. Although the number of EDPs of a program is high, and exception handling is an important topic in software development [4], the influence of exception mechanisms to unit test data generation using symbolic execution has not been widely explored [1,3,5].Taking into account the implicit constraints that stem from exception handling mechanisms can significantly increase the number of path constraints. This has the potential to exacerbate a well-known issue faced by symbolic execution approaches: path explosion [1,5,6], which is usually caused by complex loop structures.The c...

show abstract

Section: ¦ ¥mentioning

confidence: 99%

mentioning

confidence: 99%

Analyzing Exceptions in the Context of Test Data Generation Based on Symbolic Execution

Eler

Durelli

Endo

2015

International Conferences on Software Engineering and Knowledge Engineering

View full text Add to dashboard Cite

show abstract

“…Inspired by Harrold and Rothermel's criteria, Vincenzi et al [49] presented a set of testing criteria based on both control flow and data flow for unit (i.e. method) testing.…”

Section: Structural Requirements For Procedural and Oo Programsmentioning

confidence: 99%

Testing of aspect-oriented programs: difficulties and lessons learned based on theoretical and practical experience

et al. 2015

View full text Add to dashboard Cite

Background: Since the first discussions of new challenges posed by aspect-oriented programming (AOP) to software testing, the real difficulties of testing aspect-oriented (AO) programs have not been properly analysed. Firstly, despite the customisation of traditional testing techniques to the AOP context, the literature lacks discussions on how hard it is to apply them to (even ordinary) AO programs based on practical experience. Secondly, and equally important, due to the cautious AOP adoption focused on concern refactoring, test reuse is another relevant issue that has been overlooked so far. This paper deals with these two issues. It discusses the difficulties of testing AO programs from three perspectives: (i) structural-based testing, (ii) fault-based testing and (iii) test set reuse across paradigms. Methods: Perspectives (i) and (ii) are addressed by means of a retrospective of research done by the authors' group. We analyse the impact of using AOP mechanisms on the testability of programs in terms of the underlying test models, the derived test requirements and the coverage of such requirements. The discussion is based on our experience on developing and applying testing approaches and tools to AspectJ programs at both unit and integration levels. Perspective (iii), on the other hand, consists of recent exploratory studies that analyse the effort to adapt test sets for refactored systems and the quality of such test sets in terms of structural coverage. Results: Building test models for AO programs imposes higher complexity when compared to the OO paradigm. Besides this, adapting test suites for OO programs to AO equivalent programs tends to require less effort than doing the other way around, and resulting suites achieve similar quality levels for small-sized aplications. Conclusions: The conclusion is that building test models for AO programs, as well as deriving and covering paradigm-specific test requirements, is not straightforward as it has been for procedural and object-oriented (OO) programs at some extent. Once you have test suites in conformance with programs implemented in both paradigms, the quality of such suited in termos of code coverage may vary depending on the size and characteristics of the applications under testing.

show abstract

“…Outros autores partiram do princípio de que o código fonte dos componentes está disponível e propuseram o uso de téc-nicas de teste baseadas em implementação, como o trabalho de Harrold e Rothermel (1994), por exemplo. Por outro lado, mesmo considerando o encapsulamento dos componentes, Vincenzi et al (2003) propuseram o uso da ferramente JaBUTi (Vincenzi et al, 2006) para realizar o teste estrutural de componentes escritos em Java, uma vez que a ferramenta pode usar o bytecode do componente para gerar os requisitos de teste e avaliar a cobertura estrutural. Tabela 2.1: Abordagens de teste orientado a objetos aplicadas a componentes.…”

Section: Abordagens De Teste De Componentesunclassified

“…Para viabilizar essa estratégia foi proposta a ferramenta FATEsC (Ferramenta de Apoio ao Teste Estrutural de Componentes) (Teixeira et al, 2007b), que é uma extensão da ferramenta JaBUTi (Vincenzi et al, 2006).…”

Section: Metadadosunclassified

Uso da técnica de teste estrutural para o teste e monitoração de serviços

Eler¹

View full text Add to dashboard Cite

AgradecimentosAgradeço a Deus, em primeiro lugar, e a Jesus Cristo, seu filho, porque Dele por Ele e para Ele são todas as coisas (S. Paulo, Romanos 11:36). Agradeço aos meus pais, Rubens e Glória, pela educação que me deram, pelo incentivo e pelo apoio incondicional em todos os momentos. Agradeço a minha irmã Daniela e minha cunhada Juliana pela amizade e companherismo que sempre demonstraram. Agradeço em especial ao meu irmão Danilo, amigo e companheiro de jornada desde pequenos, passando pelo colégio, graduação, mestrado e doutorado. Agradeço especialmente à minha esposa Amanda que esteve ao meu lado em todos os momentos, pacientemente, acompanhando e apoiando meu trabalho tanto aqui quanto no exterior. Agradeço também a minha nova família, Samuel e Jane, meus sogros, e meu cunhado Anderson, pela amizade e incentivo.Quero agradecer especialmente ao Prof. Paulo Cesar Masiero pela confiança em mim depositada e pela forma com que, pacientemente, conduziu esta orientação. Sua ética, profissionalismo, competência e dedicação em tudo o que faz serão sempre lembrados como virtudes a serem exercitadas e buscadas em minha carreira profissional. Agradeço também ao Prof. Márcio Eduardo Delamaro pelas sugestões de melhoria do trabaho ao longo desses anos. Quero também expressar minha gratidão especial à Antonia Bertolino, minha orientadora no período que estive na Itália para o doutorado sanduíche. Ao Prof Rogério Garcia, que foi quem me incentivou a ingressar no mestrado e trilhar este caminho.Aos meus amigos Beltranos, que têm sido companheiros de uma vida toda; aos amigos da Igreja Batista Unida de Martinópolis e da Primeira Igreja Batista de São Carlos; aos novos e antigos amigos e professores do LabES, com os quais tive o prazer de compartilhar este tempo de formação, desde o meu mestrado; aos demais amigos e funcionários do ICMC e da USP de São Carlos, muito obrigado.Quero agradecer especialmente ao André Endo, pelas conversas, discussões e pela parceria na criação do serviço JaBUTiWS.Agradeço támbém especialmente à FAPESP pelo financiamento desta pesquisa.That day, for no particular reason, I decided to go for a little run. So I ran to the end of the road. ResumoA computação orientada a serviços propõe o desenvolvimento de software por meio da composição de serviços com os objetivos de aumentar o reúso de software e facilitar a criação de aplicações dinâmicas, flexíveis e com baixo acoplamento. O uso de serviços no desenvolvimento de software só é possível se os desenvolvedores de aplicações (integradores) confiarem na qualidade dos serviços oferecidos por terceiros. Uma forma de aumentar a confiança sobre serviços adquirido de terceiros é a realização de testes. Entretanto, o teste de serviços é difícil porque os testadores ficam limitados a usar técnicas de teste baseadas em especificação por causa da indisponibilidade do código fonte. Nesse contexto, os testadores não podem usufruir dos benefícios de combiná-las com técnicas baseadas em implementação, como a técnica estrutural, por exemplo. Uma abordagem para ...

show abstract

Establishing structural testing criteria for Java bytecode

Cited by 29 publications

References 20 publications

Analyzing Exceptions in the Context of Test Data Generation Based on Symbolic Execution

Analyzing Exceptions in the Context of Test Data Generation Based on Symbolic Execution

Testing of aspect-oriented programs: difficulties and lessons learned based on theoretical and practical experience

Uso da técnica de teste estrutural para o teste e monitoração de serviços

Contact Info

Product

Resources

About