Blockchain Testing: Challenges, Techniques, and Research Directions

Abstract

Specific testing solutions targeting blockchain-based software are gaining huge attention as blockchain technologies are being increasingly incorporated into enterprise systems. As blockchain-based software enters production systems, it is paramount to follow proper engineering practices, to ensure the required level of testing, and assess the readiness of the developed system. The existing research aims at addressing the testing related issues and challenges of engineering blockchain-based software by providing suitable techniques and tools. However, like any emerging discipline, the best practices and tools for testing blockchain-based systems are not yet sufficiently developed. In this paper, we provide a comprehensive survey on testing of Blockchain-based Applications (BC-Apps). First, we provide a discussion on identified challenges that are associated with BC-App testing. Second, we use a layered approach to discuss the state-of-the-art testing efforts in the area of BC technologies. In particular, we present an overview of the existing testing tools and techniques that provide testing solutions either for different components at various layers of the BC-App stack or across the whole stack. Third, we provide a set of future research directions based on the identified BC testing challenges and gaps in the literature review of existing testing solutions for BC-Apps. Moreover, we reflect on the specificity of BC-based software development procedure, which makes some of the existing tools or techniques inadequate, and call for the definition of standardised testing procedures and techniques for BC-Apps. The aim of our study is to highlight the importance of BC-based software testing and to pave the way for a disciplined, testable, and verifiable BC software development.

Measuring performances and footprint of blockchains with BCTMark: a case study on Ethereum smart contracts energy consumption

“…Lal and Marijan [23] have produced an extensive survey on the literature regarding Blockchain testing. A large part of the research on Blockchains is focused on testing the performances and correctness of those technologies.…”

Are We There Yet? Unraveling the State-of-the-Art Smart Contract Fuzzers

“…Since 2018, fuzzing has been extensively employed in the realm of smart contracts [55]. With the emergence of various smart contract fuzzers [58], it is essential to systematically evaluate their usability and effectiveness. This can help pinpoint the strengths and weaknesses of each technique, guide researchers in selecting the most appropriate technique for their use cases, and inspire the development of new fuzzers based on the gained insights.…”