Adoption of Software Testing in Internet of Things

Cortés, Mariela I.; Saraiva, Raphael; Souza, Marcia; Mello, Patrícia Alencar Silva; Soares, Pamella

doi:10.1145/3356317.3356326

Cited by 11 publications

(4 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Existing gaps are partially attributed to a mismatched focus between industry and academia [17]. Falling in line with others that identified the need for joined work between academia and industry to enable new testing approaches in real environments [16].…”

Section: Testing Embedded Systems: Challenges and Requirementsmentioning

confidence: 92%

See 1 more Smart Citation

PHiLIP on the HiL: Automated Multi-platform OS Testing with External Reference Devices

Weiss,

Rottleuthner,

Schmidt

et al. 2021

Preprint

View full text Add to dashboard Cite

Developing an operating system (OS) for low-end embedded devices requires continuous adaptation to new hardware architectures and components, while serviceability of features needs to be assured for each individual platform under tight resource constraints. It is challenging to design a versatile and accurate heterogeneous test environment that is agile enough to cover a continuous evolution of the code base and platforms. This mission is even more challenging when organized in an agile open-source community process with many contributors such as for the RIOT OS. Hardware in the Loop (HiL) testing and Continuous Integration (CI) are automatable approaches to verify functionality, prevent regressions, and improve the overall quality at development speed in large community projects.In this paper, we present PHiLIP (Primitive Hardware in the Loop Integration Product), an open-source external reference device together with tools that validate the system software while it controls hardware and interprets physical signals. Instead of focusing on a specific test setting, PHiLIP takes the approach of a tool-assisted agile HiL test process, designed for continuous evolution and deployment cycles. We explain its design, describe how it supports HiL tests, evaluate performance metrics, and report on practical experiences of employing PHiLIP in an automated CI test infrastructure. Our initial deployment comprises 22 unique platforms, each of which executes 98 peripheral tests every night. PHiLIP allows for easy extension of low-cost, adaptive testing infrastructures but serves testing techniques and tools to a much wider range of applications. CCS Concepts: • Hardware → Hardware test; • Software and its engineering → Software testing and debugging; Operating systems; • Computer systems organization → Embedded systems.

show abstract

Section: Testing Embedded Systems: Challenges and Requirementsmentioning

confidence: 92%

“…The low quality of IoT system tests indicates that existing testing approaches still face difficulties overcoming these domain-specific challenges [16]. Existing gaps are partially attributed to a mismatched focus between industry and academia [17].…”

Section: Testing Embedded Systems: Challenges and Requirementsmentioning

confidence: 99%

PHiLIP on the HiL: Automated Multi-platform OS Testing with External Reference Devices

Weiss,

Rottleuthner,

Schmidt

et al. 2021

Preprint

View full text Add to dashboard Cite

show abstract

“…In 2019, Cortes et al conducted a mapping study on software testing methods used for IoT systems [15]. The study categorizes and analyses publications discussing general testing approaches used in IoT systems.…”

Section: Motivation and Related Workmentioning

confidence: 99%

“…Two of the analyzed papers were also literature reviews relevant to the scope of this paper: a literature review dedicated to testing methods for embedded systems [23] and a study summarizing general testing methods for the IoT filed [16].…”

Section: Rq4: Topics and Subproblems Being Addressedmentioning

confidence: 99%

Interoperability and Integration Testing Methods for IoT Systems: a Systematic Mapping Study

Bureš¹,

Klima²,

Rechtberger³

et al. 2020

Preprint

View full text Add to dashboard Cite

The recent active development of Internet of Things (IoT) solutions in various domains has led to an increased demand for security, safety, and reliability of these systems. Security and data privacy are currently the most frequently discussed topics; however, other reliability aspects also need to be focused on to maintain smooth and safe operation of IoT systems. Until now, there has been no systematic mapping study dedicated to the topic of interoperability and integration testing of IoT systems specifically; therefore, we present such an overview in this study. We analyze 803 papers from four major primary databases and perform detailed assessment and quality check to find 115 relevant papers. In addition, recently published testing techniques and approaches are analyzed and classified; the challenges and limitations in the field are also identified and discussed. Research trends related to publication time, active researchers, and publication media are presented in this study. The results suggest that studies mainly focus only on general testing methods, which can be applied to integration and interoperability testing of IoT systems; thus, there are research opportunities to develop additional testing methods focused specifically on IoT systems, so that they are more effective in the IoT context.

show abstract

Interoperability and Integration Testing Methods for IoT Systems: A Systematic Mapping Study

Bureš

Klima

Rechtberger

et al. 2020

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Adoption of Software Testing in Internet of Things

Cited by 11 publications

References 12 publications

PHiLIP on the HiL: Automated Multi-platform OS Testing with External Reference Devices

PHiLIP on the HiL: Automated Multi-platform OS Testing with External Reference Devices

Interoperability and Integration Testing Methods for IoT Systems: a Systematic Mapping Study

Interoperability and Integration Testing Methods for IoT Systems: A Systematic Mapping Study

Contact Info

Product

Resources

About