Design of experiments aided holistic testing of cyber-physical energy systems

Abstract

The complex and often safety-critical nature of cyber-physical energy systems makes validation a key challenge in facilitating the energy transition, especially when it comes to the testing on system level. Reliable and reproducible validation experiments can be guided by the concept of design of experiments, which is, however, so far not fully adopted by researchers. This paper suggests a structured guideline for design of experiments application within the holistic testing procedure suggested by the European ERIGrid project. In this paper, a general workflow as well as a practical example are provided with the aim to give domain experts a basic understanding of design of experiments compliant testing.Index Terms-Design of experiments, cyber-physical energy systems, holistic testing, research infrastructure.

ERIGrid Holistic Test Description for Validating Cyber-Physical Energy Systems

“…The HTD terminology contains several concepts that possess a counterpart in DoE, as discussed in [50]. The mapping between these two conceptual views spans across the different stages of the HTD.…”

“…It provides testing with the statistical groundwork for efficient experimentation, result reproducibility and significance of the outcome against noise in the tested system. A first discussion of the relationship between DoE and holistic testing has been given in [50]. The work presented in this paper partly builds up on this first approach and aims to provide a more general understanding.…”

Applying the Smart Grid Architecture Model for Designing and Validating System-of-Systems in the Power and Energy Domain: A European Perspective

“…Parts of the project serve the research and practical demonstration of cutting-edge hardware and software validation platforms. This work is accompanied by the specification of a formal process that guides the development, documentation, and implementation of complex Smart Grid system-level test cases as outlined in Figure 12 [47,48]. This process is called the Holistic Test Description (HTD) process and spans across different stages of test planning.…”

Education and Training Needs, Methods, and Tools

“…As an example of the application of this tool, a pair of notebooks were given to the students for hands-on experience with a co-simulation environment and Design of Experiments [17]. The example used consisted of a typical Home Energy Management System in which a scenario is built up step by step, to include a house with solar panels, battery and a controller that can connect the house to the grid or discharge the battery.…”