Driven by Data or Derived Through Physics? A Review of Hybrid Physics Guided Machine Learning Techniques With Cyber-Physical System (CPS) Focus

Abstract

A multitude of cyber-physical system (CPS) applications, including design, control, diagnosis, prognostics, and a host of other problems, are predicated on the assumption of model availability. There are mainly two approaches to modeling: Physics/Equation based modeling (Model-Based, MB) and Machine Learning (ML). Recently, there is a growing consensus that ML methodologies relying on data need to be coupled with prior scientific knowledge (or physics, MB) for modeling CPS. We refer to the paradigm that combines MB approaches with ML as hybrid learning methods. Hybrid modeling (HB) methods is a growing field within both the ML and scientific communities, and are recognized as an important emerging but nascent area of research. Recently, several works have attempted to merge MB and ML models for the complete exploitation of their combined potential. However, the research literature is scattered and unorganized. So, we make a meticulous and systematic attempt at organizing and standardizing the methods of combining ML and MB models. In addition to that, we outline five metrics for the comprehensive evaluation of hybrid models. Finally, we conclude by shedding some light on the challenges of hybrid models, which we, as a research community, should focus on for harnessing the full potential of hybrid models. An additional feature of this survey is that the hybrid modeling work has been discussed with a focus on modeling cyber-physical systems. INDEX TERMS Cyber-physical systems, deep learning, deep neural networks, hybrid models, model-based, machine learning, physics guided, physics informed, physics prior, theory guided.

VIGOR: A Versatile, Individualized and Generative ORchestrator to Motivate the Movement of the People with Limited Mobility

“…Additionally, deeper and wider deep neural networks (DNNs) often require large sets of labeled data for effective training and suffer from extremely high computational complexity, preventing them from being deployed in real-time systems. As a result, there is a need to incorporate domain knowledge into DNNs [42,43]. As one of the major contributions of this project, domain knowledge will be infused into DNNs through data augmentation, customizing loss function, or embedding knowledge block into NN as an independent module (e.g., dynamicsguided discriminator in the motion choreography module).…”

Short-Term Lateral Behavior Reasoning for Target Vehicles Considering Driver Preview Characteristic

“…In [13], the vehicle maneuvers are classified using artificial neural networks. Although the above mentioned data-driven methods have been widely accepted and can achieve good performance, the physical meaning of the data-driven models is unclear, and their performance is highly dependent on the quality and quantity of training data sets [14]- [16]. In this way, the development of high-accuracy physical model-based methods is also essential for TV lateral behavior reasoning.…”

Physics Guided Deep Learning for Data-Driven Aircraft Fuel Consumption Modeling

“…One of the most common ways to make machine learning models consistent with physical laws is by extending the loss function of the machine learning models to include physical constraints and other physical information [21]. Although the concept of integrating scientific knowledge and machine learning models has only become a popular topic of scientific research in the last few years, there is already extensive literature on this topic [22][23][24]. In the last decade, there has been an increase in utilizing operational flight data, namely Quick Access Recorder (QAR) or Flight Data Recorder (FDR) [25] for many applications such as performance monitoring, anomaly detection, or weather forecasting [26][27][28][29].…”