Data-Efficient Reinforcement Learning for Complex Nonlinear Systems

Donge, Vrushabh S.; Lian, Bosen; Lewis, Frank L.; Davoudi, Ali

doi:10.1109/tcyb.2023.3324601

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

2025

Publication Types

Select...

Article3

Book1

Other1

Relationship

Self Cite0

Independent5

Authors

Journals

Cited by 6 publications

References 54 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Physics‐informed reinforcement learning for optimal control of nonlinear systems

Wang,

2024

AIChE Journal

View full text Add to dashboard Cite

This article proposes a model‐free framework to solve the optimal control problem with an infinite‐horizon performance function for nonlinear systems with input constraints. Specifically, two Physics‐Informed Neural Networks (PINNs) that incorporate the knowledge of the Lyapunov stability theorem and the convergence conditions of the policy iteration algorithm are utilized to approximate the value function and control policy, respectively. Then, a Reinforcement Learning (RL) algorithm that does not require any first‐principles or data‐driven models of nonlinear systems is developed to iteratively learn a nearly optimal control policy. Furthermore, we provide a rigorous theoretical analysis showing the conditions that ensure the stability of closed‐loop systems with the control policy learned by RL and guarantee the convergence of the iteration algorithm. Finally, the proposed Physics‐Informed Reinforcement Learning (PIRL) method is applied to a chemical process example to demonstrate its effectiveness.

show abstract