Solving the initial value problem of ordinary differential equations by Lie group based neural network method

Abstract

To combine a feedforward neural network (FNN) and Lie group (symmetry) theory of differential equations (DEs), an alternative artificial NN approach is proposed to solve the initial value problems (IVPs) of ordinary DEs (ODEs). Introducing the Lie group expressions of the solution, the trial solution of ODEs is split into two parts. The first part is a solution of other ODEs with initial values of original IVP. This is easily solved using the Lie group and known symbolic or numerical methods without any network parameters (weights and biases). The second part consists of an FNN with adjustable parameters. This is trained using the error back propagation method by minimizing an error (loss) function and updating the parameters. The method significantly reduces the number of the trainable parameters and can more quickly and accurately learn the real solution, compared to the existing similar methods. The numerical method is applied to several cases, including physical oscillation problems. The results have been graphically represented, and some conclusions have been made.

Separation of Variables Method in Solving Partial Differential Equations and Investigating the Relationship between Gravitational Field Tensor and Energy-Momentum Tensor in Einstein's Theory of Gravity

“…The process involves separating the variables in the PDE, calculating the partial derivatives of the function (u(x, t)) with respect to (t) and (x), and then substituting the results back into the PDE. By separating the variables, the PDE is transformed into two Ordinary Differential Equations (ODEs) that can be solved more easily [15]. The general solution typically involves several constants that depend on the initial and boundary conditions of the problem being solved.…”

Modeling of Mexican Hat Wavelet Neural Network with L-BFGS Algorithm for Simulating the Recycling Procedure of Waste Plastic in Ocean

“…However, some researchers have developed different ODE and PDE solvers for DE with specific properties. For instance, Lie symmetry differential equations [15], fractional differential equations [16], fuzzy differential equations [17], and singularly perturbed differential equations [18]. In another approach, symplectic artificial neural network model using curriculum learning has been investigated by Sahoo and Chakraverty [19].…”

Study of Burgers–Huxley Equation Using Neural Network Method

“…The complexities inherent in the integration of the second component, as elucidated by Equation ( 6), necessitates a sophisticated approach to computation. To tackle this daunting challenge head-on, as elaborated in the reference [29] of our previous work, the functional form of the neural network is utilized to simplify this part and ensure the accuracy of our results.…”