2021
DOI: 10.48550/arxiv.2109.15048
|View full text |Cite
Preprint
|
Sign up to set email alerts
|

Physical Gradients for Deep Learning

Abstract: Solving inverse problems, such as parameter estimation and optimal control, is a vital part of science. Many experiments repeatedly collect data and employ machine learning algorithms to quickly infer solutions to the associated inverse problems. We find that state-of-the-art training techniques are not well-suited to many problems that involve physical processes since the magnitude and direction of the gradients can vary strongly. We propose a novel hybrid training approach that combines higher-order optimiza… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1

Citation Types

0
1
0

Year Published

2022
2022
2023
2023

Publication Types

Select...
1
1

Relationship

0
2

Authors

Journals

citations
Cited by 2 publications
(1 citation statement)
references
References 24 publications
(34 reference statements)
0
1
0
Order By: Relevance
“…The convergence in the loss metric suggests that we were able to train a overparameterized neural network with 35 samples of data in 60 epochs. We attribute this to the effect of having so-called 'physical' gradients from training through a PDE solver ( [25]). p .…”
Section: Discovery Of Long-lived Nonlinear Plasma Wavepacketsmentioning
confidence: 99%
“…The convergence in the loss metric suggests that we were able to train a overparameterized neural network with 35 samples of data in 60 epochs. We attribute this to the effect of having so-called 'physical' gradients from training through a PDE solver ( [25]). p .…”
Section: Discovery Of Long-lived Nonlinear Plasma Wavepacketsmentioning
confidence: 99%