2023
DOI: 10.1609/aaai.v37i13.26961
|View full text |Cite
|
Sign up to set email alerts
|

Demystify the Gravity Well in the Optimization Landscape (Student Abstract)

Abstract: We provide both empirical and theoretical insights to demystify the gravity well phenomenon in the optimization landscape. We start from describe the problem setup and theoretical results (an escape time lower bound) of the Softmax Gravity Well (SGW) in the literature. Then we move toward the understanding of a recent observation called ASR gravity well. We provide an explanation of why normal distribution with high variance can lead to suboptimal plateaus from an energy function point of view. We also contrib… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1

Citation Types

0
1
0

Year Published

2023
2023
2024
2024

Publication Types

Select...
3
1

Relationship

0
4

Authors

Journals

citations
Cited by 4 publications
(1 citation statement)
references
References 6 publications
0
1
0
Order By: Relevance
“…However, most existing chaotic systems are traditional chaotic systems that encounter issues such as a small key space and a lack of capability to resist brute force attacks, statistical attacks, and differential attacks. Particularly in light of the developing deep learning landscape [11][12][13], the capacity to analyze complex issues has grown. Therefore, the pursuit of more secure and efficient encryption schemes is an appealing research direction [14].…”
Section: Introductionmentioning
confidence: 99%
“…However, most existing chaotic systems are traditional chaotic systems that encounter issues such as a small key space and a lack of capability to resist brute force attacks, statistical attacks, and differential attacks. Particularly in light of the developing deep learning landscape [11][12][13], the capacity to analyze complex issues has grown. Therefore, the pursuit of more secure and efficient encryption schemes is an appealing research direction [14].…”
Section: Introductionmentioning
confidence: 99%