2009
DOI: 10.1016/j.chaos.2008.07.026
|View full text |Cite
|
Sign up to set email alerts
|

Bifurcation structure of equilibria of iterated softmax

Abstract: We present a detailed bifurcation study of iterated renormalization process driven by softmax transformation parametrized by a temperature parameter. For each emerging equilibrium we give exact characterization of stable/unstable manifolds of the linearized dynamics. As the system cools down, new equilibria emerge in a strong structure until finally a complex skeleton of saddle type equilibria surrounding an unstable maximum entropy point, with decision enforcing "one-hot" stable equilibria emerges.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1

Citation Types

0
1
0

Year Published

2019
2019
2021
2021

Publication Types

Select...
2

Relationship

0
2

Authors

Journals

citations
Cited by 2 publications
(1 citation statement)
references
References 12 publications
0
1
0
Order By: Relevance
“…, the probability p(y = k|q (i) ; θ ) that it belongs to each pattern class can be determined as follows [5], [26]:…”
Section: The Ppnn Learning Algorithmmentioning
confidence: 99%
“…, the probability p(y = k|q (i) ; θ ) that it belongs to each pattern class can be determined as follows [5], [26]:…”
Section: The Ppnn Learning Algorithmmentioning
confidence: 99%