1986
DOI: 10.1142/0271
|View full text |Cite
|
Sign up to set email alerts
|

Spin Glass Theory and Beyond

Abstract: This paper first describes, from a high level viewpoint, the main challenges that had to be solved in order to develop a theory of spin glasses in the last fifty years. It then explains how important inference problems, notably those occurring in machine learning, can be formulated as problems in statistical physics of disordered systems. However, the main questions that we face in the analysis of deep networks require to develop a new chapter of spin glass theory, which will address the challenge of structure… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1
1

Citation Types

62
2,778
3
34

Year Published

1995
1995
2019
2019

Publication Types

Select...
6
3

Relationship

0
9

Authors

Journals

citations
Cited by 1,920 publications
(2,925 citation statements)
references
References 14 publications
62
2,778
3
34
Order By: Relevance
“…The bottom sketch shows a rough energy landscape with many energy minima each with a narrow funnel leading to it. magnetic system in which spins are randomly arrayed in a dilute alloy [28][29][30]. The interactions between spins are equally often, at random ferromagnetic (the spins want to point in the same direction) and antiferromagnetic (the spins want to point in opposite directions).…”
Section: Smoothness Roughness and The Topography Of Energy Landscmentioning
confidence: 99%
See 1 more Smart Citation
“…The bottom sketch shows a rough energy landscape with many energy minima each with a narrow funnel leading to it. magnetic system in which spins are randomly arrayed in a dilute alloy [28][29][30]. The interactions between spins are equally often, at random ferromagnetic (the spins want to point in the same direction) and antiferromagnetic (the spins want to point in opposite directions).…”
Section: Smoothness Roughness and The Topography Of Energy Landscmentioning
confidence: 99%
“…Systems with rough energy landscapes also exhibit effective phase transitions [28][29][30]. When the temperature of such a system is lowered, it tends to occupy the lower energy states and at a transition temperature will become trapped in one of them.…”
Section: Smoothness Roughness and The Topography Of Energy Landscmentioning
confidence: 99%
“…This is surprising since they offer a number of potentials to ethologists. Artificial neural networks can show us how small units like nerve cells can exhibit powerful computational abilities when working together (Hopfield & Tank, 1986;Mezard et al, 1987). They also provide understanding about memory and mental representations (McClelland & Rumelhart, 1985), and about mechanisms such as learning (Shanks, 1995) and stimulus control (see e.g.…”
Section: Introductionmentioning
confidence: 99%
“…where we have used (28) along with normalization in the first, (39) in the second, and (39) and (40) in the last step. This proves the assertion of Proposition 3.…”
Section: Proof (Of Proposition 3)mentioning
confidence: 99%