L-1: Difference between revisions

From Disordered Systems Wiki
Jump to navigation Jump to search
Line 52: Line 52:
=== The Solution: Part 1  ===
=== The Solution: Part 1  ===


We provide different solutions of the Random Energy Model (REM). The first one focus on the statistics of the smallest energies among the one associated to the <math>2^N</math> configurations.
We provide different solutions of the Random Energy Model (REM). The first one focus on the statistics of the smallest energies among the ones associated to the <math>M=2^N</math> configurations.
 
Consider the  <math>M=2^N</math>  energies,  <math>M=2^N</math>  nameley independent random variables <math>(x_1,...,x_M)</math> drawn from the Gaussian distribution <math>p(x)</math>.
 
It is useful to  use the following notations:
* <math>P^<(x)=\int_{-\infty}^x dx' p(x')  \sim \frac{\sigma}{\sqrt{2 \pi}|x|}e^{-\frac{x^2}{2 \sigma^2}} \; </math> for  <math>x \to -\infty</math>. It  represents the probability to draw a number smalle than ''x''
* <math> P^>(x)=\int_x^{+\infty} dx' p(x') = 1- P^<(x) </math>. It represents the probabilitty to draw a number larger than ''x''.
 


====  Extreme value stattics for Gaussian variables ====
====  Extreme value stattics for Gaussian variables ====
We consider ''N'' independent random variables <math>(x_1,...,x_N)</math> drawn from the Gaussian distribution <math>p(x)</math>.
We denote
We denote
<center><math>y_N=\min(x_1,...,x_N)</math></center>
<center><math>y_M=\min(x_1,...,x_M)</math></center>
Our goal is to compute the cumulative distribution  <math>Q_M(y)=\text{Prob}(y_M> </math> for large ''M'' in the case of i.i.d .variables.
 
We need to understand two key relations:
* the first relation is exact:
<center><math>Q_M(y) = \left(P^<(y)\right)^M </math> </center>
* the second relation identifies the typical value of the minimum, namely <math> a_M  </math>:
<center><math>P_<(a_M) = 1/M </math> </center>
From the second relation you can get that, in the Gaussian case:
<center><math>a_M =2 \sigma \sqrt{\ln M}-\frac{1}{2}\sqrt{\ln(\lnM)} +O(1) </math> </center>


It is useful to  use the following notations for the cumulative distribution <math>P^<(x)=\int_{-\infty}^x dx' p(x') \sim </math> which represents the probabilitty to draw a number smalle than ''x'' and <math> P^>(x)=\int_x^{+\infty} dx' p(x') = 1- P^<(x) </math> which represents the probabilitty to draw a number larger tthan ''x''.
Close to <math> a_M </math>, where P_<(y) sim 1/M we can use the limt  <math>\lim_{M\to \int} (1+\frac{k}{M})^M =\exp(k)</math> and re-write the first relation:
  <center><math>Q_M(y) \sim \exp\left(-P^>(y)\right)


Let us denote by <math>q_N(y)</math> the distribution of <math>y_N</math> and by <math>Q_N(y)=\text{Prob}(y_N>y)</math> its  cumulative distribution.


* Write <math>Q_N(y)</math> in terms of <math>P^>(y) </math>. (Help: Start to write this relation for <math>N=2,3,...</math>).
This is the fundamental relation of Extreme statistics and we analyze its consequences in the large ''N'' limit where, analogously to the central limit theorem, extremes statistics  display universal features.
* In particular shows that in the  large ''N'' limit  we can write
  <center><math>Q_N(y) \sim \exp\left(-N  P^>(y)\right) </math></center>
Consider now the case <math>\lambda=1</math>
* Write  <math>P^>(x)</math> and <math>P^<(x)</math>. (Remember that <math>x</math>  is a positive number.)
* Write <math>Q_N(y)</math> and <math>q_N(y)</math>.
* Plot <math>q_N(y)</math> for different values of ''N''.




Line 78: Line 85:
<math>P^>( \tilde \tilde y)=\frac 23</math>
<math>P^>( \tilde \tilde y)=\frac 23</math>


* Justify that <math>a_N</math> can be estimated from
<center><math>P^>(a_N)=\frac 1N</math></center>
* Compute  <math>a_N</math> for the exponential distribution and justify that
<center><math>Q_N\left(y=a_N+z\right)</math></center>


In the large ''N'' limit, the distribution  <math>\pi(z)</math> becomes <math>N</math> independent.  
In the large ''N'' limit, the distribution  <math>\pi(z)</math> becomes <math>N</math> independent.  

Revision as of 17:02, 19 November 2023

Spin glass Transition

Experiments

Parlare dei campioni di rame dopati con il magnesio, marino o no: trovare due figure una di suscettivita e una di calore specifico, prova della transizione termodinamica.

Edwards Anderson model

We consider for simplicity the Ising version of this model.

Ising spins takes two values and live on a lattice of sitees . The enregy is writteen as a sum between the nearest neighbours <i,j>:

Edwards and Anderson proposed to study this model for couplings that are i.i.d. random variables with zero mean. We set the coupling distribution indicate the avergage over the couplings called disorder average, with an overline:

It is crucial to assume , otherwise the model displays ferro/antiferro order. We sill discuss two distributions:

  • Gaussian couplings:
  • Coin toss couplings, , selected with probability .

Edwards Anderson order parameter

The SK model

Sherrington and Kirkpatrik considered the fully connected version of the model with Gaussian couplings:

At the inverse temperature , the partion function of the model is

Here is the energy associated to the configuration . This model presents a thermodynamic transition at .

Random energy model

The solution of the SK is difficult. To make progress we first study the radnom energy model (REM) introduced by B. Derrida.

Derivation of the model

The REM neglects the correlations between the configurations and assumes the as iid variables.

  • Show that the energy distribution is

and determine Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \sigma^2}

The Solution: Part 1

We provide different solutions of the Random Energy Model (REM). The first one focus on the statistics of the smallest energies among the ones associated to the Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle M=2^N} configurations.

Consider the Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle M=2^N} energies, Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle M=2^N} nameley independent random variables Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle (x_1,...,x_M)} drawn from the Gaussian distribution Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p(x)} .

It is useful to use the following notations:

  • Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle P^<(x)=\int_{-\infty}^x dx' p(x') \sim \frac{\sigma}{\sqrt{2 \pi}|x|}e^{-\frac{x^2}{2 \sigma^2}} \; } for Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle x \to -\infty} . It represents the probability to draw a number smalle than x
  • Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle P^>(x)=\int_x^{+\infty} dx' p(x') = 1- P^<(x) } . It represents the probabilitty to draw a number larger than x.


Extreme value stattics for Gaussian variables

We denote

Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y_M=\min(x_1,...,x_M)}

Our goal is to compute the cumulative distribution Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle Q_M(y)=\text{Prob}(y_M> } for large M in the case of i.i.d .variables.

We need to understand two key relations:

  • the first relation is exact:
Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle Q_M(y) = \left(P^<(y)\right)^M }
  • the second relation identifies the typical value of the minimum, namely Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle a_M } :
Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle P_<(a_M) = 1/M }

From the second relation you can get that, in the Gaussian case:

Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle a_M =2 \sigma \sqrt{\ln M}-\frac{1}{2}\sqrt{\ln(\lnM)} +O(1) }

Close to Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle a_M } , where P_<(y) sim 1/M we can use the limt Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \lim_{M\to \int} (1+\frac{k}{M})^M =\exp(k)} and re-write the first relation:

Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle Q_M(y) \sim \exp\left(-M P^>(y)\right) We want now to give a natural definition for the number <math>a_N} and Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle b_N} .

Consider Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle P^>(\tilde y)=\frac 12} . If you draw N independent exponential variables, how many variables (in average) will be greater than Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \tilde y} ? Repeat the same exercise with Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \tilde \tilde y} such that Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle P^>( \tilde \tilde y)=\frac 23}


In the large N limit, the distribution Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \pi(z)} becomes Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle N} independent.

  • Show that in this limit its cumulative takes the from
Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \Pi(z)= e^{-e^{-z}}}
Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \Pi(z)= e^{-e^{-z}}}

This is the cumulative distribution of the famous Gumbel distribution.

Let us remark that the precise definition of Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle a_N} and Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle b_N} fix the mean and the variance of the rescaled distribution Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \pi(z)} At variance with the central limit case the mean will be different from zero and the variance different from one.

  • Compute the mean, the variance and the asymptotic behavior of the Gumbel distribution. Draw the distribution. Explain why Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle z=0} is a special point

Generic case: Universality of the Gumbel distribution

The Gumbel distribution is the limit distribution of the maxima of a large class of function. We can say that the Gumbel distribution plays, for extreme statistics, the same role of the Gaussian distribution for the central limit theorem.

By contrast the behavior of Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle a_N} and Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle b_N} as a function of Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle N} strongly depend on the particular distributions Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p(x)} . We discuss here a family of distribution characterized by a fast decay for large Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle x}

Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p(x) \sim c e^{- x^\alpha}}

where Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \alpha>0} The key point is to be able to determine Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle A(x)} such that

Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle P^>(x)=\exp(-A(x))}
  • For Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p(x) = e^{- x}} shows Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle A(x)=x}

Otherwise Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle A(x)} should be determined asymptotically for large Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle x}

  • Show that Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle A(x)=x^\alpha +(\alpha-1) \log x+...}
  • Show that in general and compute Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle a_N} as a function of Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \alpha } for large Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle N } .
  • Show that the maximum distribution take the form
Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \lim _{N\to \infty } Q_N(y)=\left( y= a_N+ \frac{z}{A'(a_N)} \right)}

with Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle z } Gumbel distributed

  • Identify Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle b_N} and discuss its behavior as a function of Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \alpha }

Number

Bibliography

Bibliography

  • Theory of spin glasses, S. F. Edwards and P. W. Anderson, J. Phys. F: Met. Phys. 5 965, 1975