T-4

Goal: understand the information encoded in the replica solution, and the difference between Replica Symmetry (RS) and Replica Symmetry Breaking (RSB).
Techniques: replica method, variational ansatz, saddle point approximation.

The overlaps, and why they tell us about glassiness

• Order parameter, ergodicity-breaking, states: the ferromagnet. The order parameter for ferromagnets is the magnetization:

  $m=\lim _{h\to 0}\lim _{N\to \infty }{\frac {1}{N}}\sum _{i=1}^{N}{\overline {\langle \sigma _{i}\rangle _{h}}}$

  where $\langle \cdot \rangle _{h}$ is the Boltzmann average in presence of a small magnetic field, and the average over the disorder can be neglected because this quantity is self-averaging. Notice the order of limits: first the thermodynamic limit, and then the limit of zero field. In a finite system, the magnetization vanishes when the field is switched off. If the infinite size limit is taken before, though, the magnetization persists.
  

  
  A non-zero magnetisation is connected to ergodicity breaking, which is a dynamical concept: the system following some equilibrium dynamics (e.g. Langevin) explores only a sub-part of the phase space, which corresponds to the sector of positive/negative magnetization. When ergodicity is broken, the Boltzmann measure clusters into states (labelled by $\alpha$) with weight $\omega _{\alpha }$, meaning that one can re-write the thermal averages $\langle \cdot \rangle$ of any observable $A$ as

  $\langle A\rangle =\sum _{\alpha }\omega _{\alpha }\langle A\rangle _{\alpha },\quad \quad \quad \omega _{\alpha }={\frac {Z_{\alpha }}{Z}},\quad \quad \quad Z_{\alpha }=\int _{{\vec {\sigma }}\in {\text{ state }}\alpha }d{\vec {\sigma }}e^{-\beta E({\vec {\sigma }})}=\langle e^{-\beta E({\vec {\sigma }})}\rangle _{\alpha }$

  In the ferromagnet there are two pure states, $\alpha =\pm 1$, that correspond to positive and negative magnetization.



• Order parameter, ergodicity-breaking, states: the glass. In Lecture 1, we have introduced the Edwards-Anderson order parameter as: $q_{EA}=\lim _{t\to \infty }\lim _{N\to \infty }{\frac {1}{N}}\sum _{i}\sigma _{i}(0)\sigma _{i}(t)$

  This measures the autocorrelation between the configuration of the same spin at $t=0$ and that at infinitely larger time. A non-zero value of $q_{EA}$ is again an indication of ergodicity breaking: if there was not ergodicity breaking, the system would be able to visit dynamically all configurations according to the Boltzmann measure, decorrelating to the initial condition. The fact that $q_{EA}>0$ indicates that the system, even at later times, is constrained to visit configurations that are not too different from the initial ones: this is because it explores only one of the available states! The difference with the ferromagnets is that in mean-field glassy models like the spherical $p$-spin, there are not just two but many different states.
  

  The quantity $q_{EA}$ measures the overlap between configurations in the same state, that one expects to be the same for all states. In a thermodynamics formalism, it can be written as ^[*]

  $q_{EA}=q_{\alpha \alpha }=\lim _{N\to \infty }{\frac {1}{N}}\sum _{i}\langle \sigma _{i}\rangle _{\alpha }\langle \sigma _{i}\rangle _{\alpha }$

  Notice that this non-zero in a spin-glass phase, but it is also different from zero in unfrustrated ferromagnets: in the low-T phase of an Ising model, it equals to $m^{2}$, where $m$ is the magnetization.


• Replica formalism: where is this info encoded? The overlap between configurations in different states is accounted for by the overlap distribution:

  $q_{\alpha \beta }={\frac {1}{N}}\sum _{i}\langle \sigma _{i}\rangle _{\alpha }\langle \sigma _{i}\rangle _{\beta },\quad \quad \quad {P}(q)=\sum _{\alpha ,\beta }\omega _{\alpha }\,\omega _{\beta }\,\delta (q-q_{\alpha \beta }).$

  The disorder average of quantities can be computed within the replica formalism, and one finds:

  ${\overline {P}}(q)=\lim _{n\to 0}{\frac {2}{n(n-1)}}\sum _{a>b}\delta \left(q-q_{ab}^{*}\right),\quad \quad \quad q_{EA}=\max \left\{q_{a\neq b}^{*}\right\}$

  where $q_{ab}^{*}$ are the saddle point values of the overlap matrix. In the Ising case, a low temperature one has $q_{\alpha \alpha }=m^{2}$ and $q_{\alpha \neq \beta }=-m^{2}$, and thus ${\overline {P}}(q)$ has two peaks at $\pm m^{2}$. In spin-glass models, the structure of the distribution can be more complicated.

[*] - Notice that to be precise, in analogy with the magnetization, we should write $q_{EA}=\lim _{\epsilon \to 0}\lim _{N\to \infty }{\frac {1}{N}}\sum _{i}\langle \sigma _{i}^{1}\,\sigma _{i}^{2}\rangle _{\epsilon }$, where ${\vec {\sigma }}^{1},{\vec {\sigma }}^{2}$ are two copies of the system, and the average is with respect to a tilted Boltzmann measure which contains a small coupling $\epsilon$ between them, which plays the same role of the infinitesimal magnetic fields in the ferromagnet. The coupling is so weak that it only forces the configurations to fall in the same pure state, but a part from this it leaves them independent.

Problems

We go back to the spherical $p$-spin model, and complete the calculation of the free energy under different assumptions on the structure of the overlap matrix.

Problem 4.1: the RS (Replica Symmetric) solution

We go back to the saddle point equations for the spherical $p$-spin model derived in the previous problems. Let us consider the simplest possible ansatz for the structure of the matrix Q, that is the Replica Symmetric (RS) ansatz:

$Q={\begin{pmatrix}1&q_{0}&q_{0}\cdots &q_{0}\\q_{0}&1&q_{0}\cdots &q_{0}\\&\cdots &&\\q_{0}&q_{0}&q_{0}\cdots &1\end{pmatrix}}$

Under this assumption, there is a unique saddle point variable, that is $q_{0}$. We denote with $q_{0}^{*}$ its value at the saddle point.

1. RS overlap distribution. Under this assumption, what is the overlap distribution Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \overline{P}(q)} and what is Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_{EA}} ? In which sense the RS ansatz corresponds to assuming the existence of a unique pure state?

2. RS free energy. The saddle point equation for $q_{0}$ when Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle n \to 0 } is

   Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \beta^2 \, p q_0^{p-1}-\frac{q_0}{(1-q_0)^2}=0, }

   which admits always the solution $q_{0}^{*}=0$: why is this called the paramagnetic solution? Show that within this RS assumption, the quenched free energy coincides with the annealed one. Do you have an interpretation for this in terms of replicas?

Problem 4.2: the 1-RSB (Replica Symmetry Broken) calculation

In the previous problem, we have chosen a certain parametrization of the overlap matrix Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle Q} , which corresponds to assuming that typically all the copies of the systems fall into configurations that are at overlap Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_0} with each others, no matter what is the pair of replicas considered. This assumption is however not the good one at low temperature. We now assume a different parametrisation, that corresponds to breaking the symmetry between replicas: in particular, we assume that typically the $n$ replicas fall into configurations that are organized in Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle n/\mu} groups of size Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \mu \leq n } (replicas in the same group are equilibrating in the same state); pairs of replicas in the same group are more strongly correlated and have overlap $q_{1}$, while pairs of replicas belonging to different groups have a smaller overlap Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_0<q_1} . This corresponds to the following block structure for the overlap matrix:

Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle Q=\begin{pmatrix} 1 & q_1 &q_1& q_0 & q_0 \cdots& q_0\\ q_1 & 1 &q_1& q_0 & q_0 \cdots& q_0\\ q_1 & q_1 &1& q_0 & q_0 \cdots& q_0\\ \cdots\\ \cdots\\ \cdots\\ q_0 & q_0 \cdots& q_0&1 & q_1 &q_1\\ q_0 & q_0 \cdots& q_0&q_1 & 1 &q_1\\ q_0 & q_0 \cdots& q_0&q_1 & q_1 &1\\ \end{pmatrix} }

Here we have three parameters: $\mu ,q_{0},q_{1}$ (in the sketch above, Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \mu=3} ). We denote with Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \mu^{*}, q_0^{*}, q_1^{*}} their values at the saddle point.

1. 1-RSB overlap distribution. Show that in this case the overlap distribution is

   ${\overline {P}}(q)=\mu ^{*}\delta (q-q_{0}^{*})+(1-\mu ^{*})\delta (q-q_{1}^{*})$

   What is Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_{EA}} ? In which sense the parameter Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \mu} when Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle n \to 0} can be interpreted as a probability weight?

2. 1-RSB free energy and saddle point equations. Under the 1RSB assumption, the expression for the free energy is:

   Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f_{1RSB}= - \frac{1}{2 \beta} \left[ \frac{\beta^2}{2} \left(1+ (m-1)q_1^p - m q_0^p \right)+ \frac{m-1}{m} \log (1-q_1)+ \frac{1}{m} \log [m(q_1-q_0) + 1-q_1]+ \frac{q_0}{m(q_1-q_0)+ 1-q_1} \right] }

   Under which limit this reduces to the replica symmetric expression? Compute the saddle point equations with respect to the parameter Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_0, q_1 } and Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle m } . Check that Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_0=0} is again a valid solution of these equations, and that for Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_0=0} the remaining equations reduce to:

   Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle (m-1) \left[ \frac{\beta^2}{q}p q_1^{p-1}-\frac{1}{m}\frac{1}{1-q_1}+ \frac{1}{m}\frac{1}{1+ (m-1)q_1} \right]=0, \quad \quad \frac{\beta^2}{2} q_1^p + \frac{1}{m^2}\log \left( \frac{1-q_1}{1+ (m-1)q_1}\right)+ \frac{q_1}{m [1+(m-1)q_1]}=0 }

   How does one recover the paramagnetic solution?

3. The "random first-order" transition. One solution to the saddle point equations is Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle m^*= 1 } and Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_0^*= 0=q_1^* } . This is the only good solution one finds at high temperature. However, at a given critical temperature Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle T_c } one finds that the system of equations is still solved by Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle m^*=1 } , but the equation for Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_1 }

   Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \frac{\beta^2}{2} q_1^p + \log \left(1-q_1\right)+ q_1=0 }

   develops a new solution at a Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_{1}^{*} \neq 0 } : try to estimate this temperature numerically by plotting this function for Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p=3} and different values of Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \beta} . When Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle T } decreases below Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle T_c } , one sees that Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle m^*} becomes smaller than one, and Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_{1}^{SP} } increases towards one. What is different and what is similar with respect to the REM?

Replica Symmetry Breaking: the Parisi scheme, glasses, spin glasses

For the spherical Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p} -spin model, the low-T phase is glassy and the description within a 1-RSB ansatz is exact: the equilibrium in the glassy phase is described by three quantities: the typical overlap Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_1^{*} } between configurations belonging to the same state, the typical overlap Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_0^{*} } between configurations belonging to different states, and the probability Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle (1-m^{*}) } that two configurations extracted at equilibrium belong to the same state.

There are models for which the glassy phase is described by a more complicated pattern of the mutual overlaps between states, which is obtained iterating the 1RSB replica scheme to K levels, ending up with a series of overlaps Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_K > q_{K-1} > \cdots >q_0} . The underlying picture of the free-energy landscape is as follows: equilibrium states have self-overlap Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_K = q_{EA}} . They are arranged in clusters such that states inside a cluster have overlap Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_{K-1}} , but such clusters are arranged in other clusters at a higher level, at mutual overlap Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle q_{K-2}} and so on. The intuition that the free-ebnergy landscape in mean-field spin glasses has this hierarchical structure is due to Giorgio Parisi.

The exact solution of the Sherrington-Kirkpatrick model introduced in Lecture 1 is obtained iterating this procedure an infinite number of times (Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle K \to \infty } ), as understood by Parisi [1]. In this limit, the overlap distribution becomes a continuous distribution.

Check out: key concepts

Order parameters, ergodicity breaking, pure states, overlaps, overlap distribution, replica-symmetric ansatz, replica symmetry breaking.

To know more

• Castellani, Cavagna. Spin-Glass Theory for Pedestrians [2]
• Parisi. Order parameter for spin-glasses [2]
• Zamponi. Mean field theory of spin glasses [3]