T-2

Goal: deriving the equilibrium phase diagram of the Random Energy Model (REM). Notion such as: freezing transition, entropy crisis, condensation, overlap distribution.
Techniques: saddle point approximation, thermodynamics, probability theory.

Problems

Problem 2: the REM: freezing transition, condensation & glassiness

In this Problem we compute the equilibrium phase diagram of the model, and in particular the quenched free energy density $f(\beta ):=f_{\mathrm{\infty }}(\beta )$ which controls the scaling of the typical value of the partition function, $Z_N(\beta )\sim e^{-N\beta f(\beta )+o(N)}$. We show that the free energy density equals to

$$f(\beta )=\{\begin{array}{ll}& -(T\log 2+\frac{1}{2T})\text{if}T\ge T_f\\ & -\sqrt{2\log 2}\text{if}T<T_f\end{array}{T}_f=\frac{1}{\sqrt{2\log 2}}.$$

At $T_f$ a "freezing transition" occurs: in the whole low-temperature phase, the free-energy is “frozen” at the value that it has at the critical temperature $T=T_f$.

We also characterize the overlap distribution of the model: the overlap between two configurations ${\overrightarrow{\sigma }}^{\alpha },{\overrightarrow{\sigma }}^{\gamma }$ is $q({\overrightarrow{\sigma }}^{\alpha },{\overrightarrow{\sigma }}^{\gamma })=\frac{1}{N}\sum _{i=1}^N{\sigma }_i^{\alpha }{\sigma }_i^{\beta }$, and its distribution is $$P_{N,\beta }(q)=\sum _{\alpha ,\gamma }\frac{e^{-\beta E({\overrightarrow{\sigma }}^{\alpha })}}{Z_N(\beta )}\frac{e^{-\beta E({\overrightarrow{\sigma }}^{\gamma })}}{Z_N(\beta )}\delta (q-q({\overrightarrow{\sigma }}^{\alpha },{\overrightarrow{\sigma }}^{\gamma })).$$

1. The freezing transition. The partition function the REM reads $Z_N(\beta )=\sum _{\alpha =1}^{2^N}{e}^{-\beta E_{\alpha }}=\int dE{{𝒩}}_N(E)e^{-\beta E}.$ Using the behaviour of the typical value of ${{𝒩}}_N$ determined in Problem 1, derive the free energy of the model (hint: perform a saddle point calculation). What is the order of this thermodynamic transition?

2. Fluctuations, and back to average vs typical. Similarly to what we did for the entropy, one can define an annealed free energy $f_{\text{a}}(\beta )$ from $\mathbb{𝔼}(Z_N(\beta ))=e^{-N\beta f_{\text{a}}(\beta )+o(N)}$: show that in the whole low-temperature phase this is smaller than the quenched free energy obtained above. Putting all the results together, justify why the average of the partition function in the low-T phase is "dominated by rare events".

3. Entropy crisis. What happens to the entropy of the model when the critical temperature is reached, and in the low temperature phase? What does this imply for the partition function $Z_N$?

4. Overlap distribution and glassiness. Justify why in the REM the overlap when $N\to \mathrm{\infty }$ typically can take only values zero and one, leading to $$P_{\beta }(q)=\underset{N\to \mathrm{\infty }}{\lim }\mathbb{𝔼}(P_{N,\beta }(q))=\mathbb{𝔼}(I_2)\delta (q-1)+(1-\mathbb{𝔼}(I_2))\delta (q),I_2=\underset{N\to \mathrm{\infty }}{\lim }\frac{\sum _{\alpha }{z}_{\alpha }^2}{{\left(\sum _{\alpha }{z}_{\alpha }\right)}^2},z_{\alpha }=e^{-\beta E_{\alpha }}$$ Why $I_2$ can be interpreted as a probability? Using probability arguments, one can compute $$\mathbb{𝔼}(I_2)=\{\begin{array}{ll}0& \text{if}T>T_f\\ 1-\frac{T}{T_f}& \text{if}T\le T_f\end{array}$$ Interpret this result; in particular, why is this consistent with the entropy crisis?

Comments

1. Glassiness. The low-T phase of the REM is a frozen phase, characterized by the fact that the free energy is temperature independent, and that the typical value of the partition function is very different from the average value. In fact, the low-T phase is also a glass phase, characterized by a non-trivial overlap distribution $P_{\beta }(q)$ and by $q_{EA}=1.$ These quantities can be considered as order parameters of the glass phase.
   
2. Replicas. In the REM, $P_{\beta }(q)$ can be computed explicitly using probability arguments; in more complicated models that require the machinery of replicas to compute the equilibrium properties, $P_{\beta }(q)$ will emerge very naturally from such theory. We go back to this concepts in the next sets of problems, where we will also show that the non-zero order parameter $P_{\beta }(q)$ is associated to a particular form of symmetry breaking, the so called replica symmetry.

Check out: key concepts and exercises

Freezing transition, typical vs average, domination by rare events, entropy crisis, condensation and extreme events, overlap distribution.

After this lecture, you have all the tools to solve Exercise 5 and Exercise 6

To know more

• Derrida. Random-energy model: limit of a family of disordered models [1]
• Derrida and Toulouse. Sample to sample fluctuations in the random energy model [2]