BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//wp-events-plugin.com//6.4.7.2//EN
TZID:Europe/Paris
X-WR-TIMEZONE:Europe/Paris
BEGIN:VEVENT
UID:0-1021@lptms.universite-paris-saclay.fr
DTSTART;TZID=Europe/Paris:20250321T150000
DTEND;TZID=Europe/Paris:20250321T160000
DTSTAMP:20250306T100641Z
URL:http://www.lptms.universite-paris-saclay.fr/seminars/mlp-urbani/
SUMMARY:MLP@P seminars : Pierfrancesco Urbani (IPhT) - LISN\, bat 660 salle
  2014 (2° étage) - 21 Mar 25 15:00
DESCRIPTION:Generalization and overfitting in overparametrized two-layer ne
 ural networks\nPierfrancesco Urbani\nIPhT Saclay\n\nSeminar of the Series 
 MLP@P (Machine Learning Physics @ Plateau)\, joint with LISN and IPhT.\nWh
 ere: LISN\, bat 660 salle 2014 (2° étage)\n\nUnderstanding the generaliz
 ation properties of large\, overparametrized\, neural networks is a centra
 l problem in theoretical machine learning. Several insightful ideas have b
 een proposed in this regard\, among them: the implicit regularization hypo
 thesis\, the possibility of having benign overfitting and the existence of
  feature learning regimes where neural networks learn the latent structure
  of data. However a precise understanding of the emergence/validity of the
 se behaviors cannot be disentangled from the study of the non-linear train
 ing dynamics. We use a technique from statistical physics\, dynamical mean
  field theory\, to study the training dynamics and obtain a rich picture o
 f how generalization and overfitting arise in large overparametrized model
 s. In particular we point out: (i) the emergence of a separation of timesc
 ales controlling feature learning and overfitting\, (ii) a non-monotone be
 havior of the test error and\, correspondingly\, a 'feature unlearning' ph
 ase at large times and (iii) the emergence of algorithmic inductive bias t
 owards small complexity. Joint work with Andrea Montanari.\n
CATEGORIES:MLP@P
LOCATION:LISN\, bat 660 salle 2014 (2° étage)\, 660 Av. des Sciences\,  9
 1190 Gif-sur-Yvette\, France\, Gif-sur-Yvette\, 91190 \, France
X-APPLE-STRUCTURED-LOCATION;VALUE=URI;X-ADDRESS=660 Av. des Sciences\,  911
 90 Gif-sur-Yvette\, France\, Gif-sur-Yvette\, 91190 \, France;X-APPLE-RADI
 US=100;X-TITLE=LISN\, bat 660 salle 2014 (2° étage):geo:0,0
END:VEVENT
BEGIN:VTIMEZONE
TZID:Europe/Paris
X-LIC-LOCATION:Europe/Paris
BEGIN:STANDARD
DTSTART:20241027T020000
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
TZNAME:CET
END:STANDARD
END:VTIMEZONE
END:VCALENDAR