BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Memento EPFL//
BEGIN:VEVENT
SUMMARY:Mathematics Colloquium
DTSTART:20250925T160000
DTEND:20250925T170000
DTSTAMP:20260408T050523Z
UID:179431e4fa8114f30e4b356512341285c7b8246712e24585a1a5352e
CATEGORIES:Conferences - Seminars
DESCRIPTION:Prof. Philippe Rigollet\, MIT\nTitle : \nA Mathematical Perspe
 ctive on Transformers\n\nAbstract :\nSince their introduction in 2017\, Tr
 ansformers have revolutionized large language models and the broader field
  of deep learning. Central to this success is the groundbreaking self-atte
 ntion mechanism. In this presentation\, I’ll introduce a mathematical fr
 amework that casts this mechanism as a mean-field interacting particle sys
 tem\, revealing a desirable long-time clustering behavior. This perspectiv
 e leads to a trove of fascinating questions with unexpected connections to
  Kuramoto oscillators\, sphere packing\, Wasserstein gradient flows\, and 
 slow dynamics.\n\nPlease register on the following form : https://forms.gl
 e/M5pYkYZ3uMqTLHqS9
LOCATION:CM 1 105 https://plan.epfl.ch/?room==CM%201%20105
STATUS:CONFIRMED
END:VEVENT
END:VCALENDAR