BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Memento EPFL//
BEGIN:VEVENT
SUMMARY:Two mathematical perspectives on transformers
DTSTART:20240223T131500
DTEND:20240223T141500
DTSTAMP:20260408T122006Z
UID:8f509efde16e887e27cbecd360d15d4a2320d14861f2c595096e29ef
CATEGORIES:Conferences - Seminars
DESCRIPTION:Cyril Letrouit (CNRS & U. Paris-Saclay)\nI will present joint
  works with Borjan Geshkovski Yury Polyanskiy and Philippe Rigollet in whi
 ch we use tools from ODEs and PDEs to study an interacting particle system
  arising in Transformers through a mechanism called ``self-attention”. W
 e demonstrate the formation of clusters of particles as time goes to infin
 ity. I will also report on a joint work with Andrei Agrachev in which we u
 se tools from geometric control theory to understand universal approximati
 on properties of these particle systems.
LOCATION:GA 3 21 https://plan.epfl.ch/?room==GA%203%2021
STATUS:CONFIRMED
END:VEVENT
END:VCALENDAR