Workshop on the Mathematics of Transformers (Aug 2026)

This workshop will focus on the transformer architecture and its underlying (self-)attention mechanisms that gained substantial interest in recent years. Despite their empirical success and groundbreaking advances in natural language processing, computer vision, and scientific computing, the mathematical understanding of transformers is still in its infancy, with many fundamental questions only starting to be posed and addressed. 

After the first edition of the Workshop on the Mathematics of Transformers having taken place at DESY, Hamburg in September 2025, we are excited to host the second edition of this workshop at the Mathematical Institute in Oxford.

We aim to bring together researchers with backgrounds in multi-agent dynamics, optimal transport, and PDEs, to initiate discussions on a variety of aspects connected to the theoretical principles governing transformers. By fostering discussions, we seek to advance this young and rapidly evolving research field, uncovering new mathematical perspectives on transformer models.

Location and Date

The workshop will be hosted at the Mathematical Institute of the University of Oxford (Andrew Wiles Building) in lecture hall L5 on August 21, 2026.

Registration

To register, please fill out the Google form (available after Easter). The registration deadline is July 21, 2026 at 11:59 PM GMT+2, or once the number of available spots is filled.

Confirmed Speakers

TBD

Schedule

The preliminary schedule of the workshop is as follows.

Organizers

José A. Carrillo (University of Oxford)
Daniel Kelly (University of Oxford)
Konstantin Riedl (University of Oxford)
Tim Roith (Technical University of Munich)

We gratefully acknowledge support from G-Research to fund the workshop (KR's G-Research January 2026 grant).