Mean-Field Theory

Exploring applications of spin-model transformers

A non-equilibrium statistical mechanics perspective on transformers

Can we model attention as the collective response of a statistical-mechanical system?