Mean-Field Theory

A non-equilibrium statistical mechanics perspective on transformers

Can we model attention as the collective response of a statistical-mechanical system?