Mean-Field Theory

A Large-D Closure for Asymmetric Kinetic Vector-Spin Systems featured image

A Large-D Closure for Asymmetric Kinetic Vector-Spin Systems

An exercise in high-dimensional wobbling

avatar
Matthias Bal
•
Nonequilibrium Dynamics in Spin-Model Transformers featured image

Nonequilibrium Dynamics in Spin-Model Transformers

A design space for controllable quench-and-relax architectures

avatar
Matthias Bal
•
Spin-Model Transformers featured image

Spin-Model Transformers

A nonequilibrium statistical mechanics perspective on transformers

avatar
Matthias Bal
•
Deep Implicit Attention: A Mean-Field Theory Perspective on Attention Mechanisms featured image

Deep Implicit Attention: A Mean-Field Theory Perspective on Attention Mechanisms

Can we model attention as the collective response of a statistical-mechanical system?

avatar
Matthias Bal
•