Near-Equilibrium Dynamics

Entropy Production in Non-Equilibrium Neural Networks featured image

Artificial Intelligence Associative Memories Attention +16

Entropy Production in Non-Equilibrium Neural Networks

Only driven things remember forward: an exercise in cybernetics

Matthias Bal

• February 2, 2026 • 14 min read

Spin-Model Transformers featured image

Artificial Intelligence Associative Memories Attention +12

Spin-Model Transformers

A non-equilibrium statistical mechanics perspective on transformers

Matthias Bal

• June 19, 2022 • 51 min read