Non-Equilibrium Dynamics

Entropy Production in Non-Equilibrium Neural Networks featured image

Artificial Intelligence Associative Memories Attention +13

Entropy Production in Non-Equilibrium Neural Networks

An exercise in cybernetics

Matthias Bal

• 2, 2026 • 7 min read

Spin-Model Transformers featured image

Artificial Intelligence Associative Memories Attention +12

Spin-Model Transformers

A non-equilibrium statistical mechanics perspective on transformers

Matthias Bal

• 19, 2022 • 51 min read