Dynamical Systems

Entropy Production in Non-Equilibrium Neural Networks featured image

Artificial Intelligence Associative Memories Attention +16

Entropy Production in Non-Equilibrium Neural Networks

Only driven things remember forward: an exercise in cybernetics

Matthias Bal

• February 2, 2026 • 14 min read

Attention as Energy Minimization: Visualizing Energy Landscapes featured image

Artificial Intelligence Associative Memories Attention +5

Attention as Energy Minimization: Visualizing Energy Landscapes

Can we swap softmax attention for energy-based attention?

Matthias Bal

• March 17, 2021 • 19 min read