Dynamical Systems

Nonequilibrium Dynamics in Spin-Model Transformers featured image
Artificial Intelligence Associative Memories Attention +18

Nonequilibrium Dynamics in Spin-Model Transformers

A design space for controllable quench-and-relax architectures

avatar
Matthias Bal
•
Read more
Attention as Energy Minimization: Visualizing Energy Landscapes featured image
Artificial Intelligence Associative Memories Attention +5

Attention as Energy Minimization: Visualizing Energy Landscapes

Can we swap softmax attention for energy-based attention?

avatar
Matthias Bal
•
Read more