Partition Function

Transformers Are Secretly Collectives of Spin Systems featured image
Artificial Intelligence Associative Memories Attention +12

Transformers Are Secretly Collectives of Spin Systems

A statistical mechanics perspective on transformers

avatar
Matthias Bal
•
Read more
Transformers from Spin Models: Approximate Free Energy Minimization featured image
Artificial Intelligence Associative Memories Attention +14

Transformers from Spin Models: Approximate Free Energy Minimization

How far can we push the idea of transformers as physical systems?

avatar
Matthias Bal
•
Read more