Restricted Boltzmann Machine

Transformer Attention as an Implicit Mixture of Effective Energy-Based Models featured image
Artificial Intelligence Associative Memories Attention +7

Transformer Attention as an Implicit Mixture of Effective Energy-Based Models

Where does the energy function behind Transformers' attention mechanism come from?

avatar
Matthias Bal
•
Read more