Restricted Boltzmann Machine

Transformer Attention as an Implicit Mixture of Effective Energy-Based Models

Where does the energy function behind Transformers' attention mechanism come from?

Matthias Bal

• December 22, 2020 → Last updated December 30, 2020 • 13 min read

Read more