Linear Attention

Looking at the Performer from a Hopfield point of view

Blog post which analyzes the the Performer paper from a Hopfield point of view. Published as blog post at ICLR 2022.