XLSTM

Vision-LSTM -- xLSTM as Generic Vision Backbone

We introduce Vision-LSTM (ViL), an adaption of the xLSTM building blocks to computer vision.

xLSTM -- Extended Long Short-Term Memory

How far do we get in language modeling when scaling LSTMs to billions of parameters, leveraging the latest techniques from modern LLMs, but mitigating known limitations of LSTMs?