Tagged: efficient-transformers

3 articles

Latest

Longformer Cuts Transformer Memory from Quadratic to Linear for Long Docs

Nyströmformer cuts self-attention to O(n) using landmark sampling

The counterintuitive data trick that makes Mamba hybrids actually reason