Research
Snowflake’s Ulysses trick trains transformers on million-token contexts across GPUs
Hugging Face Blog · Mar 9, 2026 · 2 min read
The quadratic cost of attention has been the brick wall for training transformers on truly long sequences. You can’t ju...