Tagged: long-context

7 articles

Latest

Pokee's 28B model holds 10 million tokens on a single GPU — and stays inside your firewall

GLM-5.2 crushes open-source coding leaders, lands within 4 points of Claude Opus 4.8

Snowflake’s Ulysses trick trains transformers on million-token contexts across GPUs

Falcon-H1-Arabic Hits 256K Context, Outperforms Bigger Models with Hybrid Design

Meta drops Llama 4: 10M context window and a bold bet on NoPE layers

NVIDIA’s KVPress toolkit slashes 1M-token Llama 3 memory from 330GB to fit on a single GPU

Falcon Mamba: The First 7B Model to Ditch Attention Without Performance Loss