Cursor drops MoK megakernel: 2.37x faster MoE training, but it demands a $2M rack
MarkTechPost · Aug 4, 2026 · 3 min read
Cursor just open-sourced the secret sauce behind its Composer models, and it’s not for the hobbyist crowd. The Mixture-...
7 articles
Explore our coverage of distributed-training — 7 curated articles, summaries, and related resources from the Inblix archive.
MarkTechPost · Aug 4, 2026 · 3 min read
Cursor just open-sourced the secret sauce behind its Composer models, and it’s not for the hobbyist crowd. The Mixture-...
MarkTechPost · Jul 30, 2026 · 3 min read
Moonshot AI just open-sourced MoonEP, a communication library that tackles the messiest problem in distributed training...
OpenAI Blog · Jul 19, 2026 · 2 min read
On April 13th, 2019, OpenAI Five didn't just win a game — it dismantled Team OG, the reigning Dota 2 world champions, i...
Hugging Face Blog · May 27, 2026 · 2 min read
Every async RL library has a dirty secret: every single step, the trainer ships the entire model to the inference engin...
Hugging Face Blog · May 11, 2026 · 2 min read
If you're training or running inference on large models, you already know the pain. The step time that should be domina...
Hugging Face Blog · Aug 8, 2025 · 2 min read
Distributed training is about to get a lot less painful. Hugging Face has pulled back the curtain on a new, unified app...
Hugging Face Blog · Sep 13, 2024 · 2 min read
Three and a half years after it started as a simple multi-GPU helper, Hugging Face's Accelerate library just dropped it...