Product
Weight Normalization decouples direction from length, speeding training
OpenAI Blog · Jul 21, 2026 · 2 min read
A new method called weight normalization is taking a cleverly simple swing at a stubborn problem in deep learning: how...
Topic: optimization
4 articles
Explore our coverage of optimization — 4 curated articles, summaries, and related resources from the Inblix archive.
Product
80 CPUs, 10 minutes: Evolution beats backprop for AI training
OpenAI Blog · Jul 20, 2026 · 3 min read
A quiet upheaval is underway in how we train artificial intelligence, and it leans on an idea most researchers had writ...
Product
Reptile: OpenAI's meta-learning algo skips the heavy math
OpenAI Blog · Jul 20, 2026 · 2 min read
OpenAI just dropped Reptile, a meta-learning algorithm that does something almost cheeky: it ditches the calculus-heavy...
Research
Hugging Face squeezes 52% faster LLM inference by guessing when a draft model is wrong
Hugging Face Blog · Oct 8, 2024 · 2 min read
The whole premise of speculative decoding is clever but wasteful. You let a tiny, fast draft model spit out a bunch of...