Tagged: model-efficiency

15 articles

Latest

Skip Pre-training: Cut Encoder-Decoder Costs by Reusing BERT and GPT-2

Megatron-Turing Costs $100M to Replicate. Who Is It Even For?

Mixtral 8x7B puts sparse Mixture of Experts models at the center of open AI

webAI’s 3B model cracks logic tasks at 33 answers/sec, beating a 120B rival on speed

A KL loss tweak lets a single GPU distill a 120B model without melting

OpenAI Slashes GPT-5.6 Luna Price by 80%, Pushing Enterprise AI Costs to Pennies

GPT-5.6's Sol model slashes coding costs by 50% while beating Anthropic's Claude

OlmoEarth v1.1 slashes satellite AI compute by 3x by killing redundant tokens

Writer drops 1.5B reasoning models that beat benchmarks, not your GPU

Google's Gemma 3n Crams 5B-Parameter Brains Into Just 2GB of VRAM

Hugging Face to White House: Open 7B models now beat Claude 3.7 on code

A 32B model just crushed Claude 3.7 Sonnet on Olympiad coding problems

Hugging Face’s static embeddings hit 400x CPU speedup while keeping 85% accuracy

Google's Gemma 2 drops: A 27B open model that beats Llama 3 70B

Matryoshka embeddings shrink AI search costs without killing accuracy