Tagged: model-compression

12 articles

Latest

PrismML Shrinks Qwen3.8 27B to 5.9GB, Keeps 98% Accuracy

4-bit GPT-OSS 60B beats its bfloat16 original on 7 of 9 benchmarks

Segmind's open-source SD-Small and SD-Tiny slash Stable Diffusion size by up to 55%

Würstchen hits 42x image compression, slashing AI training costs 16-fold

Liquid AI recovers 97% of accuracy lost to 4-bit quantization

Cactus Compute's 14MB Needle 2 hits 500 tokens/sec on a Raspberry Pi 5

Meta's Ax cuts ML model bloat by 40% using constrained Bayesian search

Falcon-Edge proves 1.58-bit models can match 16-bit rivals—and you can fine-tune them

Intel's AutoRound shrinks LLMs to 2-bit with only 37 minutes of GPU time

NVIDIA’s KVPress toolkit slashes 1M-token Llama 3 memory from 330GB to fit on a single GPU

The world’s smallest VLM is here at 256M parameters, beating 80B models from 17 months ago

Quanto brings flexible PyTorch quantization to Optimum, no tracing required