Tagged: hugging-face-transformers

2 articles

Latest

Transformers 4.49 quietly fixes the mess that made MoE models a deployment nightmare

KV cache quantization squeezes 5GB down to fit longer LLM generations