Tagged: vLLM

7 articles

Latest

Hugging Face transformers now runs at native vLLM speed with zero porting

Stand Up a Private vLLM Server on HF Jobs With a Single Docker-Style Command

Four V1 bugs nearly sank our RL training — here’s what vLLM 0.18.1 actually fixed

vLLM's long prompts silently choke fast token generation for everyone

TRL v0.18.0 lets you train and serve LLMs on the same GPUs, cutting idle time

Transformers hits 300+ architectures as Hugging Face pushes for total AI ecosystem dominance

How TNG Broke vLLM’s FIFO Queue to Stop Power Users from Hogging GPUs