Tagged: model-inference

4 articles

Latest

Hugging Face: bitsandbytes wins on ease, GPTQ wins on speed

Why your LLM needs 350GB of VRAM just to load — and how to fix it

China's Moonshot Just Dropped a 2.8T Parameter Model That Trades Compute for Memory

Open video models still can't touch image AI's 'Stable Diffusion moment'