Tagged: gptq

3 articles

Latest

Hugging Face adds GPTQ: run 176B models in 4-bit with near-zero accuracy loss

Hugging Face: bitsandbytes wins on ease, GPTQ wins on speed

Llama 2 benchmark: GPTQ lets you run 13B on a single GPU at half the cost