Tagged: hardware-acceleration

4 articles

Latest

Graphcore and Hugging Face team up to slash Transformer latency

Intel and Hugging Face team up to slash Transformer latency to milliseconds

AWS Inferentia2 cuts Hugging Face model latency 4.5x over NVIDIA A10G GPUs

Llama 2 now runs on AWS Inferentia2, and the numbers are surprising