Tagged: onnx-runtime

7 articles

Latest

BERT Inference on CPUs: AWS c5.metal Benchmarks Reveal Ugly Scaling

Optimum 1.2 brings ONNX Runtime to Transformers pipelines for faster BERT inference

Hugging Face Optimum cuts model training time by 35% with ONNX Runtime

ONNX Runtime cuts whisper-tiny latency up to 74% vs PyTorch

PaddleOCR v6 drops: tiny models hit 86.2% detection, run on CPU

Transformers.js v4 hits npm: WebGPU comes to Node.js with 4x faster models

ONNX Runtime boosts SDXL Turbo image generation by 229% over PyTorch