Tagged: on-device-inference

6 articles

Latest

Apple's Core ML runs Stable Diffusion in 18s on M1 Max — here's the catch

Liquid AI's Pipette Exposes Why Two 350M Models Keep 78% vs 34% Speed on Phones

Perplexity's $0/Token Agent Needs a $4K GPU — and It Actually Works

Cactus Compute's 14MB Needle 2 hits 500 tokens/sec on a Raspberry Pi 5

Liquid AI's 3B vision model hits 228 tokens/s on M5 Max, 11K/s on GPU

NXP's 3-camera robot learns to make tea using a $70 chip