AI Pulse by Inblix

Topic: MI300X

2 articles

Explore our coverage of MI300X — 2 curated articles, summaries, and related resources from the Inblix archive.

Hugging Face Now Lets You Build and Share AMD ROCm Kernels Without the Toolchain Headaches — Inblix summary
Research

Hugging Face Now Lets You Build and Share AMD ROCm Kernels Without the Toolchain Headaches

Hugging Face Blog · Nov 17, 2025 · 2 min read

If you've ever wrestled with CMake, Nix, or ABI issues just to get a custom GPU kernel running in PyTorch, the new work...

Custom CUDA kernels juice Llama 3.1 405B on AMD MI300X, skipping Nvidia lock-in — Inblix summary
Research

Custom CUDA kernels juice Llama 3.1 405B on AMD MI300X, skipping Nvidia lock-in

Hugging Face Blog · Jul 9, 2025 · 2 min read

A billion-plus requests a day. That's the ballpark for ChatGPT, and it underscores why even a 1% latency shave in large...