AI Pulse by Inblix

Topic: quantization

11 articles

Explore our coverage of quantization — 11 curated articles, summaries, and related resources from the Inblix archive.

Related Terms

Inference LoRA (Low-Rank Adaptation) Quantization
Meta drops 30B agentic model Muse Glimmer under Apache 2.0 — runs on a single GPU — Inblix summary
AI News

Meta drops 30B agentic model Muse Glimmer under Apache 2.0 — runs on a single GPU

MarkTechPost · Aug 10, 2026 · 2 min read

Meta just open-sourced Muse Glimmer, a 30-billion-parameter model purpose-built for always-on local agent workflows. It...

Ollama vs LM Studio vs llama.cpp: Which local AI runtime actually fits your workflow? — Inblix summary
Research

Ollama vs LM Studio vs llama.cpp: Which local AI runtime actually fits your workflow?

Machine Learning Mastery · Jul 29, 2026 · 2 min read

If you've spent any time running small language models locally, you've probably noticed the elephant in the room: Ollam...

Your 'Claude' API call probably ran on a different model—and the law has no idea what to do about that — Inblix summary
AI News

Your 'Claude' API call probably ran on a different model—and the law has no idea what to do about that

MarkTechPost · Jul 23, 2026 · 3 min read

Three products, three different answers to the question "what is a model," and zero cases telling us which one a court...

This 27B reasoning model runs on an iPhone and Apple is testing it — Inblix summary
AI News

This 27B reasoning model runs on an iPhone and Apple is testing it

The Decoder · Jul 15, 2026 · 3 min read

PrismML, a startup founded by Caltech researchers, just released Bonsai 27B — a 27-billion-parameter model that runs lo...

Intel CPUs can now run vision models in 3 steps—no GPU needed — Inblix summary
Research

Intel CPUs can now run vision models in 3 steps—no GPU needed

Hugging Face Blog · Oct 15, 2025 · 2 min read

Running AI on your own hardware usually means buying a pricey GPU. But a new workflow from Hugging Face and Intel lets...

OpenAI drops GPT-OSS: a 120B open-source MoE model that fits on a single 80GB GPU — Inblix summary
Research

OpenAI drops GPT-OSS: a 120B open-source MoE model that fits on a single 80GB GPU

Hugging Face Blog · Aug 5, 2025 · 3 min read

OpenAI just did something it rarely does: it open-sourced a family of models. Meet GPT-OSS, a pair of reasoning-focused...

Intel's AutoRound shrinks LLMs to 2-bit with only 37 minutes of GPU time — Inblix summary
Research

Intel's AutoRound shrinks LLMs to 2-bit with only 37 minutes of GPU time

Hugging Face Blog · Apr 29, 2025 · 2 min read

Here's a number that makes other quantization researchers wince: 2.1x higher relative accuracy at 2-bit precision. That...

Hugging Face and Intel squeeze Llama 3.1 into 4-bit for edge devices with OpenVINO — Inblix summary
Research

Hugging Face and Intel squeeze Llama 3.1 into 4-bit for edge devices with OpenVINO

Hugging Face Blog · Sep 20, 2024 · 2 min read

Running a model like Meta-Llama-3.1-8B on a laptop or edge device is moving from 'technically possible' to genuinely pr...

Llama 8B shrank to 1.58 bits per parameter and still beat a full-size model — Inblix summary
Research

Llama 8B shrank to 1.58 bits per parameter and still beat a full-size model

Hugging Face Blog · Sep 18, 2024 · 2 min read

Microsoft Research’s BitNet architecture promised a world where LLM parameters are just -1, 0, or 1, slashing memory an...

ggml packs PyTorch power into 1MB: here's why devs are switching — Inblix summary
Research

ggml packs PyTorch power into 1MB: here's why devs are switching

Hugging Face Blog · Aug 13, 2024 · 2 min read

The library that quietly powers llama.cpp and Ollama is worth a close look for any developer who's ever winced at a PyT...

Quanto FP8 Quantization Cuts SD3 Memory Use by 33% on a Single GPU — Inblix summary
Research

Quanto FP8 Quantization Cuts SD3 Memory Use by 33% on a Single GPU

Hugging Face Blog · Jul 30, 2024 · 2 min read

Running Stable Diffusion 3 in FP16 eats 18.765 GB of GPU memory. That's a problem for anyone without a datacenter card....