AI Pulse by Inblix

Topic: parquet

2 articles

Explore our coverage of parquet — 2 curated articles, summaries, and related resources from the Inblix archive.

Hugging Face's 4 PB Parquet problem just got a 100x cheaper fix — Inblix summary
Research

Hugging Face's 4 PB Parquet problem just got a 100x cheaper fix

Hugging Face Blog · Jul 25, 2025 · 2 min read

Hugging Face hosts nearly 21 petabytes of datasets, and over 4 PB of that is Parquet files. That's a massive storage bi...

A single row change in a 2GB Parquet file just cost 230MB—here’s the fix Hugging Face found — Inblix summary
Research

A single row change in a 2GB Parquet file just cost 230MB—here’s the fix Hugging Face found

Hugging Face Blog · Oct 5, 2024 · 2 min read

Most of us assume that tweaking a single row in a massive dataset should be a lightweight operation. Hugging Face engin...