Hugging Face's LeRobot v0.4 drops: 130-task benchmark support and a plugin system for any robot arm

Hugging Face just shipped LeRobot v0.4.0, and it’s the kind of update that makes you rethink what’s possible with open-source robotics. The headline change is Datasets v3.0, a complete overhaul that ditches scattered JSON files for unified Parquet metadata and introduces a chunked episode format. The team says this unlocks support for massive datasets like the Open X-Embodiment collection, which clocks in at over 400GB. Video streaming is now seamless, and dataset initialization times are way down. They’ve also shipped a CLI tool, lerobot-edit-dataset, that lets you delete episodes, split datasets, and merge multiple records into one without breaking a sweat.

But the real story here is the expanded training ground. LeRobot now officially supports LIBERO, a benchmark with over 130 tasks for Vision-Language-Action policies, and Meta-World, which brings 50-plus diverse manipulation tasks into the fold. Standardizing around gymnasium 1.0.0 and mujoco 3.0.0 gives the simulation layer deterministic seeding and a much sturdier foundation. The team isn’t hiding their ambition—they’re calling this a move toward building the go-to evaluation hub for VLAs.

Under the hood, a new modular pipeline called Processors acts as a universal translator between raw sensor data and what AI models expect. Think of it as an assembly line of steps that normalize, tokenize, and shift data to the GPU. There’s a split here: PolicyProcessorPipeline handles batched tensors for high-performance training, while another path manages the specific action commands your hardware needs. It’s the kind of infrastructure work that’s invisible when it works but was a headache before it existed.

The release also introduces a plugin system for hardware integration. Details are still emerging, but the promise is clear—swapping robot arms without rewriting your entire stack. New VLA models like PI0.5 and GR00T N1.5 are now available, and there’s a Hugging Face Robot Learning Course to onboard newcomers. I’m cautiously optimistic. The tooling gap between proprietary labs and open-source efforts has been wide, and releases like this actually close it. Whether the models hold up in real-world generalization is the test that matters.