NVIDIA drops 15TB of robot training data and a humanoid brain model at GTC

NVIDIA didn’t just launch faster chips at GTC 2025. For the builders sweating the gap between simulated training and real-world deployment, Jensen Huang’s team dropped a payload of open models and data that changes the physics of development. The marquee item is Cosmos Transfer, a 7-billion-parameter world foundation model designed to kill the domain randomization guesswork. Instead of hoping your robot generalizes from cartoonish sims, developers can now feed it structured inputs—segmentation maps, LiDAR scans, 3D bounding boxes—and get back photorealistic video that rigidly respects spatial alignment. It’s a multi-control system where separate ControlNets for each sensor modality guide the output, allowing you to lock the structure while varying the weather or appearance. Coupled with Omniverse, it’s essentially a controllable synthetic data factory for autonomous vehicles and humanoids.

Then there’s the raw fuel: the Physical AI Dataset. Fifteen terabytes. That’s over 320,000 real-world robotics trajectories and up to a thousand SimReady OpenUSD assets, dumped onto Hugging Face. This isn’t a scraped internet mess. NVIDIA calls it “commercial-grade” and pre-validated, aimed squarely at post-training Cosmos Predict models. It’s the kind of high-quality, diverse kinematic data that usually stays locked inside well-funded labs, and its release signals a clear intent to commoditize the foundation layer of physical AI.

But the real attention-grabber is Isaac GR00T N1, which NVIDIA bills as the first open foundation model for generalized humanoid reasoning. The 2-billion-parameter model, also on Hugging Face, uses a dual-system architecture inspired by human cognition: a slow-thinking Vision-Language Model (System 2) based on NVIDIA-Eagle with SmolLM-1.7B handles reasoning and planning, while a Diffusion Transformer (System 1) translates those plans into continuous motion. The neat trick is that a single set of weights generalizes across different bodies—Fourier GR-1 and 1X Neo—handling bimanual manipulation and multi-step tasks out of the box.

What’s left unsaid is the post-training burden. NVIDIA is clear that these are foundations, not off-the-shelf solutions. The path forward is specialization: take GR00T N1, fine-tune it on your specific embodiment and task with your own data, and hope the dual-system architecture holds up. The 15TB dataset is a generous starting pistol, but it’s also a clever lock-in play for the Omniverse-to-reality pipeline. The real test isn’t these demos—it’s whether a small team can actually use Cosmos Transfer to generate training data that closes the sim-to-real gap without a supercomputer, or whether this remains a rich-kid’s game. The models are open. The compute needed to wield them is not.