A new paper from DeepMind details an energy-based model capable of learning abstract concepts like “above,” “between,” or “closest” after seeing only five demonstrations. The work directly tackles a persistent headache in AI: how to get machines to form the kind of flexible, generalizable concepts that humans pick up almost effortlessly. Instead of requiring massive datasets, the system internalizes spatial and relational ideas expressed as simple 2D point clouds.
The core innovation lies in using an energy function that mathematically represents a concept as a low-energy state. The model encodes a preference for configurations of entities and an attention mask, outputting a single number that signals whether a concept is satisfied—zero energy means it is, higher values mean it isn’t. This setup, built on a relational network architecture, allows a single network to perform both recognition and generation of instances of a concept, a bidirectional ability the researchers note is reminiscent of mirror neurons in animals.
What makes this particularly interesting is the demonstration of cross-domain transfer without retraining. The model was first taught concepts in a flat, 2D particle world. It then applied that same understanding to guide a 3D physics-based robot, translating a spatial concept from one wholly dissimilar environment to another. This suggests the system is capturing something closer to an abstract rule rather than just surface-level visual patterns.
The model isn’t limited to spatial relations. The training regime covers visual, temporal, and quantitative concepts by optimizing the energy function to assign low values to the states and attention masks found in a handful of demonstration trajectories. By learning to predict the next state and the correct focus of attention, the system is pushed to build a compressed, useful understanding of the task at hand. It’s a step toward giving agents a basic vocabulary of understanding that could serve as building blocks for more complex reasoning and planning down the line.
