ActionFlow: Equivariant, Accurate, and Efficient Policies with Spatially Symmetric Flow Matching

1TU Darmstadt, 2German Research Center for AI (DFKI), 3Hessian.AI

ActionFlow is a new policy class for Learning from Demonstrations that is efficient, accurate, and fast. ActionFlow integrates spatial symmetry inductive biases through Invariant Point Attention while generating expressive action sequences leveraging Flow Matching in SE(3). We show that ActionFlow can be used to learn policies for a variety of tasks, including bulb screwing or mug hanging.

Abstract

Spatial understanding is a critical aspect of most robotic tasks, particularly when generalization is important. Despite the impressive results of deep generative models in complex manipulation tasks, the absence of a representation that encodes intricate spatial relationships between observations and actions often limits spatial generalization, necessitating large amounts of demonstrations. To tackle this problem, we introduce a novel policy class, ActionFlow. ActionFlow integrates spatial symmetry inductive biases while generating expressive action sequences. On the representation level, ActionFlow introduces an SE(3) Invariant Transformer architecture, which enables informed spatial reasoning based on the relative SE(3) poses between observations and actions. For action generation, ActionFlow leverages Flow Matching, a state-of-the-art deep generative model known for generating high-quality samples with fast inference - an essential property for feedback control. In combination, ActionFlow policies exhibit strong spatial and locality biases and SE(3)-equivariant action generation. Our experiments demonstrate the effectiveness of ActionFlow and its two main components on several simulated and real-world robotic manipulation tasks and confirm that we can obtain equivariant, accurate, and efficient policies with spatially symmetric flow matching.

Video

Bulbscrew Policy Rollouts

Mug Hang Train Configurations Policy Rollouts

Mug Hang Test Configurations Policy Rollouts