RT-1 Robot Action Dataset

Google RT-1 teleop demos: 87k+ episodes of Everyday Robots tabletop manipulation with language, RLDS format (OXE fractal).

Dataset specifications
Year2022
Episodes87,212
Total hours351
Modalitiesee_pose, language, proprioception, rgb
Task categoriesmanipulation, navigation
LicenseCC-BY-4.0
Accessopen — commercial use permitted
MaintainerGoogle (Robotics at Google / Everyday Robots)

The RT-1 robot action dataset (fractal20220817_data in Open X-Embodiment) contains 87,212 human-teleoperated demonstration episodes of tabletop manipulation with 17 objects, collected on Google's Everyday Robots mobile manipulators. Each step pairs an RGB image and natural-language instruction with a discretized arm+base action, plus success/feasible/undesirable labels, stored in RLDS/TFDS format.