RoboNet

Open multi-robot manipulation dataset: 15M+ frames of tabletop robot-object interaction from 7 robot platforms and 113 camera viewpoints.

Dataset specifications
Year2019
Episodes162,417
Embodimentsfetch, franka_panda, kuka_iiwa, multi, sawyer, widowx
Modalitiesee_pose, force_torque, proprioception, rgb
Task categoriesmanipulation
LicenseCC-BY-4.0
Accessopen — commercial use permitted
MaintainerUC Berkeley (BAIR), Stanford, UPenn GRASP, Google Brain

RoboNet is a large-scale, open dataset for multi-robot learning, containing over 15 million video frames of robot-object interaction collected autonomously across four research labs (UC Berkeley BAIR, Stanford AI Lab, UPenn GRASP, Google Brain Robotics). It aggregates data from 7 robot platforms (Sawyer, Franka Panda, Baxter, Fetch, Google R3, Kuka LBR iiwa, WidowX) recorded from 113 unique camera viewpoints in tabletop settings, with each datapoint storing the camera RGB image, arm pose, force-sensor readings, gripper state and actions. The TFDS release exposes 162,417 trajectories with 5-dimensional action and state vectors.