Geppetto tracks 1035 robot training datasets including Open X-Embodiment, DROID, and AgiBot World, each with structured metadata on trajectory count, hours of demonstration, robot platforms, license, commercial use, access model, and file format. Every dataset connects to the robots it trains and the professions it affects.

DatasetYearCategoryTrajectoriesHoursPlatformsLicenseCommercialAccessFormat
MARS-LVIG2024research-lab——UAV with downward LiDAR, camera, IMU, GNSSnot statedNoopen—
QDGset2024research-lab——6-DoF grasps, simulatednot statedNoopen—
Sim-Grasp-Dataset2024research-lab——synthetic clutter, two-finger grippernot statedNoopen—
TARGO2024research-lab——synthetic plus some real cluttered scenesnot statedNoopen—
ManiWAV bagel-in-the-wild2024research-lab——UMI gripper with contact microphonenot statedNoopen—
Robot Utility Models (RUM) data2024research-lab——Stick V2 with iPhone; deployed on Hello Robot Stretch and xArm 7not stated for data (code MIT)Noopen—
UMI on Legs manipulation trajectories2024research-lab——UMI handheld gripper (deployed on a quadruped with arm)not statedNoopen—
Nymeria and NymeriaPlus2024research-lab——not stated in fetched excerptseparate dataset licence files; code CC BY-NC 4.0Noopen—
H2O / OmniH2O retargeted AMASS for H1 (amass_phc_filtered)2024research-lab——Unitree H1CC BY-NC 4.0 (repo)Noopen—
HARPER2024research-lab——quadruped robot view of humannot statedNoopen—
CORE4D2024research-lab——two humans jointly moving objectsnot statedNoopen—
FORCE2024research-lab——human plus object with force nuancesnot statedNoopen—
Harmony4D2024research-lab——closely interacting humans, multi-view videonot statedNoopen—
LocoVR2024research-lab——two-person trajectories in VR homesnot statedNoopen—
MotionLib (Being-M0)2024research-lab——human body motion with hierarchical textnot statedNoopen—
MotionVerse (Large Motion Model)2024research-lab——human body, unified from 16 datasetsnot statedNoopen—
THOR-MAGNI2024research-lab——indoor human motion with robotscc-by-4.0Yesopen—
Pick-and-Place Human Multimodal Dataset2024research-lab——human pick and placenot statedNoopen—
LLARVA visual trace pretraining data2024research-lab——Open X-Embodiment robotsnot statedNoopen—
TraceVLA visual trace prompting dataset2024research-lab——robot manipulation trajectories; evaluated on WidowX and SimplerEnvnot statedNoopen—
NaVILA dataset2024research-lab——legged robots (VLA with locomotion skills)not statedNoopen—
RT-H language motions2024research-lab——not stated on project pagenot statedNoopen—
Can-Do2024research-lab——embodied planning samplesnot statedNoopen—
IDKB2024research-lab——driving handbooks and test questionsnot statedNoopen—
NatSGD and NatSGLD2024research-lab——speech, gesture and demonstrations for robotnot statedNoopen—
ManipVQA2024research-lab——images with affordance and physical grounding QAnot statedNoopen—
MSQA (Multi-modal Situated QA)2024research-lab——real-world 3D scenesnot statedNoopen—
PhysiCLeAR (Octopi)2024research-lab——GelSight tactile videos with property annotationsnot statedNoopen—
RoboSpatial2024research-lab——real indoor and tabletop 3D scans with egocentric imagesnot statedNoopen—
SpatialVLM spatial VQA data2024research-lab——internet real-world imagesnot statedNoopen—
TLV (Touch-Language-Vision)2024research-lab——tactile images with sentence-level descriptionsnot statedNoopen—
Touch100k2024research-lab——GelSight tactile images with paired vision and textnot statedNoopen—
TVL (Touch-Vision-Language) dataset2024research-lab——handheld 3D printed device with DIGIT sensor and Logitech BRIO webcamnot statedNoopen—
VLA-3D2024research-lab——3D scenes with referential languagenot statedNoopen—
AHA dataset (FailGen)2024research-lab——RLBench simulatornot statedNoopen—
GOAT-Bench2024research-lab——Habitat scenesnot statedNoopen—
HM-EQA2024research-lab——HM3D scenesnot statedNoopen—
HM3D-OVON2024research-lab——HM3DSem scenesMITYesopen—
In-building embodied delivery dataset2024research-lab——simulated buildingnot statedNoopen—
LHPR-VLN2024research-lab——simulated indoor scenesMITYesopen—
NaVid training data2024research-lab——Habitat continuous environmentsnot statedNoopen—
NoisyEQA2024research-lab——EQA environments with noisy queriesnot statedNoopen—
OpenEQA2024research-lab——HM3D and real home and office scansnot statedNoopen—
OpenUAV / TravelUAV2024research-lab——UAV simulation platformnot statedNoopen—
S-EQA2024research-lab——VirtualHome simulatornot statedNoopen—
SafeAgentBench2024research-lab——embodied task planningnot statedNoopen—
SafetyDetect2024research-lab——home scenesnot statedNoopen—
SAT (Spatial Aptitude Training)2024research-lab——ProcTHOR simulated indoor scenesmit (Molmo2-ER mirror tag)Yesopen—
Uni-NaVid training data2024research-lab——simulated navigation across four sub-tasksnot statedNoopen—
DROID language annotations and camera calibration (KarlP/droid)2024research-lab——DROID Franka platformcc-by-4.0 (Hub tag)Yesopen—
RH20T-P2024research-lab——RH20T real-world robot datanot statedNoopen—
AutoTrust2024research-lab——images from public driving setsnot statedNoopen—
CODA-LM2024research-lab——CODA corner-case imagesnot statedNoopen—
doScenes2024research-lab——nuScenesnot statedNoopen—
MAPLM2024research-lab——HD map, lidar BEV, panoramic imagesnot statedNoopen—
MM-AU2024research-lab——ego-view accident videosnot statedNoopen—
NuInstruct2024research-lab——nuScenes multi-view videonot statedNoopen—
OmniDrive2024research-lab——nuScenesnot statedNoopen—
SURDS2024research-lab——nuScenesnot statedNoopen—
WOMD-Reasoning2024research-lab——Waymo Open Motion scenariosnot statedNogated—
CEAR2024research-lab——MIT Mini Cheetah with event camera, RGB-D, IMU, LiDAR, joint encodersnot statedNoopen—
Leg-KILO dataset2024research-lab——Unitree Go1 with LiDAR, IMU, joint encoders, contact sensorsnot statedNoopen—
PFERD (Poses for Equine Research Dataset)2024research-lab——5 horses, 100+ skin markers, 10 cameras, hSMAL modelnot statedNoopen—
TAIL and TAIL-Plus2024research-lab——wheeled and quadruped robots on sandnot statedNoopen—
CoPeD2024research-lab——multiple robotsnot statedNoopen—
GEODE2024research-lab——heterogeneous LiDARs on multiple platformsnot statedNoopen—
MCD (Multi-Campus Dataset)2024research-lab——ATV and handheld rigs with multiple lidarsnot statedNoopen—
SNAIL Radar2024research-lab——4D radar rig on several platformsnot statedNoopen—
VBR (Vision Benchmark in Rome)2024research-lab——handheld and vehicle rigs with RGB, LiDAR, IMU, GPSnot statedNoopen—
DIDLM2024research-lab——infrared, depth cameras, LiDAR, 4D radarnot statedNoopen—
ENWIDE LiDAR Inertial Dataset2024research-lab——LiDAR and IMUnot statedNoopen—
Helvipad2024research-lab——omnidirectional stereo rignot statedNoopen—
Oxford Spires Dataset2024research-lab——perception unit with three cameras, LiDAR, IMUnot statedNoopen—
Autonomous wheelchair road-crossing dataset2024research-lab——autonomous wheelchairnot statedNoopen—
CSE Dataset (Collaborative SLAM in Service Environments)2024research-lab——multi-robot service environmentsnot statedNoopen—
Earth Rover dataset recorded at the ICRA@40 party2024research-lab——FrodoBots Earth Rovernot statedNoopen—
RoboSense2024research-lab——mobile robot with cameras, LiDAR and fisheyenot statedNoopen—
Robot@Home22024research-lab——mobile robot in home environmentscc-by-4.0Yesopen—
Semantic2D2024research-lab——2D lidar on mobile robotnot statedNoopen—
THUD++2024research-lab——real robot platform plus physical simulationnot statedNoopen—
TiROD2024research-lab——tiny mobile robot cameranot statedNoopen—
UMAD2024research-lab——mobile robot patrol imagesnot statedNoopen—
BridgeData V22023real-robot—111.1WidowX 250sMITYesopenhdf5, zarr, mp4
ALOHA — Action Chunking with Transformers2023real-robot——ALOHA bimanual robot, ViperX 300s, WidowX 250sMITYesopenhdf5, lerobot
RoboSet — A Diverse Multi-Task Robot Learning Dataset2023real-robot——Franka PandaCC BY 4.0Yesopenhdf5, lerobot
Open X-Embodiment — Robotic Learning Datasets2023real-robot——Franka Panda, Google RT-2, WidowX 250sApache 2.0Yesopenzarr, tfrecord
PushT — Diffusion Policy Reference Dataset2023synthetic——simulated 2D pusherApache 2.0Yesopenlerobot, parquet
RflyMAD2023research-lab——multicopters, simulated and realnot statedNoopen—
WiSARD2023research-lab——UAV visual and thermalnot statedNoopen—
GRACO2023research-lab——UGV and UAVnot statedNoopen—
I-24 MOTION2023research-lab——276 pole-mounted cameras over 4.2 miles of freewaynot statedNogated—
ScenarioNet2023research-lab——Waymo, nuScenes, nuPlan scenarios in MetaDrivenot statedNoopen—
AIDE2023research-lab——multi-view in-cabin and out-of-cabin camerasnot statedNoopen—
Aurora Multi-Sensor Dataset2023research-lab——Uber ATG vehicles, lidar and cameras, Pittsburghnot statedNoopen—
AVOID2023research-lab——AV incident reportsnot statedNoopen—
Dual Radar2023research-lab——car with two 4D radars, lidar, cameranot statedNoopen—
ECMD2023research-lab——event cameras with multi-sensor suitenot statedNoopen—
HeLiPR2023research-lab——car with heterogeneous lidarsnot statedNoopen—
IDD-AW2023research-lab——RGB and NIR camera pairsnot statedNogated—
Occ3D2023research-lab——Waymo and nuScenesnot statedNoopen—