Geppetto tracks 1035 robot training datasets including Open X-Embodiment, DROID, and AgiBot World, each with structured metadata on trajectory count, hours of demonstration, robot platforms, license, commercial use, access model, and file format. Every dataset connects to the robots it trains and the professions it affects.

DatasetYearCategoryTrajectoriesHoursPlatformsLicenseCommercialAccessFormat
RoboFactory dataset2025synthetic——multi-robot ManiSkill scenesmitYesopen—
T2M4LVO2025research-lab——non-human skeletons from Truebones ZooCC BY-NC 4.0Noopen—
hqfang/memorybench2025research-lab——not statedapache-2.0Yesopen—
PHUMA2025research-lab——Unitree G1 configuration on the cardapache-2.0Yesopen—
Arena-GR1-Manipulation-Task2025synthetic——Fourier GR1 in Isaac Lab Arenacc-by-4.0Yesopen—
AgriLiRa4D2025research-lab——multi-sensor UAV over farmlandnot statedNoopen—
AnyVisLoc2025research-lab——low-altitude UAV with 2.5D reference mapsnot statedNoopen—
LASED2025research-lab——aerial orthophotosnot statedNoopen—
MATRIX multi-drone multi-view pedestrian dataset2025research-lab——multiple dronesnot statedNoopen—
MESSI2025research-lab——drone over dense urban areanot statedNoopen—
MMLA2025research-lab——low-altitude drone wildlife videonot statedNoopen—
OrthoLoC2025research-lab——UAV images with orthophoto and DSM referencesnot statedNoopen—
EgoExoBench2025human-video——public ego-exo datasetsnot statedNogated—
GRIP2025research-lab——soft and rigid grippers, IPC simulationnot statedNoopen—
Parcel-Suction-Dataset2025research-lab——synthetic cluttered parcel scenes, suctionnot statedNoopen—
PRISM (GraspMolmo)2025research-lab——synthetic cluttered scenes with task language and graspsnot statedNoopen—
Supermarket-6DoF2025research-lab——physical robot grasp executionsnot statedNoopen—
ActiveUMI2025research-lab——VR controllers shaped as grippers plus head-mounted displaynot statedNoopen—
Generalist AI GEN-0 training corpus (November 2025 snapshot)2025research-lab——"1,000s of data collection devices and robots" (not specified further)not statedNoopen—
MV-UMI2025research-lab——UMI gripper with added third-person cameranot statedNoopen—
RDT2 UMI dataset2025research-lab——redesigned bimanual UMI gripper with HTC Vive trackingnot statedNoopen—
ASAP motions2025research-lab——Unitree G1 29 DoF annealed to 23 DoFMIT (repo)Noopen—
SONIC motion capture training set2025research-lab——human motion capture used for humanoid whole-body controlnot statedNoopen—
TWIST motion dataset2025research-lab——Unitree G1MIT (repo)Noopen—
3HANDS2025research-lab——handovers with supernumerary limbnot statedNoopen—
ClimbingCap (AscendMotion)2025research-lab——human climbers, RGB, LiDAR, IMUnot statedNoopen—
HHI-Assist2025research-lab——human-human physical assistancenot statedNoopen—
HUMOTO2025research-lab——human body with articulated objectsnot statedNoopen—
SD-Dataset2025research-lab——human assembly and disassembly near robotsnot statedNoopen—
YCB-Handovers2025research-lab——human-human handovers, YCB objectsnot statedNoopen—
K2MUSE2025research-lab——lower-limb kinematics, kinetics, ultrasound, EMGnot statedNoopen—
Waymo-3DSkelMo2025research-lab——Waymo lidar pedestriansnot statedNogated—
AerialVG2025research-lab——real aerial imagesnot statedNogated—
AirCopBench2025research-lab——multi-drone, simulator and real datanot statedNoopen—
MM-UAVBench2025research-lab——real UAV data from public datasetsapache-2.0Yesopen—
Open3D-VQA2025research-lab——open-space aerial viewsnot statedNoopen—
UrbanVideo-Bench2025research-lab——manually controlled drones in real and simulated citiesnot statedNoopen—
GuardianFail-36k and UR5-Fail2025research-lab——RLBench simulator, BridgeDataV2 robot, UR5 with three camerasnot statedNoopen—
RoVI-Book2025research-lab——robotic visual instruction images from OXEnot statedNoopen—
MUSON2025research-lab——egocentric views in social scenesnot statedNoopen—
SAIT guide dog robot dataset2025research-lab——guide dog robotsnot statedNoopen—
AmbiK2025research-lab——kitchen task textnot statedNoopen—
CausalVQA2025research-lab——real-world videonot statedNoopen—
J-ORA2025research-lab——robot perception, Japanese dialoguenot statedNoopen—
MVPBench (Minimal Video Pairs)2025research-lab——real and simulated video pairsnot statedNoopen—
RoboDesign1M2025research-lab——robot design documentsnot statedNoopen—
User Questions for Explainable Robotics2025research-lab——household robotsnot statedNoopen—
VeBrain-600k2025research-lab——not stated in abstractnot statedNoopen—
WorldPrediction2025research-lab——procedural human activity videonot statedNoopen—
A4Bench2025research-lab——imagesnot statedNoopen—
CLTP tactile point cloud-language dataset2025research-lab——tactile 3D point cloudsnot statedNoopen—
ERQA2025research-lab——real-world robotics-focused imagesCC-BY-4.0Yesopen—
MoniRefer2025research-lab——roadside lidar and camerasnot statedNoopen—
ObjTac2025research-lab——force-based tactile sensor (Paxini, per TaCo table)not statedNoopen—
RAGNet2025research-lab——images with affordance masks and instructionsnot statedNoopen—
RoboAfford++2025research-lab——images for manipulation and navigation affordancenot statedNoopen—
SURPRISE3D2025research-lab——3D indoor scenesnot statedNoopen—
TUMTraffic-VideoQA2025research-lab——roadside camerasnot statedNoopen—
ViewSpatial-Bench2025research-lab——multi-perspective spatial QAnot statedNoopen—
VTV150K2025research-lab——GelSight Mini, DIGIT, Tac3Dnot statedNoopen—
CityEQA-EC2025research-lab——3D urban simulatornot statedNoopen—
DriveQA2025research-lab——driving-test text and CARLA imagesnot statedNoopen—
EXPRESS-Bench2025research-lab——simulated 3D explorationnot statedNoopen—
HA-VLN 2.0 / HAPS 2.02025research-lab——simulators with multi-human interactionsnot statedNoopen—
HaL-13k (AeroDuo)2025research-lab——paired high and low altitude UAVsnot statedNoopen—
IndoorUAV2025research-lab——simulated UAV in Habitat indoor scenesnot statedNoopen—
OpenFly2025research-lab——Unreal Engine, GTA V, Google Earth, 3D GS renderersapache-2.0Yesopen—
VLN-PE2025research-lab——physically embodied robots in simulationnot statedNoopen—
I-FailSense datasets2025research-lab——simulation and real-world manipulationnot statedNoopen—
TLA dataset2025research-lab——fingertip peg-in-hole assembly with tactilenot statedNoopen—
Box-QAymo2025research-lab——Waymo Opennot statedNoopen—
CARScenes2025research-lab——images from Argoverse 1, Cityscapes, KITTI, nuScenesnot statedNoopen—
DriveAction2025research-lab——production assisted-driving vehiclesnot statedNoopen—
DriveBench2025research-lab——nuScenes-based framesnot statedNoopen—
DriveLMM-o12025research-lab——nuScenes multi-view and lidarnot statedNoopen—
Impromptu VLA2025research-lab——clips from 8 open driving datasetsnot statedNoopen—
LANGTRAJ2025research-lab——driving trajectories with languagenot statedNoopen—
NuGrounding2025research-lab——nuScenes multi-viewnot statedNoopen—
NuPlanQA2025research-lab——nuPlan multi-viewnot statedNoopen—
NuRisk2025research-lab——nuScenes, Waymo, CommonRoadnot statedNoopen—
NuScenes-SpatialQA2025research-lab——nuScenesnot statedNoopen—
Robusto-12025research-lab——dashcam video, Perunot statedNoopen—
V2V-QA (V2V-LLM)2025research-lab——V2V4Real multi-vehicle lidarnot statedNoopen—
VLADBench2025research-lab——images from public driving setsnot statedNoopen—
WaymoQA2025research-lab——Waymo multi-viewnot statedNoopen—
Spatial Relationship Aware Dataset for Robotics2025research-lab——robot-acquired indoor imagesnot statedNoopen—
Large-Scale LiDAR-Inertial backpack dataset2025research-lab——backpack with multi-beam LiDAR, IMU, RTK-GNSSnot statedNoopen—
Lidar Variability2025research-lab——solid-state and spinning lidarsnot statedNoopen—
LoopDB2025research-lab——camera, loop closurenot statedNoopen—
SLABIM2025research-lab——SLAM sensor rig coupled with BIMnot statedNoopen—
SmartPNT-MSF2025research-lab——multi-sensor positioning rignot statedNoopen—
CU-Multi2025research-lab——multiple robotsnot statedNoopen—
i2Nav-Robot2025research-lab——omnidirectional wheeled robot with solid-state LiDARs, 4D radar, stereo, GNSS, IMUnot statedNoopen—
INDOOR-LiDAR2025research-lab——robot-centric 360 degree indoor LiDAR, real plus simulatednot statedNoopen—
M2UD2025research-lab——ground robot on uneven terrainnot statedNoopen—
M3DGR2025research-lab——ground robot multi-sensor SLAMnot statedNoopen—
MobileOcc2025research-lab——mobile robotnot statedNoopen—
MRCD (Mobile Robot Campus Dataset)2025research-lab——wheeled delivery robotnot statedNoopen—
NavDP dataset2025synthetic——simulated navigationnot statedNoopen—
PeRoI2025research-lab——mobile robot among pedestriansnot statedNoopen—