Geppetto tracks 1035 robot training datasets including Open X-Embodiment, DROID, and AgiBot World, each with structured metadata on trajectory count, hours of demonstration, robot platforms, license, commercial use, access model, and file format. Every dataset connects to the robots it trains and the professions it affects.

DatasetYearCategoryTrajectoriesHoursPlatformsLicenseCommercialAccessFormat
ORBIT2021human-video——mobile phones held by blind or low-vision usersnot statedNoopen—
TREK-1502021human-video——EPIC-KITCHENS videosnot statedNoopen—
H2O-3D2021human-video——fixed multi-view RGB-D cameras (not egocentric)not statedNoopen—
ARQ-CRISP slip detection dataset 20212021research-lab——robot hand tactile data during pick and placenot statedNoopen—
Robot handle grasping failure data2021research-lab——Toyota HSR drawer handle graspingCC-BY-4.0Yesopen—
Grasps Under Varied Object Orientation Dataset2021research-lab——human hand graspsnot statedNoopen—
OCID-Grasp2021research-lab——OCID RGB-D scenes with grasp rectanglessee repo LICENSENoopen—
SuctionNet-1Billion2021research-lab——GraspNet-1Billion scenes with suction labelsCC BY-NC-SA 4.0Noopen—
Contact-GraspNet training scenes2021research-lab——simulated tabletop scenes, parallel-jawsee repo License.pdfNoopen—
DefGraspSim2021research-lab——simulated grasps on deformable objectssee repo LICENSENoopen—
TrajAir2021real-robot—2,442droneCC-BY-4.0Yesopen—
DexYCB2021human-video—0.83humanCC-BY-NC-4.0Noopen—
In-flight Positional and Energy-Use Dataset of Package-Delivery Quadcopter UAVs2021real-robot—10.75droneCC-BY-4.0Yesopen—
Anti-UAV2021research-lab——RGB and thermal video of dronesnot statedNoopen—
CrossLoc2021research-lab——real and rendered aerial imagerynot statedNoopen—
Fixed-wing Aircraft Collision Course Dataset2021research-lab——camera, fixed-wing aircraftnot statedNoopen—
Lighthouse Positioning System Dataset2021research-lab——Lighthouse tracking for UAVsnot statedNoopen—
NeuroBEM dataset2021research-lab——quadrotor in a large motion capture systemnot statedNoopen—
IPS300+2021research-lab——roadside lidar and cameras at intersectionCC BY-NC-SA 4.0Noopen—
REGRAD2021research-lab——simulated cluttered scenes with relationship and grasp labelsnot statedNoopen—
UAV-Human2021research-lab——UAV multi-modal video of peoplenot statedNoopen—
ExPI (Extreme Pose Interaction)2021research-lab——two dancers, 3D poses and shapesnot statedNoopen—
SAMP2021research-lab——human body interacting with furniturenot statedNoopen—
Airbert BnB2021research-lab——online rental listing imagesnot statedNoopen—
OCID-Ref2021research-lab——OCID RGB and point cloud scenesMITYesopen—
ScanQA2021research-lab——ScanNet RGB-D indoor scansCC BY-NC-SA 3.0Noopen—
SUTD-TrafficQA2021research-lab——in-the-wild traffic videosnot statedNoopen—
K-EQA2021research-lab——simulated scenes with external knowledgenot statedNoopen—
Robo-VLN2021research-lab——continuous 3D reconstructed environmentsnot statedNoopen—
SOON2021research-lab——Matterport3D simulatornot statedNoopen—
MIT Mini Cheetah contact data sets2021research-lab——MIT Mini Cheetah proprioceptionnot statedNoopen—
AcinoSet2021research-lab——cheetahs in the wild, multi-viewnot statedNoopen—
ColoRadar2021research-lab——millimeter wave radar rignot statedNoopen—
Hilti SLAM Challenge Dataset 20212021research-lab——handheld multi-sensor rignot statedNoopen—
TUM-VIE2021research-lab——stereo event cameras, stereo grayscale, IMUnot statedNoopen—
CMU-GPR2021research-lab——ground penetrating radarnot statedNoopen—
M2DGR2021research-lab——ground robot with fisheye, infrared, event cameras, LiDAR, IMUnot statedNoopen—
NAVER LABS indoor localization datasets2021research-lab——mapping platform with 10 cameras and LiDARnot statedNoopen—
EgoCom2020research-lab—38.5—Modified MITYesopen—
SensatUrban2020research-lab——urban-scale photogrammetric point cloudsnot statedNoopen—
University-16522020research-lab——synthetic drone, satellite and ground viewsnot statedNoopen—
pNEUMA2020research-lab——swarm of 10 drones over Athensnot statedNoopen—
4Seasons2020research-lab——car with stereo camera, IMU, RTK-GNSSCC BY-NC-SA 4.0Noopen—
A2D22020research-lab——Audi Q7 with 6 cameras, 5 lidarsCC BY-ND 4.0Noopen—
Car Crash Dataset (CCD)2020research-lab——dashcam accident videosnot statedNoopen—
CARRADA2020research-lab——camera and automotive radarCC BY-NC-SA 4.0Noopen—
Cirrus2020research-lab——car with two 250 m bi-pattern lidars and cameranot statedNoopen—
comma10k2020research-lab——comma device road imagesMITYesopen—
CurveLanes2020research-lab——lane imagesnot statedNoopen—
DDAD2020research-lab——TRI vehicles, 6 cameras, Luminar lidarCC BY-NC-SA 4.0Noopen—
Ford Multi-AV Seasonal Dataset2020research-lab——Ford AV fleet, lidars, cameras, GPS/IMUCC BY-NC-SA 4.0Noopen—
FSOCO2020research-lab——Formula Student driverless car camerasnot statedNoopen—
Honda TITAN2020research-lab——egocentric vehicle camera, Tokyoresearch onlyNoopen—
LIBRE2020research-lab——multiple 3D LiDARs on vehiclenot statedNoopen—
nuImages2020research-lab——nuScenes vehicle camerasCC BY-NC-SA 4.0Nogated—
Oxford Radar RobotCar2020research-lab——RobotCar with Navtech radar, lidar, camerasCC BY-NC-SA 4.0Nogated—
PandaSet2020research-lab——car with Hesai Pandar64 and PandarGT lidars, 6 camerasCC BY 4.0Yesopen—
PePScenes2020research-lab——pedestrian action labels in 3Dnot statedNoopen—
SemanticPOSS2020research-lab——LiDAR point cloudsnot statedNoopen—
Toronto-3D2020research-lab——mobile LiDAR urban point cloudnot statedNoopen—
Ego2Hands / Ego2HandsPose2020human-video——egocentric RGB cameranot statedNoopen—
EgoK3602020human-video——wearable 360 cameranot statedNoopen—
Ego3DHands2020human-video——Synthetic two-hand imagesnot statedNoopen—
ContactPose2020research-lab——human hand grasps, RGB-D and contact mapsnot statedNoopen—
EGAD2020research-lab——3D-printable object meshesnot statedNoopen—
GRAB2020research-lab——human whole body with hands and face, SMPL-X, plus 3D objectscustom, sign-in requiredNogated—
Event-Stream grasping dataset2020research-lab——neuromorphic event cameranot statedNoopen—
GraspNet-1Billion2020research-lab——Kinect Azure and RealSense D435 RGB-D, parallel-jaw grasp labelsCC BY-NC-SA 4.0Noopen—
Real Embodied Dataset (RED)2020research-lab——hand-mounted RGB-D, upper hemisphere viewpointsnot statedNoopen—
TaskGrasp2020research-lab——RGB-D point clouds of real objects with task labelsnot statedNoopen—
ACRONYM2020research-lab——simulated parallel-jaw gripper (NVIDIA FleX)MIT (repo)Noopen—
Robotic Interestingness Dataset (SubTF)2020human-video—7.8—unknownNoopen—
TartanAir2020synthetic—27.8droneCC-BY-4.0Yesopen—
AU-AIR2020research-lab——UAV with camera and flight telemetrynot statedNoopen—
ERA2020research-lab——aerial event videosnot statedNoopen—
CADC (Canadian Adverse Driving Conditions)2020research-lab——Lincoln MKZ with 8 cameras, lidar, GNSSCC BY-NC 4.0Noopen—
VGN synthetic grasp data2020research-lab——simulated parallel-jaw grasps in clutterBSD-3-Clause (repo)Noopen—
HumanAct122020research-lab——human body, 3D skeletonnot statedNoopen—
AIR-Act2Act2020research-lab——human-human interaction for social robotsnot statedNoopen—
ETRI-Activity3D2020research-lab——RGB-D from robot viewpointnot statedNoopen—
InterHand2.6M2020research-lab——multi-view interacting handsnot statedNoopen—
MoGaze2020research-lab——full-body mocap with eye gazenot statedNoopen—
SFU-Store-Nav2020research-lab——camera and mocap of shoppersnot statedNoopen—
GoLD (Grounded Language Dataset)2020research-lab——multimodal object descriptionsnot statedNoopen—
RxR (Room-Across-Room)2020research-lab——Matterport3D simulatorCC-BY-4.0 (annotations)Yesopen—
VLN-CE (R2R-CE and RxR-CE)2020research-lab——Habitat continuous environmentsnot statedNoopen—
BDD-OIA2020research-lab——BDD100K imagesnot statedNoopen—
RobotSlang2020research-lab——physical robot driven by a human Drivernot statedNoopen—
Motion Imitation retargeted dog motions (Peng et al.)2020research-lab——Laikago and A1 quadrupedsnot statedNoopen—
RGBD-Dog2020research-lab——dogs of several breeds, Kinect v2 plus mocap skeletonnot statedNoopen—
Newer College Dataset2020research-lab——handheld LiDAR, inertial and vision devicenot statedNoopen—
TrajNet++2020research-lab——pedestrian trajectories in crowdsnot statedNoopen—
Meta-World — Multi-Task and Meta-Reinforcement Learning2019synthetic——Sawyer (simulated)MITYesopenjson, pkl
CITR and DUT2019research-lab——top-view pedestrian and vehicle trajectoriesnot statedNoopen—
Mapillary Traffic Sign Dataset (MTSD)2019research-lab——crowdsourced street-level camerasCC BY-NC-SANogated—
A*3D2019research-lab——car with cameras and lidar, Singaporenon-commercial academicNoopen—
A3D (AnAn Accident Detection)2019research-lab——dashcam accident videosnot statedNoopen—
Argoverse 12019research-lab——Argo AI vehicle, ring cameras, lidar, HD mapsCC BY-NC-SA 4.0Noopen—
BLVD2019research-lab——vehicle, 5D semanticsnot statedNoopen—
Brno Urban Dataset2019research-lab——car with cameras, lidars, thermal camera, GNSSnot statedNoopen—