EgoVerse — Egocentric Robot Training Dataset: 8.5M Frames, 74 Countries

EgoVerse is the largest egocentric dataset for robot learning — 8.5 million first-person video frames collected across 74 countries. Free to download for research and commercial robot training.

Dataset specifications
Year2025
Episodes57,761
Total hours1,213
Frame rate20 fps
Embodimentsaria_bimanual, aria_left_arm, aria_right_arm, eva_bimanual, eva_right_arm, mecka_bimanual, scale_bimanual, scale_left_arm, scale_right_arm
Modalitiesrgb, proprioception, language
View typeegocentric, multi-view
Task categoriescleaning, dishwashing, folding, cooking, manipulation, pick-and-place, human-robot-interaction
Data formatzarr, lerobot, hdf5
LicenseCC BY-SA 4.0
Accessopen — commercial use permitted
MaintainerGaTech RL2, Mecka AI, ETH Zurich, Scale AI
Origin countryUS

What is it?

EgoVerse is the largest open-source egocentric robot learning dataset available as of 2025. Developed by Georgia Tech RL2 in collaboration with Mecka AI, ETH Zurich, and Scale AI, it contains 57,761 labelled episodes totalling 1,213 hours of real-robot demonstration data. The dataset covers 5,059 distinct tasks across six robot embodiments — bimanual arm platforms from Aria, Eva, Mecka, and Scale — collected in diverse real-world environments including kitchens, bedrooms, dining rooms, offices, workshops, and outdoor balconies. Data is distributed in Zarr and LeRobot format via AWS S3, with an interactive episode browser at partners.mecka.ai/egoverse.

Who is it for?

EgoVerse is designed for machine learning researchers working on imitation learning, behaviour cloning, and vision-language-action model training for household and service robot applications. It is particularly valuable for researchers who need large-scale, diverse, commercially licensable manipulation data across multiple robot platforms. The dataset is also a primary reference for policy researchers studying generalisation across embodiments, as it covers six distinct bimanual arm configurations under a single consistent task taxonomy.

Key specifications

How it compares

EgoVerse is the largest open manipulation dataset by episode count and total hours. Open X-Embodiment covers more embodiments (22 vs 6) but has fewer hours of egocentric household data. DROID (76,000 episodes) is comparable in scale but focuses on Franka Panda arm manipulation in lab settings rather than household environments. EgoVerse's egocentric camera perspective and diversity of real-world home environments make it the strongest dataset for training domestic service robot policies.

Limitations and access notes

EgoVerse covers manipulation tasks but does not include locomotion, outdoor navigation, or physical contact-rich tasks requiring force feedback. The dataset was collected using bimanual arm platforms — it does not include mobile base data, humanoid full-body data, or legged robot data. The CC BY-SA 4.0 license requires derivative datasets to be shared under the same license. Access is free and requires no registration.

Linked professions

Frequently asked questions

How do I download EgoVerse?

EgoVerse is freely available via AWS S3 in Zarr and LeRobot format. Access the dataset and download instructions at partners.mecka.ai/egoverse. No registration is required. The dataset is licensed under CC BY-SA 4.0, which permits commercial use with attribution.

What tasks does EgoVerse cover?

EgoVerse covers 5,059 distinct tasks across 7 categories: cleaning (vacuuming, mopping, surface wiping), dishwashing (loading, scrubbing, rinsing), folding (clothes, napkins, towels), cooking (chopping, mixing, decorating food), general manipulation, pick-and-place, and human-robot interaction. Tasks were performed in kitchens, bedrooms, dining rooms, offices, workshops, and balconies.

Can EgoVerse be used for commercial robotics development?

Yes. EgoVerse is licensed under CC BY-SA 4.0, which permits commercial use. You must provide attribution to the original creators (GaTech RL2, Mecka AI, ETH Zurich, Scale AI) and any derivative datasets you create must be shared under the same CC BY-SA 4.0 license.

What robot platforms are included in EgoVerse?

EgoVerse includes data from six robot embodiment configurations: aria_bimanual, aria_left_arm, aria_right_arm, eva_bimanual, eva_right_arm, mecka_bimanual, scale_bimanual, scale_left_arm, and scale_right_arm. All are bimanual or single-arm manipulation platforms with egocentric camera setups.

How does EgoVerse compare to Open X-Embodiment?

EgoVerse contains 57,761 episodes across 6 embodiments focused on household manipulation tasks with egocentric cameras. Open X-Embodiment contains over 1 million episodes across 22 embodiments but covers a broader range of lab and non-household settings. EgoVerse is stronger for domestic service robot training; Open X-Embodiment offers broader cross-embodiment generalisation.