Ego4D — Around the World in 3,025 Hours of Egocentric Video
SEE IT IN USE
About This Dataset
Ego4D is the largest egocentric human activity video dataset ever assembled, developed by Meta AI Research in collaboration with over 50 institutions across 9 countries. Released in 2022 under the Ego4D Research License for non-commercial use, it contains 3,025 hours of egocentric video recorded by 931 camera wearers across diverse daily activities including cooking, construction, health activities, sports, and social interactions captured in 74 worldwide locations. The dataset includes rich annotations covering narrations, temporal action segments, object interactions, and social interaction segments. Ego4D provides the largest source of human demonstration data for robot learning pre-training, particularly for egocentric manipulation policy training. Access requires signing the Ego4D license agreement. The dataset has been used to pre-train vision encoders and action models that transfer to robot manipulation tasks, bridging the gap between human and robot data.
What is it?
Ego4D is the largest egocentric human activity video dataset ever assembled, developed by Meta AI Research in collaboration with over 50 institutions across 9 countries. Released in 2022 under the Ego4D Research License, it contains 3,025 hours of egocentric video recorded by 931 camera wearers across 74 worldwide locations. Activities span cooking, construction, healthcare, sports, crafts, agriculture, and social interactions. The dataset includes rich annotations covering narrations, temporal action segments, object interactions, and social interaction labels.
Who is it for?
Ego4D is primarily used to pretrain vision encoders and action models for robot learning. Human egocentric video provides a vastly larger and more diverse source of manipulation demonstrations than any robot-collected dataset — humans performing everyday tasks generate implicit robot training signal when the tasks overlap. Researchers use Ego4D to pretrain visual representations that then transfer to robot manipulation, reducing the amount of real-robot data needed for policy training.
Key specifications
- •Duration: 3,025 hours of egocentric video
- •Camera wearers: 931 participants
- •Locations: 74 worldwide locations across 9 countries
- •Frame rate: 30 fps
- •Annotations: Narrations, temporal actions, object interactions, social interactions
- •Format: MP4, JSON annotations
- •License: Ego4D License — non-commercial research only
- •Access: Gated — requires signing Ego4D license agreement
How it compares
Ego4D is by far the largest egocentric dataset available (3,025 hours vs EgoVerse's 1,213 hours), but covers human activities rather than robot demonstrations directly. EgoVerse provides real robot demonstrations in egocentric format with task labels — more directly usable for robot policy training. Ego4D's value is scale for pretraining visual representations; EgoVerse's value is task-labelled robot demonstrations.
Limitations and access notes
The Ego4D license prohibits commercial use. Access requires signing the license agreement which includes providing institutional affiliation. The dataset covers human activities — transfer to robot manipulation requires domain adaptation. Not all activities are relevant to robot manipulation tasks.
Tasks Covered
This dataset covers manipulation, cooking, cleaning, dishwashing, folding, construction, human-robot-interaction, long-horizon tasks across human (wearable camera) robot platforms.
Access and Licensing
Citation
Meta AI Research & University of Indiana & 50+ global institutions (2022). Ego4D — Around the World in 3,025 Hours of Egocentric Video. https://ego4d-data.org
Robot Embodiments
This dataset includes demonstrations collected using the following robot platforms.
- human (wearable camera)
Professions trained on this dataset
Roles where robots trained on Ego4D — Around the World in 3,025 Hours of Egocentric Video are being deployed
Related Datasets
SPARC (Spatial Annotations from Robot Demonstrations at Scale)
Intuitive Robots Research Team · 2026 · null
Real RobotPalmDex — Embodiment-Agnostic Tactile Manipulation Dataset
PalmDex Research Team · 2026 · CC BY-SA 4.0
Real RobotGR1 Robot Teleoperation Dataset
NVIDIA · 2026 · MIT
Real RobotPhysicalAI Robotics Kitchen Manipulation Demos
NVIDIA · 2026 · CC BY 4.0
Frequently Asked Questions
About Meta AI Research & University of Indiana & 50+ global institutions
Ego4D — Around the World in 3,025 Hours of Egocentric Video is a Human Video dataset maintained by Meta AI Research and University of Indiana and 50+ global institutions, released in 2022 under the Ego4D License — non-commercial research only license. The dataset is restricted to non-commercial research use. It covers manipulation, cooking, cleaning, dishwashing, folding, construction, human-robot-interaction, long-horizon tasks using human (wearable camera) robot platforms. Access requires registration at https://ego4d-data.org.