Companion release · CoRL 2026 workshop paper ↗
A failure-aware slice of a 500-hour crowdsourced egocentric corpus: stereo clips sampled across the quality spectrum, the metadata they were collected with, the automatic QC signals used to sample them, and frame-accurate human review of idle and off-task time.
Counts over the clips in this preview. QC strata come from the automatic CLEF score of the 30 s source chunk and were used to make the sample span the quality range; they are not ground truth.
The paper maps source-specific QA labels onto four canonical families. Failures are usually localised: trimming annotated intervals keeps far more footage than rejecting whole recordings.
Failures of the recording process: camera misalignment, obstruction, wrong mounting or orientation.
visible in footageReduced observability: blur, exposure, poor lighting, compression.
visible in footageDeviations from the intended activity: idle time, off-task behaviour, staged or repeated actions, no visible task.
labelledContent inconsistent with its task description or other metadata.
task id vs. descriptionReviewers marked idle spans (both hands still or nothing task-related in hand for > 2 s) and non-task spans (phone use, conversation, walking without work, smoking, eating/drinking, unrelated object, other), each with a one-line description. Below: where in the 30 s clips those spans fall, across all reviewed clips.
The dataset repository holds the full-resolution stereo clips (4000×1200 side-by-side, 30 fps, H.264), metadata.jsonl, the taxonomy, a schema, checksums and evaluation scripts.
from huggingface_hub import snapshot_download
root = snapshot_download("psdn-ai/EgoCrowd-500H", repo_type="dataset")
Preview terms apply (private review and reproduction of the paper's analyses). Contact hello@psdn.ai for licensing or the full corpus.
@inproceedings{nagpal2026egocrowd,
title = {When Crowdsourced Egocentric Video Goes Wrong:
Failure Modes, Metadata, and Quality Control},
author = {Nagpal, Rashmi and Liu, Lefei and Park, Jongwon
and Chinchali, Sandeep P.},
booktitle = {CoRL Workshops},
year = {2026},
url = {https://openreview.net/pdf?id=rLGRN1Uoh2}
}