EgoMAGIC- An Egocentric Video Field Medicine Dataset for Training Perception Algorithms
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914503466156032 |
|---|---|
| author | VanVoorst, Brian Walczak, Nicholas Gilleo, Christopher Meissner, Charles Felix, Fabio Roman, Iran Steers, Bea Silva, Claudio Shen, Yuhan Lu, Zijia Lee, Shih-Po Elhamifar, Ehsan |
| author_facet | VanVoorst, Brian Walczak, Nicholas Gilleo, Christopher Meissner, Charles Felix, Fabio Roman, Iran Steers, Bea Silva, Claudio Shen, Yuhan Lu, Zijia Lee, Shih-Po Elhamifar, Ehsan |
| contents | This paper introduces EgoMAGIC (Medical Assistance, Guidance, Instruction, and Correction), an egocentric medical activity dataset collected as part of DARPA's Perceptually-enabled Task Guidance (PTG) program. This dataset comprises 3,355 videos of 50 medical tasks, with at least 50 labeled videos per task. The primary objective of the PTG program was to develop virtual assistants integrated into augmented reality headsets to assist users in performing complex tasks.
To encourage exploration and research using this dataset, the medical training data has been released along with an action detection challenge focused on eight medical tasks. The majority of the videos were recorded using a head-mounted stereo camera with integrated audio. From this dataset, 40 YOLO models were trained using 1.95 million labels to detect 124 medical objects, providing a robust starting point for developers working on medical AI applications.
In addition to introducing the dataset, this paper presents baseline results on action detection for the eight selected medical tasks across three models, with the best-performing method achieving average mAP 0.526. Although this paper primarily addresses action detection as the benchmark, the EgoMAGIC dataset is equally suitable for action recognition, object identification and detection, error detection, and other challenging computer vision tasks.
The dataset is accessible via zenodo.org (DOI: 10.5281/zenodo.19239154). |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_22036 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | EgoMAGIC- An Egocentric Video Field Medicine Dataset for Training Perception Algorithms VanVoorst, Brian Walczak, Nicholas Gilleo, Christopher Meissner, Charles Felix, Fabio Roman, Iran Steers, Bea Silva, Claudio Shen, Yuhan Lu, Zijia Lee, Shih-Po Elhamifar, Ehsan Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning This paper introduces EgoMAGIC (Medical Assistance, Guidance, Instruction, and Correction), an egocentric medical activity dataset collected as part of DARPA's Perceptually-enabled Task Guidance (PTG) program. This dataset comprises 3,355 videos of 50 medical tasks, with at least 50 labeled videos per task. The primary objective of the PTG program was to develop virtual assistants integrated into augmented reality headsets to assist users in performing complex tasks. To encourage exploration and research using this dataset, the medical training data has been released along with an action detection challenge focused on eight medical tasks. The majority of the videos were recorded using a head-mounted stereo camera with integrated audio. From this dataset, 40 YOLO models were trained using 1.95 million labels to detect 124 medical objects, providing a robust starting point for developers working on medical AI applications. In addition to introducing the dataset, this paper presents baseline results on action detection for the eight selected medical tasks across three models, with the best-performing method achieving average mAP 0.526. Although this paper primarily addresses action detection as the benchmark, the EgoMAGIC dataset is equally suitable for action recognition, object identification and detection, error detection, and other challenging computer vision tasks. The dataset is accessible via zenodo.org (DOI: 10.5281/zenodo.19239154). |
| title | EgoMAGIC- An Egocentric Video Field Medicine Dataset for Training Perception Algorithms |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2604.22036 |