EgoMoD: Predicting Global Maps of Dynamics from Local Egocentric Observations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Catalano, Iacopo, Morilla-Cabello, David, Pena-Queralta, Jorge, Montijano, Eduardo
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908856914804736
author Catalano, Iacopo
Morilla-Cabello, David
Pena-Queralta, Jorge
Montijano, Eduardo
author_facet Catalano, Iacopo
Morilla-Cabello, David
Pena-Queralta, Jorge
Montijano, Eduardo
contents Efficient navigation in dynamic environments requires anticipating how motion patterns evolve beyond the robot's immediate perceptual range, enabling preemptive rather than purely reactive planning in crowded scenes. Maps of Dynamics (MoDs) offer a structured representation of motion tendencies in space useful for long-term global planning, but constructing them traditionally requires global environment observations over extended periods of time. We introduce EgoMoD, the first approach that learns to predict future MoDs directly from short egocentric video clips collected during robot operation. Our method learns to infer environment-wide motion tendencies from local dynamic cues using a video- and pose-conditioned architecture trained with MoDs computed from external observations as privileged supervision, allowing local observations to serve as predictive signals of global motion structure. Thanks to this, we offer the capacity to forecast future motion dynamics over the whole environment rather than merely extend past patterns in the robot's field of view. Experiments in large simulated environments show that EgoMoD accurately predicts future MoDs under limited observability, while evaluation with real images showcases its zero-shot transferability to real systems.
format Preprint
id arxiv_https___arxiv_org_abs_2603_00167
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle EgoMoD: Predicting Global Maps of Dynamics from Local Egocentric Observations
Catalano, Iacopo
Morilla-Cabello, David
Pena-Queralta, Jorge
Montijano, Eduardo
Robotics
Efficient navigation in dynamic environments requires anticipating how motion patterns evolve beyond the robot's immediate perceptual range, enabling preemptive rather than purely reactive planning in crowded scenes. Maps of Dynamics (MoDs) offer a structured representation of motion tendencies in space useful for long-term global planning, but constructing them traditionally requires global environment observations over extended periods of time. We introduce EgoMoD, the first approach that learns to predict future MoDs directly from short egocentric video clips collected during robot operation. Our method learns to infer environment-wide motion tendencies from local dynamic cues using a video- and pose-conditioned architecture trained with MoDs computed from external observations as privileged supervision, allowing local observations to serve as predictive signals of global motion structure. Thanks to this, we offer the capacity to forecast future motion dynamics over the whole environment rather than merely extend past patterns in the robot's field of view. Experiments in large simulated environments show that EgoMoD accurately predicts future MoDs under limited observability, while evaluation with real images showcases its zero-shot transferability to real systems.
title EgoMoD: Predicting Global Maps of Dynamics from Local Egocentric Observations
topic Robotics
url https://arxiv.org/abs/2603.00167