MapTrace: Scalable Data Generation for Route Tracing on Maps

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Panagopoulou, Artemis, Purohit, Aveek, Kulshrestha, Achin, Yazdani, Soroosh, Goyal, Mohit
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917163953029120
author Panagopoulou, Artemis
Purohit, Aveek
Kulshrestha, Achin
Yazdani, Soroosh
Goyal, Mohit
author_facet Panagopoulou, Artemis
Purohit, Aveek
Kulshrestha, Achin
Yazdani, Soroosh
Goyal, Mohit
contents While Multimodal Large Language Models have achieved human-like performance on many visual and textual reasoning tasks, their proficiency in fine-grained spatial understanding, such as route tracing on maps remains limited. Unlike humans, who can quickly learn to parse and navigate maps, current models often fail to respect fundamental path constraints, in part due to the prohibitive cost and difficulty of collecting large-scale, pixel-accurate path annotations. To address this, we introduce a scalable synthetic data generation pipeline that leverages synthetic map images and pixel-level parsing to automatically produce precise annotations for this challenging task. Using this pipeline, we construct a fine-tuning dataset of 23k path samples across 4k maps, enabling models to acquire more human-like spatial capabilities. Using this dataset, we fine-tune both open-source and proprietary MLLMs. Results on MapBench show that finetuning substantially improves robustness, raising success rates by up to 6.4 points, while also reducing path-tracing error (NDTW). These gains highlight that fine-grained spatial reasoning, absent in pretrained models, can be explicitly taught with synthetic supervision.
format Preprint
id arxiv_https___arxiv_org_abs_2512_19609
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MapTrace: Scalable Data Generation for Route Tracing on Maps
Panagopoulou, Artemis
Purohit, Aveek
Kulshrestha, Achin
Yazdani, Soroosh
Goyal, Mohit
Computer Vision and Pattern Recognition
Artificial Intelligence
While Multimodal Large Language Models have achieved human-like performance on many visual and textual reasoning tasks, their proficiency in fine-grained spatial understanding, such as route tracing on maps remains limited. Unlike humans, who can quickly learn to parse and navigate maps, current models often fail to respect fundamental path constraints, in part due to the prohibitive cost and difficulty of collecting large-scale, pixel-accurate path annotations. To address this, we introduce a scalable synthetic data generation pipeline that leverages synthetic map images and pixel-level parsing to automatically produce precise annotations for this challenging task. Using this pipeline, we construct a fine-tuning dataset of 23k path samples across 4k maps, enabling models to acquire more human-like spatial capabilities. Using this dataset, we fine-tune both open-source and proprietary MLLMs. Results on MapBench show that finetuning substantially improves robustness, raising success rates by up to 6.4 points, while also reducing path-tracing error (NDTW). These gains highlight that fine-grained spatial reasoning, absent in pretrained models, can be explicitly taught with synthetic supervision.
title MapTrace: Scalable Data Generation for Route Tracing on Maps
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2512.19609