Salvato in:
Dettagli Bibliografici
Autori principali: Tang, Datao, Wang, Hao, Xin, Yudeng, Qiao, Hui, Jiang, Dongsheng, Li, Yin, Yu, Zhiheng, Cao, Xiangyong
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:https://arxiv.org/abs/2510.21391
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912668852420608
author Tang, Datao
Wang, Hao
Xin, Yudeng
Qiao, Hui
Jiang, Dongsheng
Li, Yin
Yu, Zhiheng
Cao, Xiangyong
author_facet Tang, Datao
Wang, Hao
Xin, Yudeng
Qiao, Hui
Jiang, Dongsheng
Li, Yin
Yu, Zhiheng
Cao, Xiangyong
contents Remote sensing vision tasks require extensive labeled data across multiple, interconnected domains. However, current generative data augmentation frameworks are task-isolated, i.e., each vision task requires training an independent generative model, and ignores the modeling of geographical information and spatial constraints. To address these issues, we propose \textbf{TerraGen}, a unified layout-to-image generation framework that enables flexible, spatially controllable synthesis of remote sensing imagery for various high-level vision tasks, e.g., detection, segmentation, and extraction. Specifically, TerraGen introduces a geographic-spatial layout encoder that unifies bounding box and segmentation mask inputs, combined with a multi-scale injection scheme and mask-weighted loss to explicitly encode spatial constraints, from global structures to fine details. Also, we construct the first large-scale multi-task remote sensing layout generation dataset containing 45k images and establish a standardized evaluation protocol for this task. Experimental results show that our TerraGen can achieve the best generation image quality across diverse tasks. Additionally, TerraGen can be used as a universal data-augmentation generator, enhancing downstream task performance significantly and demonstrating robust cross-task generalisation in both full-data and few-shot scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2510_21391
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle TerraGen: A Unified Multi-Task Layout Generation Framework for Remote Sensing Data Augmentation
Tang, Datao
Wang, Hao
Xin, Yudeng
Qiao, Hui
Jiang, Dongsheng
Li, Yin
Yu, Zhiheng
Cao, Xiangyong
Computer Vision and Pattern Recognition
Remote sensing vision tasks require extensive labeled data across multiple, interconnected domains. However, current generative data augmentation frameworks are task-isolated, i.e., each vision task requires training an independent generative model, and ignores the modeling of geographical information and spatial constraints. To address these issues, we propose \textbf{TerraGen}, a unified layout-to-image generation framework that enables flexible, spatially controllable synthesis of remote sensing imagery for various high-level vision tasks, e.g., detection, segmentation, and extraction. Specifically, TerraGen introduces a geographic-spatial layout encoder that unifies bounding box and segmentation mask inputs, combined with a multi-scale injection scheme and mask-weighted loss to explicitly encode spatial constraints, from global structures to fine details. Also, we construct the first large-scale multi-task remote sensing layout generation dataset containing 45k images and establish a standardized evaluation protocol for this task. Experimental results show that our TerraGen can achieve the best generation image quality across diverse tasks. Additionally, TerraGen can be used as a universal data-augmentation generator, enhancing downstream task performance significantly and demonstrating robust cross-task generalisation in both full-data and few-shot scenarios.
title TerraGen: A Unified Multi-Task Layout Generation Framework for Remote Sensing Data Augmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.21391