FUSE-RSVLM: Feature Fusion Vision-Language Model for Remote Sensing
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914226878021632 |
|---|---|
| author | Dang, Yunkai Wang, Donghao Yang, Jiacheng Jiang, Yifan Zhu, Meiyi Yang, Yuekun Wang, Cong Fan, Qi Li, Wenbin Gao, Yang |
| author_facet | Dang, Yunkai Wang, Donghao Yang, Jiacheng Jiang, Yifan Zhu, Meiyi Yang, Yuekun Wang, Cong Fan, Qi Li, Wenbin Gao, Yang |
| contents | Large vision-language models (VLMs) exhibit strong performance across various tasks. However, these VLMs encounter significant challenges when applied to the remote sensing domain due to the inherent differences between remote sensing images and natural images. Existing remote sensing VLMs often fail to extract fine-grained visual features and suffer from visual forgetting during deep language processing. To address this, we introduce MF-RSVLM, a Multi-Feature Fusion Remote Sensing Vision--Language Model that effectively extracts and fuses visual features for RS understanding. MF-RSVLM learns multi-scale visual representations and combines global context with local details, improving the capture of small and complex structures in RS scenes. A recurrent visual feature injection scheme ensures the language model remains grounded in visual evidence and reduces visual forgetting during generation. Extensive experiments on diverse RS benchmarks show that MF-RSVLM achieves state-of-the-art or highly competitive performance across remote sensing classification, image captioning, and VQA tasks. Our code is publicly available at https://github.com/Yunkaidang/RSVLM. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_24022 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | FUSE-RSVLM: Feature Fusion Vision-Language Model for Remote Sensing Dang, Yunkai Wang, Donghao Yang, Jiacheng Jiang, Yifan Zhu, Meiyi Yang, Yuekun Wang, Cong Fan, Qi Li, Wenbin Gao, Yang Computer Vision and Pattern Recognition Artificial Intelligence Large vision-language models (VLMs) exhibit strong performance across various tasks. However, these VLMs encounter significant challenges when applied to the remote sensing domain due to the inherent differences between remote sensing images and natural images. Existing remote sensing VLMs often fail to extract fine-grained visual features and suffer from visual forgetting during deep language processing. To address this, we introduce MF-RSVLM, a Multi-Feature Fusion Remote Sensing Vision--Language Model that effectively extracts and fuses visual features for RS understanding. MF-RSVLM learns multi-scale visual representations and combines global context with local details, improving the capture of small and complex structures in RS scenes. A recurrent visual feature injection scheme ensures the language model remains grounded in visual evidence and reduces visual forgetting during generation. Extensive experiments on diverse RS benchmarks show that MF-RSVLM achieves state-of-the-art or highly competitive performance across remote sensing classification, image captioning, and VQA tasks. Our code is publicly available at https://github.com/Yunkaidang/RSVLM. |
| title | FUSE-RSVLM: Feature Fusion Vision-Language Model for Remote Sensing |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2512.24022 |