Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | https://arxiv.org/abs/2503.16326 |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916658202804224 |
|---|---|
| author | Yuan, Long Mo, Fengran Huang, Kaiyu Wang, Wenjie Zhai, Wangyuxuan Zhu, Xiaoyu Li, You Xu, Jinan Nie, Jian-Yun |
| author_facet | Yuan, Long Mo, Fengran Huang, Kaiyu Wang, Wenjie Zhai, Wangyuxuan Zhu, Xiaoyu Li, You Xu, Jinan Nie, Jian-Yun |
| contents | The rapid advancement of multimodal large language models (LLMs) has opened new frontiers in artificial intelligence, enabling the integration of diverse large-scale data types such as text, images, and spatial information. In this paper, we explore the potential of multimodal LLMs (MLLM) for geospatial artificial intelligence (GeoAI), a field that leverages spatial data to address challenges in domains including Geospatial Semantics, Health Geography, Urban Geography, Urban Perception, and Remote Sensing. We propose a MLLM (OmniGeo) tailored to geospatial applications, capable of processing and analyzing heterogeneous data sources, including satellite imagery, geospatial metadata, and textual descriptions. By combining the strengths of natural language understanding and spatial reasoning, our model enhances the ability of instruction following and the accuracy of GeoAI systems. Results demonstrate that our model outperforms task-specific models and existing LLMs on diverse geospatial tasks, effectively addressing the multimodality nature while achieving competitive results on the zero-shot geospatial tasks. Our code will be released after publication. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_16326 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | OmniGeo: Towards a Multimodal Large Language Models for Geospatial Artificial Intelligence Yuan, Long Mo, Fengran Huang, Kaiyu Wang, Wenjie Zhai, Wangyuxuan Zhu, Xiaoyu Li, You Xu, Jinan Nie, Jian-Yun Artificial Intelligence The rapid advancement of multimodal large language models (LLMs) has opened new frontiers in artificial intelligence, enabling the integration of diverse large-scale data types such as text, images, and spatial information. In this paper, we explore the potential of multimodal LLMs (MLLM) for geospatial artificial intelligence (GeoAI), a field that leverages spatial data to address challenges in domains including Geospatial Semantics, Health Geography, Urban Geography, Urban Perception, and Remote Sensing. We propose a MLLM (OmniGeo) tailored to geospatial applications, capable of processing and analyzing heterogeneous data sources, including satellite imagery, geospatial metadata, and textual descriptions. By combining the strengths of natural language understanding and spatial reasoning, our model enhances the ability of instruction following and the accuracy of GeoAI systems. Results demonstrate that our model outperforms task-specific models and existing LLMs on diverse geospatial tasks, effectively addressing the multimodality nature while achieving competitive results on the zero-shot geospatial tasks. Our code will be released after publication. |
| title | OmniGeo: Towards a Multimodal Large Language Models for Geospatial Artificial Intelligence |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2503.16326 |