RANGE: Retrieval Augmented Neural Fields for Multi-Resolution Geo-Embeddings

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dhakal, Aayush, Sastry, Srikumar, Khanal, Subash, Ahmad, Adeel, Xing, Eric, Jacobs, Nathan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913775524773888
author Dhakal, Aayush
Sastry, Srikumar
Khanal, Subash
Ahmad, Adeel
Xing, Eric
Jacobs, Nathan
author_facet Dhakal, Aayush
Sastry, Srikumar
Khanal, Subash
Ahmad, Adeel
Xing, Eric
Jacobs, Nathan
contents The choice of representation for geographic location significantly impacts the accuracy of models for a broad range of geospatial tasks, including fine-grained species classification, population density estimation, and biome classification. Recent works like SatCLIP and GeoCLIP learn such representations by contrastively aligning geolocation with co-located images. While these methods work exceptionally well, in this paper, we posit that the current training strategies fail to fully capture the important visual features. We provide an information-theoretic perspective on why the resulting embeddings from these methods discard crucial visual information that is important for many downstream tasks. To solve this problem, we propose a novel retrieval-augmented strategy called RANGE. We build our method on the intuition that the visual features of a location can be estimated by combining the visual features from multiple similar-looking locations. We evaluate our method across a wide variety of tasks. Our results show that RANGE outperforms the existing state-of-the-art models with significant margins in most tasks. We show gains of up to 13.1% on classification tasks and 0.145 $R^2$ on regression tasks. All our code and models will be made available at: https://github.com/mvrl/RANGE.
format Preprint
id arxiv_https___arxiv_org_abs_2502_19781
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RANGE: Retrieval Augmented Neural Fields for Multi-Resolution Geo-Embeddings
Dhakal, Aayush
Sastry, Srikumar
Khanal, Subash
Ahmad, Adeel
Xing, Eric
Jacobs, Nathan
Computer Vision and Pattern Recognition
The choice of representation for geographic location significantly impacts the accuracy of models for a broad range of geospatial tasks, including fine-grained species classification, population density estimation, and biome classification. Recent works like SatCLIP and GeoCLIP learn such representations by contrastively aligning geolocation with co-located images. While these methods work exceptionally well, in this paper, we posit that the current training strategies fail to fully capture the important visual features. We provide an information-theoretic perspective on why the resulting embeddings from these methods discard crucial visual information that is important for many downstream tasks. To solve this problem, we propose a novel retrieval-augmented strategy called RANGE. We build our method on the intuition that the visual features of a location can be estimated by combining the visual features from multiple similar-looking locations. We evaluate our method across a wide variety of tasks. Our results show that RANGE outperforms the existing state-of-the-art models with significant margins in most tasks. We show gains of up to 13.1% on classification tasks and 0.145 $R^2$ on regression tasks. All our code and models will be made available at: https://github.com/mvrl/RANGE.
title RANGE: Retrieval Augmented Neural Fields for Multi-Resolution Geo-Embeddings
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.19781