Cover Image

Pretrain Where? Investigating How Pretraining Data Diversity Impacts Geospatial Foundation Model Performance

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kaur, Amandeep, Purohit, Mirali, Muhawenayo, Gedeon, Rolf, Esther, Kerner, Hannah
Format:	Preprint
Published:	2026
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

How Does the Spatial Distribution of Pre-training Data Affect Geospatial Foundation Models?
by: Purohit, Mirali, et al.
Published: (2025)

Mars-Bench: A Benchmark for Evaluating Foundation Models for Mars Science Tasks
by: Purohit, Mirali, et al.
Published: (2025)

MOMO: Mars Orbital Model Foundation Model for Mars Orbital Applications
by: Purohit, Mirali, et al.
Published: (2026)

Mission Critical -- Satellite Data is a Distinct Modality in Machine Learning
by: Rolf, Esther, et al.
Published: (2024)

Lightweight, Pre-trained Transformers for Remote Sensing Timeseries
by: Tseng, Gabriel, et al.
Published: (2023)

On Pretraining Data Diversity for Self-Supervised Learning
by: Hammoud, Hasan Abed Al Kader, et al.
Published: (2024)

PRUE: A Practical Recipe for Field Boundary Segmentation at Scale
by: Muhawenayo, Gedeon, et al.
Published: (2026)

The first global agricultural field boundary map at 10m resolution
by: Robinson, Caleb, et al.
Published: (2026)

Foundation Model-oriented Robustness: Robust Image Model Evaluation with Pretrained Models
by: Zhang, Peiyan, et al.
Published: (2023)

Classification Drives Geographic Bias in Street Scene Segmentation
by: Nair, Rahul, et al.
Published: (2024)

An All-MLP Sequence Modeling Architecture That Excels at Copying
by: Cui, Chenwei, et al.
Published: (2024)

Cropland Mapping using Geospatial Embeddings
by: Zvonkov, Ivan, et al.
Published: (2025)

No One Knows the State of the Art in Geospatial Foundation Models
by: Corley, Isaac, et al.
Published: (2026)

Learning to Read Where to Look: Disease-Aware Vision-Language Pretraining for 3D CT
by: Ging, Simon, et al.
Published: (2026)

Impact of Pretraining Word Co-occurrence on Compositional Generalization in Multimodal Models
by: Qu, Helen, et al.
Published: (2025)

Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model
by: Roth, Karsten, et al.
Published: (2023)

Towards Knowledge Guided Pretraining Approaches for Multimodal Foundation Models: Applications in Remote Sensing
by: Ravirathinam, Praveen, et al.
Published: (2024)

Simplifying Knowledge Transfer in Pretrained Models
by: Jain, Siddharth, et al.
Published: (2025)

Modeling Caption Diversity in Contrastive Vision-Language Pretraining
by: Lavoie, Samuel, et al.
Published: (2024)

TerraTorch: The Geospatial Foundation Models Toolkit
by: Gomes, Carlos, et al.
Published: (2025)

Pretrained Visual Uncertainties
by: Kirchhof, Michael, et al.
Published: (2024)

Scaling Video Pretraining for Surgical Foundation Models
by: Lu, Sicheng, et al.
Published: (2026)

Underrepresented in Foundation Model Pretraining Data? A One-Shot Probe
by: Vorster, Chris, et al.
Published: (2026)

No "Zero-Shot" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance
by: Udandarao, Vishaal, et al.
Published: (2024)

Accelerating Augmentation Invariance Pretraining
by: Lin, Jinhong, et al.
Published: (2024)

Pretrained Diffusion Models Are Inherently Skipped-Step Samplers
by: Xu, Wenju
Published: (2025)

Pretrained Image-Text Models are Secretly Video Captioners
by: Zhang, Chunhui, et al.
Published: (2025)

Generative Event Pretraining with Foundation Model Alignment
by: Cao, Jianwen, et al.
Published: (2026)

Filter Like You Test: Data-Driven Data Filtering for CLIP Pretraining
by: Shechter, Mikey, et al.
Published: (2025)

Visual Instruction Pretraining for Domain-Specific Foundation Models
by: Li, Yuxuan, et al.
Published: (2025)

Renaissance: Investigating the Pretraining of Vision-Language Encoders
by: Fields, Clayton, et al.
Published: (2024)

Multi-Region Transfer Learning for Segmentation of Crop Field Boundaries in Satellite Images with Limited Labels
by: Kerner, Hannah, et al.
Published: (2024)

DPA: A one-stop metric to measure bias amplification in classification datasets
by: Tokas, Bhanu, et al.
Published: (2024)

Evaluating and Benchmarking Foundation Models for Earth Observation and Geospatial AI
by: Dionelis, Nikolaos, et al.
Published: (2024)

Geospatial Foundation Models to Enable Progress on Sustainable Development Goals
by: Ghamisi, Pedram, et al.
Published: (2025)

Polyp Segmentation Generalisability of Pretrained Backbones
by: Sanderson, Edward, et al.
Published: (2024)

Medical Semantic Segmentation with Diffusion Pretrain
by: Li, David, et al.
Published: (2025)

Data-Efficient Contrastive Language-Image Pretraining: Prioritizing Data Quality over Quantity
by: Joshi, Siddharth, et al.
Published: (2024)

Reflecting on the State of Rehearsal-free Continual Learning with Pretrained Models
by: Thede, Lukas, et al.
Published: (2024)

Enhanced Spatiotemporal Consistency for Image-to-LiDAR Data Pretraining
by: Xu, Xiang, et al.
Published: (2025)