Imagen de Portada

Pretraining Billion-scale Geospatial Foundational Models on Frontier

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Tsaris, Aristeidis, Dias, Philipe Ambrozio, Potnis, Abhishek, Yin, Junqi, Wang, Feiyi, Lunga, Dalton
Formato:	Preprint
Publicado:	2024
Materias:	Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery
por: Dias, Philipe, et al.
Publicado: (2024)

Scalable Artificial Intelligence for Science: Perspectives, Methods and Exemplars
por: Brewer, Wesley, et al.
Publicado: (2024)

SciTrust 2.0: A Comprehensive Framework for Evaluating Trustworthiness of Large Language Models in Scientific Applications
por: Herron, Emily, et al.
Publicado: (2025)

ORBIT: Oak Ridge Base Foundation Model for Earth System Predictability
por: Wang, Xiao, et al.
Publicado: (2024)

SimLBR: Learning to Detect Fake Images by Learning to Detect Real Images
por: Dhakal, Aayush, et al.
Publicado: (2026)

Decoding Memories: An Efficient Pipeline for Self-Consistency Hallucination Detection
por: Gao, Weizhi, et al.
Publicado: (2025)

Scaling Up Data Parallelism in Decentralized Deep Learning
por: Xie, Bing, et al.
Publicado: (2025)

Billion-Scale Graph Foundation Models
por: Bechler-Speicher, Maya, et al.
Publicado: (2026)

A Billion-scale Foundation Model for Remote Sensing Images
por: Cha, Keumgang, et al.
Publicado: (2023)

FOCUS: Fused Observation of Channels for Unveiling Spectra
por: Xiao, Xi, et al.
Publicado: (2025)

Timer-S1: A Billion-Scale Time Series Foundation Model with Serial Scaling
por: Liu, Yong, et al.
Publicado: (2026)

Zenith: Scaling up Ranking Models for Billion-scale Livestreaming Recommendation
por: Zhang, Ruifeng, et al.
Publicado: (2026)

MathPile: A Billion-Token-Scale Pretraining Corpus for Math
por: Wang, Zengzhi, et al.
Publicado: (2023)

Fine-tuning of Geospatial Foundation Models for Aboveground Biomass Estimation
por: Muszynski, Michal, et al.
Publicado: (2024)

Sequence Length Scaling in Vision Transformers for Scientific Images on Frontier
por: Tsaris, Aristeidis, et al.
Publicado: (2024)

Krutrim LLM: Multilingual Foundational Model for over a Billion People
por: Kallappa, Aditya, et al.
Publicado: (2025)

Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts
por: Shi, Xiaoming, et al.
Publicado: (2024)

Earth AI: Unlocking Geospatial Insights with Foundation Models and Cross-Modal Reasoning
por: Bell, Aaron, et al.
Publicado: (2025)

Governing AI Beyond the Pretraining Frontier
por: Caputo, Nicholas A.
Publicado: (2025)

Distributed Cross-Channel Hierarchical Aggregation for Foundation Models
por: Tsaris, Aristeidis, et al.
Publicado: (2025)

Tula: Optimizing Time, Cost, and Generalization in Distributed Large-Batch Training
por: Tyagi, Sahil, et al.
Publicado: (2026)

Towards Billion-scale Multi-modal Biometric Search
por: Koner, Arka, et al.
Publicado: (2026)

Foundations and Frontiers of Graph Learning Theory
por: Huang, Yu, et al.
Publicado: (2024)

AttestLLM: Efficient Attestation Framework for Billion-scale On-device LLMs
por: Zhang, Ruisi, et al.
Publicado: (2025)

Bridging Remote Sensors with Multisensor Geospatial Foundation Models
por: Han, Boran, et al.
Publicado: (2024)

First On-Orbit Demonstration of a Geospatial Foundation Model
por: Du, Andrew, et al.
Publicado: (2025)

Game-TARS: Pretrained Foundation Models for Scalable Generalist Multimodal Game Agents
por: Wang, Zihao, et al.
Publicado: (2025)

Piper: Efficient Large-Scale MoE Training via Resource Modeling and Pipelined Hybrid Parallelism
por: Dash, Sajal, et al.
Publicado: (2026)

Jailbreaking Frontier Foundation Models Through Intention Deception
por: Wang, Xinhe, et al.
Publicado: (2026)

Towards Scalable Foundation Model for Multi-modal and Hyperspectral Geospatial Data
por: Si, Haozhe, et al.
Publicado: (2025)

Undermining Image and Text Classification Algorithms Using Adversarial Attacks
por: Lunga, Langalibalele, et al.
Publicado: (2024)

Diffusion-Guided Pretraining for Brain Graph Foundation Models
por: Wei, Xinxu, et al.
Publicado: (2026)

Nemotron-CC-Math: A 133 Billion-Token-Scale High Quality Math Pretraining Dataset
por: Mahabadi, Rabeeh Karimi, et al.
Publicado: (2025)

Utilizing a Geospatial Foundation Model for Coastline Delineation in Small Sandy Islands
por: Chhabra, Tishya, et al.
Publicado: (2025)

Deploying Geospatial Foundation Models in the Real World: Lessons from WorldCereal
por: Butsko, Christina, et al.
Publicado: (2025)

Fostering Intrinsic Motivation in Reinforcement Learning with Pretrained Foundation Models
por: Andres, Alain, et al.
Publicado: (2024)

Cross-Scenario Unified Modeling of User Interests at Billion Scale
por: Xu, Manjie, et al.
Publicado: (2025)

Geospatial Knowledge Graphs
por: Zhu, Rui
Publicado: (2024)

Pretraining a Foundation Model for Small-Molecule Natural Products
por: Ding, Yuheng, et al.
Publicado: (2025)

Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment
por: Agarwalla, Abhinav, et al.
Publicado: (2024)