In-context learning enables continental-scale subsurface temperature prediction from sparse local observations

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: O'Malley, Daniel, Johnson, Christopher W., Santos, Javier E., Lara, Pablo, Malusà, Sandro, Srikishan, Bharat, Kath, John, Mazumder, Arnab, Mehana, Mohamed, Coblentz, David, DeBardeleben, Nathan, Lawrence, Earl, Viswanathan, Hari
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909049200574464
author O'Malley, Daniel
Johnson, Christopher W.
Santos, Javier E.
Lara, Pablo
Malusà, Sandro
Srikishan, Bharat
Kath, John
Mazumder, Arnab
Mehana, Mohamed
Coblentz, David
DeBardeleben, Nathan
Lawrence, Earl
Viswanathan, Hari
author_facet O'Malley, Daniel
Johnson, Christopher W.
Santos, Javier E.
Lara, Pablo
Malusà, Sandro
Srikishan, Bharat
Kath, John
Mazumder, Arnab
Mehana, Mohamed
Coblentz, David
DeBardeleben, Nathan
Lawrence, Earl
Viswanathan, Hari
contents Continental-scale knowledge of subsurface temperature is limited by the cost and sparsity of borehole measurements, but such information is essential for geothermal resource assessment and for understanding heat transport in the shallow crust. The thermal field reflects the interaction between lithology, crustal structure, radiogenic heat production, and advective fluid flow, sometimes producing sharp anomalies that are smoothed by conventional interpolation or difficult to capture with physical models. Here we introduce In-Context Earth, a transformer-based model that uses sparse local borehole observations as geological context to predict continuous temperature-at-depth fields with calibrated uncertainty. In the contiguous United States, the model achieves a mean absolute error of 4.7 °C, outperforming the physics-informed Stanford Thermal Model, a model based on AlphaEarth embeddings, the multimodal Transparent Earth model, and universal kriging, while resolving sharper thermal gradients in geothermal provinces. Its uncertainty estimates are well calibrated, with a Kolmogorov-Smirnov statistic of 2.5%. Without finetuning, the model adapts to Alberta, Australia, and the United Kingdom (UK) using only 20 local observations at inference time, maintaining high accuracy in geologically distinct test regions with a mean absolute error of 2.2 °C in Alberta, 6.2 °C in Australia, and 5.4 °C in the UK. Interpretability analyses show that the model learns internal representations of subsurface properties it never observes during training, including seismic velocities, geochemistry, and crustal structure, and uses these representations in physically consistent ways. More broadly, this work shows that in-context learning can use sparse borehole observations for continental-scale subsurface characterization, without requiring dense measurements or region-specific retraining.
format Preprint
id arxiv_https___arxiv_org_abs_2605_16665
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle In-context learning enables continental-scale subsurface temperature prediction from sparse local observations
O'Malley, Daniel
Johnson, Christopher W.
Santos, Javier E.
Lara, Pablo
Malusà, Sandro
Srikishan, Bharat
Kath, John
Mazumder, Arnab
Mehana, Mohamed
Coblentz, David
DeBardeleben, Nathan
Lawrence, Earl
Viswanathan, Hari
Machine Learning
Geophysics
Continental-scale knowledge of subsurface temperature is limited by the cost and sparsity of borehole measurements, but such information is essential for geothermal resource assessment and for understanding heat transport in the shallow crust. The thermal field reflects the interaction between lithology, crustal structure, radiogenic heat production, and advective fluid flow, sometimes producing sharp anomalies that are smoothed by conventional interpolation or difficult to capture with physical models. Here we introduce In-Context Earth, a transformer-based model that uses sparse local borehole observations as geological context to predict continuous temperature-at-depth fields with calibrated uncertainty. In the contiguous United States, the model achieves a mean absolute error of 4.7 °C, outperforming the physics-informed Stanford Thermal Model, a model based on AlphaEarth embeddings, the multimodal Transparent Earth model, and universal kriging, while resolving sharper thermal gradients in geothermal provinces. Its uncertainty estimates are well calibrated, with a Kolmogorov-Smirnov statistic of 2.5%. Without finetuning, the model adapts to Alberta, Australia, and the United Kingdom (UK) using only 20 local observations at inference time, maintaining high accuracy in geologically distinct test regions with a mean absolute error of 2.2 °C in Alberta, 6.2 °C in Australia, and 5.4 °C in the UK. Interpretability analyses show that the model learns internal representations of subsurface properties it never observes during training, including seismic velocities, geochemistry, and crustal structure, and uses these representations in physically consistent ways. More broadly, this work shows that in-context learning can use sparse borehole observations for continental-scale subsurface characterization, without requiring dense measurements or region-specific retraining.
title In-context learning enables continental-scale subsurface temperature prediction from sparse local observations
topic Machine Learning
Geophysics
url https://arxiv.org/abs/2605.16665