Limits of Resolution Equivariance in Fourier Neural Operators

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Colagrande, Alex, Caillon, Paul, Feillet, Eva, Allauzen, Alexandre
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916070568230912
author Colagrande, Alex
Caillon, Paul
Feillet, Eva
Allauzen, Alexandre
author_facet Colagrande, Alex
Caillon, Paul
Feillet, Eva
Allauzen, Alexandre
contents Fourier Neural Operators are often assumed to generalize across spatial resolutions, enabling training on a coarse grid and deployment on a finer grid. We test this assumption by contrasting two inference-time choices when moving from training resolution $s$ to test resolution $S>s$: running FNO directly at $S$, or running at $s$ and upsampling the prediction to $S$ via Fourier zero-padding. On Darcy flow, we observe that direct fine-grid inference is not reliably beneficial and can be worse than the low-grid-plus-upsampling baseline. We further analyze layerwise spectra and find that, under Fourier truncation, intermediate representations increasingly concentrate energy in low frequencies, with high-frequency output produced mainly by late nonlinear/decoder stages. This offers a mechanistic explanation for why FNO can perform well while retaining few modes, yet remain sensitive under resolution shifts. Our findings highlight a simple but strong baseline for cross-resolution evaluation and point to nonlinear aliasing as a key obstacle to zero-shot resolution equivariance.
format Preprint
id arxiv_https___arxiv_org_abs_2606_00677
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Limits of Resolution Equivariance in Fourier Neural Operators
Colagrande, Alex
Caillon, Paul
Feillet, Eva
Allauzen, Alexandre
Machine Learning
Fourier Neural Operators are often assumed to generalize across spatial resolutions, enabling training on a coarse grid and deployment on a finer grid. We test this assumption by contrasting two inference-time choices when moving from training resolution $s$ to test resolution $S>s$: running FNO directly at $S$, or running at $s$ and upsampling the prediction to $S$ via Fourier zero-padding. On Darcy flow, we observe that direct fine-grid inference is not reliably beneficial and can be worse than the low-grid-plus-upsampling baseline. We further analyze layerwise spectra and find that, under Fourier truncation, intermediate representations increasingly concentrate energy in low frequencies, with high-frequency output produced mainly by late nonlinear/decoder stages. This offers a mechanistic explanation for why FNO can perform well while retaining few modes, yet remain sensitive under resolution shifts. Our findings highlight a simple but strong baseline for cross-resolution evaluation and point to nonlinear aliasing as a key obstacle to zero-shot resolution equivariance.
title Limits of Resolution Equivariance in Fourier Neural Operators
topic Machine Learning
url https://arxiv.org/abs/2606.00677