The False Promise of Zero-Shot Super-Resolution in Machine-Learned Operators

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Sakarvadia, Mansi, Hegazy, Kareem, Totounferoush, Amin, Chard, Kyle, Yang, Yaoqing, Foster, Ian, Mahoney, Michael W.
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917298079531008
author Sakarvadia, Mansi
Hegazy, Kareem
Totounferoush, Amin
Chard, Kyle
Yang, Yaoqing
Foster, Ian
Mahoney, Michael W.
author_facet Sakarvadia, Mansi
Hegazy, Kareem
Totounferoush, Amin
Chard, Kyle
Yang, Yaoqing
Foster, Ian
Mahoney, Michael W.
contents A core challenge in scientific machine learning, and scientific computing more generally, is modeling continuous phenomena which (in practice) are represented discretely. Machine-learned operators (MLOs) have been introduced as a means to achieve this modeling goal, as this class of architecture can perform inference at arbitrary resolution. In this work, we evaluate whether this architectural innovation is sufficient to perform "zero-shot super-resolution," namely to enable a model to serve inference on higher-resolution data than that on which it was originally trained. We comprehensively evaluate both zero-shot sub-resolution and super-resolution (i.e., multi-resolution) inference in MLOs. We decouple multi-resolution inference into two key behaviors: 1) extrapolation to varying frequency information; and 2) interpolating across varying resolutions. We empirically demonstrate that MLOs fail to do both of these tasks in a zero-shot manner. Consequently, we find MLOs are not able to perform accurate inference at resolutions different from those on which they were trained, and instead they are brittle and susceptible to aliasing. To address these failure modes, we propose a simple, computationally-efficient, and data-driven multi-resolution training protocol that overcomes aliasing and that provides robust multi-resolution generalization.
format Preprint
id arxiv_https___arxiv_org_abs_2510_06646
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle The False Promise of Zero-Shot Super-Resolution in Machine-Learned Operators
Sakarvadia, Mansi
Hegazy, Kareem
Totounferoush, Amin
Chard, Kyle
Yang, Yaoqing
Foster, Ian
Mahoney, Michael W.
Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
A core challenge in scientific machine learning, and scientific computing more generally, is modeling continuous phenomena which (in practice) are represented discretely. Machine-learned operators (MLOs) have been introduced as a means to achieve this modeling goal, as this class of architecture can perform inference at arbitrary resolution. In this work, we evaluate whether this architectural innovation is sufficient to perform "zero-shot super-resolution," namely to enable a model to serve inference on higher-resolution data than that on which it was originally trained. We comprehensively evaluate both zero-shot sub-resolution and super-resolution (i.e., multi-resolution) inference in MLOs. We decouple multi-resolution inference into two key behaviors: 1) extrapolation to varying frequency information; and 2) interpolating across varying resolutions. We empirically demonstrate that MLOs fail to do both of these tasks in a zero-shot manner. Consequently, we find MLOs are not able to perform accurate inference at resolutions different from those on which they were trained, and instead they are brittle and susceptible to aliasing. To address these failure modes, we propose a simple, computationally-efficient, and data-driven multi-resolution training protocol that overcomes aliasing and that provides robust multi-resolution generalization.
title The False Promise of Zero-Shot Super-Resolution in Machine-Learned Operators
topic Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.06646