Learning What's Real: Disentangling Signal and Measurement Artifacts in Multi-Sensor Data, with Applications to Astrophysics

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Mercader-Perez, Pablo, Cuesta-Lazaro, Carolina, Muthukrishna, Daniel, Audenaert, Jeroen, Villar, V. Ashley, Hogg, David W., Huertas-Company, Marc, Freeman, William T.
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913022212046848
author Mercader-Perez, Pablo
Cuesta-Lazaro, Carolina
Muthukrishna, Daniel
Audenaert, Jeroen
Villar, V. Ashley
Hogg, David W.
Huertas-Company, Marc
Freeman, William T.
author_facet Mercader-Perez, Pablo
Cuesta-Lazaro, Carolina
Muthukrishna, Daniel
Audenaert, Jeroen
Villar, V. Ashley
Hogg, David W.
Huertas-Company, Marc
Freeman, William T.
contents Data collected from the physical world is always a combination of multiple sources: an underlying signal from the physical process of interest and a signal from measurement-dependent artifacts from the sensor or instrument. This secondary signal acts as a confounding factor, limiting our ability to extract information about the physics underlying the phenomena we observe. Furthermore, it complicates the combination of observations in heterogeneous or multi-instrument settings. We propose a deep learning framework that leverages overlapping observations, a dual-encoder architecture, and a counterfactual generation objective to disentangle these factors of variation. The resulting representations explicitly separate intrinsic signals from sensor-specific distortions and noise, and can be used for counterfactual view generation, parameter inference unconfounded by measurement distortions, and instrument-independent similarity search. We demonstrate the effectiveness of our approach on astrophysical galaxy images from the DESI Legacy Imaging Survey (Legacy) and the Hyper Suprime-Cam (HSC) Survey as a representative multi-instrument setting. This framework provides a general recipe for scientific and multi-modal self-supervised pretraining: construct training pairs from overlapping observations of the same physical system, treat sensor- or modality-specific effects as augmentations, and learn invariant representations through counterfactual generation.
format Preprint
id arxiv_https___arxiv_org_abs_2604_09787
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Learning What's Real: Disentangling Signal and Measurement Artifacts in Multi-Sensor Data, with Applications to Astrophysics
Mercader-Perez, Pablo
Cuesta-Lazaro, Carolina
Muthukrishna, Daniel
Audenaert, Jeroen
Villar, V. Ashley
Hogg, David W.
Huertas-Company, Marc
Freeman, William T.
Instrumentation and Methods for Astrophysics
Astrophysics of Galaxies
Machine Learning
Data collected from the physical world is always a combination of multiple sources: an underlying signal from the physical process of interest and a signal from measurement-dependent artifacts from the sensor or instrument. This secondary signal acts as a confounding factor, limiting our ability to extract information about the physics underlying the phenomena we observe. Furthermore, it complicates the combination of observations in heterogeneous or multi-instrument settings. We propose a deep learning framework that leverages overlapping observations, a dual-encoder architecture, and a counterfactual generation objective to disentangle these factors of variation. The resulting representations explicitly separate intrinsic signals from sensor-specific distortions and noise, and can be used for counterfactual view generation, parameter inference unconfounded by measurement distortions, and instrument-independent similarity search. We demonstrate the effectiveness of our approach on astrophysical galaxy images from the DESI Legacy Imaging Survey (Legacy) and the Hyper Suprime-Cam (HSC) Survey as a representative multi-instrument setting. This framework provides a general recipe for scientific and multi-modal self-supervised pretraining: construct training pairs from overlapping observations of the same physical system, treat sensor- or modality-specific effects as augmentations, and learn invariant representations through counterfactual generation.
title Learning What's Real: Disentangling Signal and Measurement Artifacts in Multi-Sensor Data, with Applications to Astrophysics
topic Instrumentation and Methods for Astrophysics
Astrophysics of Galaxies
Machine Learning
url https://arxiv.org/abs/2604.09787