PSDNorm: Test-Time Temporal Normalization for Deep Learning in Sleep Staging

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Gnassounou, Théo, Collas, Antoine, Flamary, Rémi, Gramfort, Alexandre
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914293893562368
author Gnassounou, Théo
Collas, Antoine
Flamary, Rémi
Gramfort, Alexandre
author_facet Gnassounou, Théo
Collas, Antoine
Flamary, Rémi
Gramfort, Alexandre
contents Distribution shift poses a significant challenge in machine learning, particularly in biomedical applications using data collected across different subjects, institutions, and recording devices, such as sleep data. While existing normalization layers, BatchNorm, LayerNorm and InstanceNorm, help mitigate distribution shifts, when applied over the time dimension they ignore the dependencies and auto-correlation inherent to the vector coefficients they normalize. In this paper, we propose PSDNorm that leverages Monge mapping and temporal context to normalize feature maps in deep learning models for signals. Evaluations with architectures based on U-Net or transformer backbones trained on 10K subjects across 10 datasets, show that PSDNorm achieves state-of-the-art performance on unseen left-out datasets while being more robust to data scarcity.
format Preprint
id arxiv_https___arxiv_org_abs_2503_04582
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PSDNorm: Test-Time Temporal Normalization for Deep Learning in Sleep Staging
Gnassounou, Théo
Collas, Antoine
Flamary, Rémi
Gramfort, Alexandre
Machine Learning
Distribution shift poses a significant challenge in machine learning, particularly in biomedical applications using data collected across different subjects, institutions, and recording devices, such as sleep data. While existing normalization layers, BatchNorm, LayerNorm and InstanceNorm, help mitigate distribution shifts, when applied over the time dimension they ignore the dependencies and auto-correlation inherent to the vector coefficients they normalize. In this paper, we propose PSDNorm that leverages Monge mapping and temporal context to normalize feature maps in deep learning models for signals. Evaluations with architectures based on U-Net or transformer backbones trained on 10K subjects across 10 datasets, show that PSDNorm achieves state-of-the-art performance on unseen left-out datasets while being more robust to data scarcity.
title PSDNorm: Test-Time Temporal Normalization for Deep Learning in Sleep Staging
topic Machine Learning
url https://arxiv.org/abs/2503.04582