SleepLM: Natural-Language Intelligence for Human Sleep

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Xu, Zongzhe, Shuai, Zitao, Mozaffari, Eideen, Aysola, Ravi S., Kumar, Rajesh, Yang, Yuzhe
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914355956678656
author Xu, Zongzhe
Shuai, Zitao
Mozaffari, Eideen
Aysola, Ravi S.
Kumar, Rajesh
Yang, Yuzhe
author_facet Xu, Zongzhe
Shuai, Zitao
Mozaffari, Eideen
Aysola, Ravi S.
Kumar, Rajesh
Yang, Yuzhe
contents We present SleepLM, a family of sleep-language foundation models that enable human sleep alignment, interpretation, and interaction with natural language. Despite the critical role of sleep, learning-based sleep analysis systems operate in closed label spaces (e.g., predefined stages or events) and fail to describe, query, or generalize to novel sleep phenomena. SleepLM bridges natural language and multimodal polysomnography, enabling language-grounded representations of sleep physiology. To support this alignment, we introduce a multilevel sleep caption generation pipeline that enables the curation of the first large-scale sleep-text dataset, comprising over 100K hours of data from more than 10,000 individuals. Furthermore, we present a unified pretraining objective that combines contrastive alignment, caption generation, and signal reconstruction to better capture physiological fidelity and cross-modal interactions. Extensive experiments on real-world sleep understanding tasks verify that SleepLM outperforms state-of-the-art in zero-shot and few-shot learning, cross-modal retrieval, and sleep captioning. Importantly, SleepLM also exhibits intriguing capabilities including language-guided event localization, targeted insight generation, and zero-shot generalization to unseen tasks. All code and data will be open-sourced.
format Preprint
id arxiv_https___arxiv_org_abs_2602_23605
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle SleepLM: Natural-Language Intelligence for Human Sleep
Xu, Zongzhe
Shuai, Zitao
Mozaffari, Eideen
Aysola, Ravi S.
Kumar, Rajesh
Yang, Yuzhe
Artificial Intelligence
We present SleepLM, a family of sleep-language foundation models that enable human sleep alignment, interpretation, and interaction with natural language. Despite the critical role of sleep, learning-based sleep analysis systems operate in closed label spaces (e.g., predefined stages or events) and fail to describe, query, or generalize to novel sleep phenomena. SleepLM bridges natural language and multimodal polysomnography, enabling language-grounded representations of sleep physiology. To support this alignment, we introduce a multilevel sleep caption generation pipeline that enables the curation of the first large-scale sleep-text dataset, comprising over 100K hours of data from more than 10,000 individuals. Furthermore, we present a unified pretraining objective that combines contrastive alignment, caption generation, and signal reconstruction to better capture physiological fidelity and cross-modal interactions. Extensive experiments on real-world sleep understanding tasks verify that SleepLM outperforms state-of-the-art in zero-shot and few-shot learning, cross-modal retrieval, and sleep captioning. Importantly, SleepLM also exhibits intriguing capabilities including language-guided event localization, targeted insight generation, and zero-shot generalization to unseen tasks. All code and data will be open-sourced.
title SleepLM: Natural-Language Intelligence for Human Sleep
topic Artificial Intelligence
url https://arxiv.org/abs/2602.23605