Saved in:
Bibliographic Details
Main Authors: Laglil, Morad, Devijver, Emilie, Gaussier, Eric, Pracca, Bertrand
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2511.22674
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915642804797440
author Laglil, Morad
Devijver, Emilie
Gaussier, Eric
Pracca, Bertrand
author_facet Laglil, Morad
Devijver, Emilie
Gaussier, Eric
Pracca, Bertrand
contents Inspired by recent advances in large language models, foundation models have been developed for zero-shot time series forecasting, enabling prediction on datasets unseen during pretraining. These large-scale models, trained on vast collections of time series, learn generalizable representations for both point and probabilistic forecasting, reducing the need for task-specific architectures and manual tuning. In this work, we review the main architectures, pretraining strategies, and optimization methods used in such models, and study the effect of fine-tuning after pretraining to enhance their performance on specific datasets. Our empirical results show that fine-tuning generally improves zero-shot forecasting capabilities, especially for long-term horizons.
format Preprint
id arxiv_https___arxiv_org_abs_2511_22674
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Modèles de Fondation et Ajustement : Vers une Nouvelle Génération de Modèles pour la Prévision des Séries Temporelles
Laglil, Morad
Devijver, Emilie
Gaussier, Eric
Pracca, Bertrand
Machine Learning
Inspired by recent advances in large language models, foundation models have been developed for zero-shot time series forecasting, enabling prediction on datasets unseen during pretraining. These large-scale models, trained on vast collections of time series, learn generalizable representations for both point and probabilistic forecasting, reducing the need for task-specific architectures and manual tuning. In this work, we review the main architectures, pretraining strategies, and optimization methods used in such models, and study the effect of fine-tuning after pretraining to enhance their performance on specific datasets. Our empirical results show that fine-tuning generally improves zero-shot forecasting capabilities, especially for long-term horizons.
title Modèles de Fondation et Ajustement : Vers une Nouvelle Génération de Modèles pour la Prévision des Séries Temporelles
topic Machine Learning
url https://arxiv.org/abs/2511.22674