Lightweight Time Series Data Valuation on Time Series Foundation Models via In-Context Finetuning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wu, Shunyu, Li, Tianyue, Leng, Yixuan, Suo, Jingyi, Lou, Jian, Li, Dan, Ng, See-Kiong
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918380501467136
author Wu, Shunyu
Li, Tianyue
Leng, Yixuan
Suo, Jingyi
Lou, Jian
Li, Dan
Ng, See-Kiong
author_facet Wu, Shunyu
Li, Tianyue
Leng, Yixuan
Suo, Jingyi
Lou, Jian
Li, Dan
Ng, See-Kiong
contents Time series foundation models (TSFMs) have demonstrated increasing capabilities due to their extensive pretraining on large volumes of diverse time series data. Consequently, the quality of time series data is crucial to TSFM performance, rendering an accurate and efficient data valuation of time series for TSFMs indispensable. However, traditional data valuation methods, such as influence functions, face severe computational bottlenecks due to their poor scalability with growing TSFM model sizes and often fail to preserve temporal dependencies. In this paper, we propose LTSV, a Lightweight Time Series Valuation on TSFMS via in-context finetuning. Grounded in the theoretical evidence that in-context finetuning approximates the influence function, LTSV estimates a sample's contribution by measuring the change in context loss after in-context finetuning, leveraging the strong generalization capabilities of TSFMs to produce robust and transferable data valuations. To capture temporal dependencies, we introduce temporal block aggregation, which integrates per-block influence scores across overlapping time windows. Experiments across multiple time series datasets and models demonstrate that LTSV consistently provides reliable and strong valuation performance, while maintaining manageable computational requirements. Our results suggest that in-context finetuning on time series foundation models provides a practical and effective bridge between data attribution and model generalization in time series learning.
format Preprint
id arxiv_https___arxiv_org_abs_2511_11648
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Lightweight Time Series Data Valuation on Time Series Foundation Models via In-Context Finetuning
Wu, Shunyu
Li, Tianyue
Leng, Yixuan
Suo, Jingyi
Lou, Jian
Li, Dan
Ng, See-Kiong
Machine Learning
Artificial Intelligence
Time series foundation models (TSFMs) have demonstrated increasing capabilities due to their extensive pretraining on large volumes of diverse time series data. Consequently, the quality of time series data is crucial to TSFM performance, rendering an accurate and efficient data valuation of time series for TSFMs indispensable. However, traditional data valuation methods, such as influence functions, face severe computational bottlenecks due to their poor scalability with growing TSFM model sizes and often fail to preserve temporal dependencies. In this paper, we propose LTSV, a Lightweight Time Series Valuation on TSFMS via in-context finetuning. Grounded in the theoretical evidence that in-context finetuning approximates the influence function, LTSV estimates a sample's contribution by measuring the change in context loss after in-context finetuning, leveraging the strong generalization capabilities of TSFMs to produce robust and transferable data valuations. To capture temporal dependencies, we introduce temporal block aggregation, which integrates per-block influence scores across overlapping time windows. Experiments across multiple time series datasets and models demonstrate that LTSV consistently provides reliable and strong valuation performance, while maintaining manageable computational requirements. Our results suggest that in-context finetuning on time series foundation models provides a practical and effective bridge between data attribution and model generalization in time series learning.
title Lightweight Time Series Data Valuation on Time Series Foundation Models via In-Context Finetuning
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2511.11648