TRACE: A Generalizable Drift Detector for Streaming Data-Driven Optimization

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhong, Yuan-Ting, Huang, Ting, Xiao, Xiaolin, Gong, Yue-Jiao
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914186056957952
author Zhong, Yuan-Ting
Huang, Ting
Xiao, Xiaolin
Gong, Yue-Jiao
author_facet Zhong, Yuan-Ting
Huang, Ting
Xiao, Xiaolin
Gong, Yue-Jiao
contents Many optimization tasks involve streaming data with unknown concept drifts, posing a significant challenge as Streaming Data-Driven Optimization (SDDO). Existing methods, while leveraging surrogate model approximation and historical knowledge transfer, are often under restrictive assumptions such as fixed drift intervals and fully environmental observability, limiting their adaptability to diverse dynamic environments. We propose TRACE, a TRAnsferable C}oncept-drift Estimator that effectively detects distributional changes in streaming data with varying time scales. TRACE leverages a principled tokenization strategy to extract statistical features from data streams and models drift patterns using attention-based sequence learning, enabling accurate detection on unseen datasets and highlighting the transferability of learned drift patterns. Further, we showcase TRACE's plug-and-play nature by integrating it into a streaming optimizer, facilitating adaptive optimization under unknown drifts. Comprehensive experimental results on diverse benchmarks demonstrate the superior generalization, robustness, and effectiveness of our approach in SDDO scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2512_07082
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle TRACE: A Generalizable Drift Detector for Streaming Data-Driven Optimization
Zhong, Yuan-Ting
Huang, Ting
Xiao, Xiaolin
Gong, Yue-Jiao
Machine Learning
Many optimization tasks involve streaming data with unknown concept drifts, posing a significant challenge as Streaming Data-Driven Optimization (SDDO). Existing methods, while leveraging surrogate model approximation and historical knowledge transfer, are often under restrictive assumptions such as fixed drift intervals and fully environmental observability, limiting their adaptability to diverse dynamic environments. We propose TRACE, a TRAnsferable C}oncept-drift Estimator that effectively detects distributional changes in streaming data with varying time scales. TRACE leverages a principled tokenization strategy to extract statistical features from data streams and models drift patterns using attention-based sequence learning, enabling accurate detection on unseen datasets and highlighting the transferability of learned drift patterns. Further, we showcase TRACE's plug-and-play nature by integrating it into a streaming optimizer, facilitating adaptive optimization under unknown drifts. Comprehensive experimental results on diverse benchmarks demonstrate the superior generalization, robustness, and effectiveness of our approach in SDDO scenarios.
title TRACE: A Generalizable Drift Detector for Streaming Data-Driven Optimization
topic Machine Learning
url https://arxiv.org/abs/2512.07082