Federated Time Series Generation on Feature and Temporally Misaligned Data

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Soi, Zhi Wen, Fan, Chenrui, Shankar, Aditya, Mălan, Abele, Chen, Lydia Y.
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909736162557952
author Soi, Zhi Wen
Fan, Chenrui
Shankar, Aditya
Mălan, Abele
Chen, Lydia Y.
author_facet Soi, Zhi Wen
Fan, Chenrui
Shankar, Aditya
Mălan, Abele
Chen, Lydia Y.
contents Distributed time series data presents a challenge for federated learning, as clients often possess different feature sets and have misaligned time steps. Existing federated time series models are limited by the assumption of perfect temporal or feature alignment across clients. In this paper, we propose FedTDD, a novel federated time series diffusion model that jointly learns a synthesizer across clients. At the core of FedTDD is a novel data distillation and aggregation framework that reconciles the differences between clients by imputing the misaligned timesteps and features. In contrast to traditional federated learning, FedTDD learns the correlation across clients' time series through the exchange of local synthetic outputs instead of model parameters. A coordinator iteratively improves a global distiller network by leveraging shared knowledge from clients through the exchange of synthetic data. As the distiller becomes more refined over time, it subsequently enhances the quality of the clients' local feature estimates, allowing each client to then improve its local imputations for missing data using the latest, more accurate distiller. Experimental results on five datasets demonstrate FedTDD's effectiveness compared to centralized training, and the effectiveness of sharing synthetic outputs to transfer knowledge of local time series. Notably, FedTDD achieves 79.4% and 62.8% improvement over local training in Context-FID and Correlational scores.
format Preprint
id arxiv_https___arxiv_org_abs_2410_21072
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Federated Time Series Generation on Feature and Temporally Misaligned Data
Soi, Zhi Wen
Fan, Chenrui
Shankar, Aditya
Mălan, Abele
Chen, Lydia Y.
Machine Learning
Distributed, Parallel, and Cluster Computing
Distributed time series data presents a challenge for federated learning, as clients often possess different feature sets and have misaligned time steps. Existing federated time series models are limited by the assumption of perfect temporal or feature alignment across clients. In this paper, we propose FedTDD, a novel federated time series diffusion model that jointly learns a synthesizer across clients. At the core of FedTDD is a novel data distillation and aggregation framework that reconciles the differences between clients by imputing the misaligned timesteps and features. In contrast to traditional federated learning, FedTDD learns the correlation across clients' time series through the exchange of local synthetic outputs instead of model parameters. A coordinator iteratively improves a global distiller network by leveraging shared knowledge from clients through the exchange of synthetic data. As the distiller becomes more refined over time, it subsequently enhances the quality of the clients' local feature estimates, allowing each client to then improve its local imputations for missing data using the latest, more accurate distiller. Experimental results on five datasets demonstrate FedTDD's effectiveness compared to centralized training, and the effectiveness of sharing synthetic outputs to transfer knowledge of local time series. Notably, FedTDD achieves 79.4% and 62.8% improvement over local training in Context-FID and Correlational scores.
title Federated Time Series Generation on Feature and Temporally Misaligned Data
topic Machine Learning
Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2410.21072