Private Vertical Federated Inference for Time-Series

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Fenaux, Lucas, Xie, Larris, Bang, Aditya, Zhang, Alex, Wilson, Kevin, Kerschbaum, Florian
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910202883735552
author Fenaux, Lucas
Xie, Larris
Bang, Aditya
Zhang, Alex
Wilson, Kevin
Kerschbaum, Florian
author_facet Fenaux, Lucas
Xie, Larris
Bang, Aditya
Zhang, Alex
Wilson, Kevin
Kerschbaum, Florian
contents Institutions may benefit from collaborative inference on time-series data. In settings where privacy is necessary, multi-party computation (MPC) is a straightforward approach to providing strong guarantees, yet it remains prohibitively expensive and scales poorly with modern transformer architectures. Vertical Federated Learning (VFL) offers efficiency but suffers from privacy leakage at the embedding level, and securing the entire VFL model head via MPC remains prohibitively slow and communication-heavy for larger models. To enable practical, secure inference at scale, we propose "Public/Private Hybrid Head-VFL" (PPHH-VFL). This hybrid architecture splits the model head into an efficient plaintext public head and a secure, lightweight MPC private head. By applying adversarial training to the public embeddings, we mitigate privacy leakage; concurrently, the small private head securely preserves the flow of sensitive information needed for high downstream utility. Empirical evaluations on models ranging up to 86 million parameters demonstrate that PPHH-VFL accelerates inference by up to six orders of magnitude compared to end-to-end MPC. Compared to a standard VFL+MPC baseline, our approach scales significantly better, achieving a speedup of up to 44.4x in WAN and a 91.2x reduction in communication costs (dropping from 1.7 GB to 19 MB per batch), while simultaneously improving downstream classification accuracy by 2.50% and regression RMSE by 40.7%.
format Preprint
id arxiv_https___arxiv_org_abs_2605_08343
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Private Vertical Federated Inference for Time-Series
Fenaux, Lucas
Xie, Larris
Bang, Aditya
Zhang, Alex
Wilson, Kevin
Kerschbaum, Florian
Machine Learning
Cryptography and Security
Distributed, Parallel, and Cluster Computing
Primary 68T07, Secondary 68P27, 94A60, 68M14, 62M10
Institutions may benefit from collaborative inference on time-series data. In settings where privacy is necessary, multi-party computation (MPC) is a straightforward approach to providing strong guarantees, yet it remains prohibitively expensive and scales poorly with modern transformer architectures. Vertical Federated Learning (VFL) offers efficiency but suffers from privacy leakage at the embedding level, and securing the entire VFL model head via MPC remains prohibitively slow and communication-heavy for larger models. To enable practical, secure inference at scale, we propose "Public/Private Hybrid Head-VFL" (PPHH-VFL). This hybrid architecture splits the model head into an efficient plaintext public head and a secure, lightweight MPC private head. By applying adversarial training to the public embeddings, we mitigate privacy leakage; concurrently, the small private head securely preserves the flow of sensitive information needed for high downstream utility. Empirical evaluations on models ranging up to 86 million parameters demonstrate that PPHH-VFL accelerates inference by up to six orders of magnitude compared to end-to-end MPC. Compared to a standard VFL+MPC baseline, our approach scales significantly better, achieving a speedup of up to 44.4x in WAN and a 91.2x reduction in communication costs (dropping from 1.7 GB to 19 MB per batch), while simultaneously improving downstream classification accuracy by 2.50% and regression RMSE by 40.7%.
title Private Vertical Federated Inference for Time-Series
topic Machine Learning
Cryptography and Security
Distributed, Parallel, and Cluster Computing
Primary 68T07, Secondary 68P27, 94A60, 68M14, 62M10
url https://arxiv.org/abs/2605.08343