Conformalized Neural Networks for Federated Uncertainty Quantification under Dual Heterogeneity

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Nguyen, Quang-Huy, Wang, Jiaqi, Ku, Wei-Shinn
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918359036067840
author Nguyen, Quang-Huy
Wang, Jiaqi
Ku, Wei-Shinn
author_facet Nguyen, Quang-Huy
Wang, Jiaqi
Ku, Wei-Shinn
contents Federated learning (FL) faces challenges in uncertainty quantification (UQ). Without reliable UQ, FL systems risk deploying overconfident models at under-resourced agents, leading to silent local failures despite seemingly satisfactory global performance. Existing federated UQ approaches often address data heterogeneity or model heterogeneity in isolation, overlooking their joint effect on coverage reliability across agents. Conformal prediction is a widely used distribution-free UQ framework, yet its applications in heterogeneous FL settings remains underexplored. We provide FedWQ-CP, a simple yet effective approach that balances empirical coverage performance with efficiency at both global and agent levels under the dual heterogeneity. FedWQ-CP performs agent-server calibration in a single communication round. On each agent, conformity scores are computed on calibration data and a local quantile threshold is derived. Each agent then transmits only its quantile threshold and calibration sample size to the server. The server simply aggregates these thresholds through a weighted average to produce a global threshold. Experimental results on seven public datasets for both classification and regression demonstrate that FedWQ-CP empirically maintains agent-wise and global coverage while producing the smallest prediction sets or intervals.
format Preprint
id arxiv_https___arxiv_org_abs_2602_23296
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Conformalized Neural Networks for Federated Uncertainty Quantification under Dual Heterogeneity
Nguyen, Quang-Huy
Wang, Jiaqi
Ku, Wei-Shinn
Machine Learning
Artificial Intelligence
Federated learning (FL) faces challenges in uncertainty quantification (UQ). Without reliable UQ, FL systems risk deploying overconfident models at under-resourced agents, leading to silent local failures despite seemingly satisfactory global performance. Existing federated UQ approaches often address data heterogeneity or model heterogeneity in isolation, overlooking their joint effect on coverage reliability across agents. Conformal prediction is a widely used distribution-free UQ framework, yet its applications in heterogeneous FL settings remains underexplored. We provide FedWQ-CP, a simple yet effective approach that balances empirical coverage performance with efficiency at both global and agent levels under the dual heterogeneity. FedWQ-CP performs agent-server calibration in a single communication round. On each agent, conformity scores are computed on calibration data and a local quantile threshold is derived. Each agent then transmits only its quantile threshold and calibration sample size to the server. The server simply aggregates these thresholds through a weighted average to produce a global threshold. Experimental results on seven public datasets for both classification and regression demonstrate that FedWQ-CP empirically maintains agent-wise and global coverage while producing the smallest prediction sets or intervals.
title Conformalized Neural Networks for Federated Uncertainty Quantification under Dual Heterogeneity
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2602.23296