Who to Trust? Aggregating Client Predictions in Federated Distillation
Fuente:
arXiv
Guardado en:
| Autores principales: | Kovalchuk, Viktor, Son, Denis, Bolatov, Arman, Guizani, Mohsen, Horváth, Samuel, Panov, Maxim, Takáč, Martin, Gorbunov, Eduard, Kotelevskii, Nikita |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Byzantine-Robust Optimization under $(L_0, L_1)$-Smoothness
por: Bolatov, Arman, et al.
Publicado: (2026)
por: Bolatov, Arman, et al.
Publicado: (2026)
Adaptive Set-Mass Calibration with Conformal Prediction
por: Kazantsev, Daniil, et al.
Publicado: (2025)
por: Kazantsev, Daniil, et al.
Publicado: (2025)
From Risk to Uncertainty: Generating Predictive Uncertainty Measures via Bayesian Estimation
por: Kotelevskii, Nikita, et al.
Publicado: (2024)
por: Kotelevskii, Nikita, et al.
Publicado: (2024)
Federated Learning Can Find Friends That Are Advantageous
por: Tupitsa, Nazarii, et al.
Publicado: (2024)
por: Tupitsa, Nazarii, et al.
Publicado: (2024)
Uncertainty Quantification for Regression using Proper Scoring Rules
por: Fishkov, Alexander, et al.
Publicado: (2025)
por: Fishkov, Alexander, et al.
Publicado: (2025)
Efficient Conformal Prediction under Data Heterogeneity
por: Plassier, Vincent, et al.
Publicado: (2023)
por: Plassier, Vincent, et al.
Publicado: (2023)
Multidimensional Uncertainty Quantification via Optimal Transport
por: Kotelevskii, Nikita, et al.
Publicado: (2025)
por: Kotelevskii, Nikita, et al.
Publicado: (2025)
LionMuon: Alternating Spectral and Sign Descent for Efficient Training
por: Bolatov, Arman, et al.
Publicado: (2026)
por: Bolatov, Arman, et al.
Publicado: (2026)
Learning Confident Classifiers in the Presence of Label Noise
por: Hashmi, Asma Ahmed, et al.
Publicado: (2023)
por: Hashmi, Asma Ahmed, et al.
Publicado: (2023)
Preconditioned Norms: A Unified Framework for Steepest Descent, Quasi-Newton and Adaptive Methods
por: Veprikov, Andrey, et al.
Publicado: (2025)
por: Veprikov, Andrey, et al.
Publicado: (2025)
Methods with Local Steps and Random Reshuffling for Generally Smooth Non-Convex Federated Optimization
por: Demidovich, Yury, et al.
Publicado: (2024)
por: Demidovich, Yury, et al.
Publicado: (2024)
Trust Driven On-Demand Scheme for Client Deployment in Federated Learning
por: Chahoud, Mario, et al.
Publicado: (2024)
por: Chahoud, Mario, et al.
Publicado: (2024)
Remove that Square Root: A New Efficient Scale-Invariant Version of AdaGrad
por: Choudhury, Sayantan, et al.
Publicado: (2024)
por: Choudhury, Sayantan, et al.
Publicado: (2024)
Probabilistic Conformal Prediction with Approximate Conditional Validity
por: Plassier, Vincent, et al.
Publicado: (2024)
por: Plassier, Vincent, et al.
Publicado: (2024)
Low-Resource Machine Translation through the Lens of Personalized Federated Learning
por: Moskvoretskii, Viktor, et al.
Publicado: (2024)
por: Moskvoretskii, Viktor, et al.
Publicado: (2024)
Where Does Warm-Up Come From? Adaptive Scheduling for Norm-Constrained Optimizers
por: Riabinin, Artem, et al.
Publicado: (2026)
por: Riabinin, Artem, et al.
Publicado: (2026)
Neural Optimal Transport Meets Multivariate Conformal Prediction
por: Kondratyev, Vladimir, et al.
Publicado: (2025)
por: Kondratyev, Vladimir, et al.
Publicado: (2025)
Methods for Convex $(L_0,L_1)$-Smooth Optimization: Clipping, Acceleration, and Adaptivity
por: Gorbunov, Eduard, et al.
Publicado: (2024)
por: Gorbunov, Eduard, et al.
Publicado: (2024)
PaDPaF: Partial Disentanglement with Partially-Federated GANs
por: Almansoori, Abdulla Jasem, et al.
Publicado: (2022)
por: Almansoori, Abdulla Jasem, et al.
Publicado: (2022)
Linear Convergence Rate in Convex Setup is Possible! Gradient Descent Method Variants under $(L_0,L_1)$-Smoothness
por: Lobanov, Aleksandr, et al.
Publicado: (2024)
por: Lobanov, Aleksandr, et al.
Publicado: (2024)
Clipping Improves Adam-Norm and AdaGrad-Norm when the Noise Is Heavy-Tailed
por: Chezhegov, Savelii, et al.
Publicado: (2024)
por: Chezhegov, Savelii, et al.
Publicado: (2024)
Generalising Battery Control in Net-Zero Buildings via Personalised Federated RL
por: Avila, Nicolas M Cuadrado, et al.
Publicado: (2024)
por: Avila, Nicolas M Cuadrado, et al.
Publicado: (2024)
FedPeWS: Personalized Warmup via Subnetworks for Enhanced Heterogeneous Federated Learning
por: Tastan, Nurbek, et al.
Publicado: (2024)
por: Tastan, Nurbek, et al.
Publicado: (2024)
Convergence of Clipped-SGD for Convex $(L_0,L_1)$-Smooth Optimization with Heavy-Tailed Noise
por: Chezhegov, Savelii, et al.
Publicado: (2025)
por: Chezhegov, Savelii, et al.
Publicado: (2025)
Byzantine Robustness and Partial Participation Can Be Achieved at Once: Just Clip Gradient Differences
por: Malinovsky, Grigory, et al.
Publicado: (2023)
por: Malinovsky, Grigory, et al.
Publicado: (2023)
On-Demand Model and Client Deployment in Federated Learning with Deep Reinforcement Learning
por: Chahoud, Mario, et al.
Publicado: (2024)
por: Chahoud, Mario, et al.
Publicado: (2024)
Collaborative and Efficient Personalization with Mixtures of Adaptors
por: Almansoori, Abdulla Jasem, et al.
Publicado: (2024)
por: Almansoori, Abdulla Jasem, et al.
Publicado: (2024)
Double Momentum and Error Feedback for Clipping with Fast Rates and Differential Privacy
por: Islamov, Rustem, et al.
Publicado: (2025)
por: Islamov, Rustem, et al.
Publicado: (2025)
Simplex Deep Linear Discriminant Analysis
por: Tezekbayev, Maxat, et al.
Publicado: (2026)
por: Tezekbayev, Maxat, et al.
Publicado: (2026)
ReDAct: Uncertainty-Aware Deferral for LLM Agents
por: Piatrashyn, Dzianis, et al.
Publicado: (2026)
por: Piatrashyn, Dzianis, et al.
Publicado: (2026)
FRUGAL: Memory-Efficient Optimization by Reducing State Overhead for Scalable Training
por: Zmushko, Philip, et al.
Publicado: (2024)
por: Zmushko, Philip, et al.
Publicado: (2024)
Differentially Private Clipped-SGD: High-Probability Convergence with Arbitrary Clipping Level
por: Khah, Saleh Vatan, et al.
Publicado: (2025)
por: Khah, Saleh Vatan, et al.
Publicado: (2025)
Rectifying Conformity Scores for Better Conditional Coverage
por: Plassier, Vincent, et al.
Publicado: (2025)
por: Plassier, Vincent, et al.
Publicado: (2025)
Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning
por: Ponkshe, Kaustubh, et al.
Publicado: (2024)
por: Ponkshe, Kaustubh, et al.
Publicado: (2024)
Revisiting LocalSGD and SCAFFOLD: Improved Rates and Missing Analysis
por: Luo, Ruichen, et al.
Publicado: (2025)
por: Luo, Ruichen, et al.
Publicado: (2025)
Generalized Policy Learning for Smart Grids: FL TRPO Approach
por: Li, Yunxiang, et al.
Publicado: (2024)
por: Li, Yunxiang, et al.
Publicado: (2024)
Breaking the Heavy-Tailed Noise Barrier in Stochastic Optimization Problems
por: Puchkin, Nikita, et al.
Publicado: (2023)
por: Puchkin, Nikita, et al.
Publicado: (2023)
Loss-Transformation Invariance in the Damped Newton Method
por: Shestakov, Alexander, et al.
Publicado: (2025)
por: Shestakov, Alexander, et al.
Publicado: (2025)
LoFT: Low-Rank Adaptation That Behaves Like Full Fine-Tuning
por: Tastan, Nurbek, et al.
Publicado: (2025)
por: Tastan, Nurbek, et al.
Publicado: (2025)
Deep Linear Discriminant Analysis Revisited
por: Tezekbayev, Maxat, et al.
Publicado: (2026)
por: Tezekbayev, Maxat, et al.
Publicado: (2026)
Ejemplares similares
-
Byzantine-Robust Optimization under $(L_0, L_1)$-Smoothness
por: Bolatov, Arman, et al.
Publicado: (2026) -
Adaptive Set-Mass Calibration with Conformal Prediction
por: Kazantsev, Daniil, et al.
Publicado: (2025) -
From Risk to Uncertainty: Generating Predictive Uncertainty Measures via Bayesian Estimation
por: Kotelevskii, Nikita, et al.
Publicado: (2024) -
Federated Learning Can Find Friends That Are Advantageous
por: Tupitsa, Nazarii, et al.
Publicado: (2024) -
Uncertainty Quantification for Regression using Proper Scoring Rules
por: Fishkov, Alexander, et al.
Publicado: (2025)