Image de couverture de livre

Assortment of Attention Heads: Accelerating Federated PEFT with Head Pruning and Strategic Client Selection

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Venkatesha, Yeshwanth, Kundu, Souvik, Panda, Priyadarshini
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Artificial Intelligence Distributed, Parallel, and Cluster Computing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Fast and Cost-effective Speculative Edge-Cloud Decoding with Early Exits
par: Venkatesha, Yeshwanth, et autres
Publié: (2025)

ProbSelect: Stochastic Client Selection for GPU-Accelerated Compute Devices in the 3D Continuum
par: Stanisic, Andrija, et autres
Publié: (2025)

Efficient Client Selection in Federated Learning
par: Marfo, William, et autres
Publié: (2025)

FedAH: Aggregated Head for Personalized Federated Learning
par: Zhou, Pengzhan, et autres
Publié: (2024)

Optimizing Federated Learning by Entropy-Based Client Selection
par: Lutz, Andreas, et autres
Publié: (2024)

FairKV: Balancing Per-Head KV Cache for Fast Multi-GPU Inference
par: Zhao, Bingzhe, et autres
Publié: (2025)

Etalon: Holistic Performance Evaluation Framework for LLM Inference Systems
par: Agrawal, Amey, et autres
Publié: (2024)

Optimus: Accelerating Large-Scale Multi-Modal LLM Training by Bubble Exploitation
par: Feng, Weiqi, et autres
Publié: (2024)

Federated Learning Client Pruning for Noisy Labels
par: Morafah, Mahdi, et autres
Publié: (2024)

PNCS:Power-Norm Cosine Similarity for Diverse Client Selection in Federated Learning
par: Li, Liangyan, et autres
Publié: (2025)

FlowPrefill: Decoupling Preemption from Prefill Scheduling Granularity to Mitigate Head-of-Line Blocking in LLM Serving
par: Hsieh, Chia-chi, et autres
Publié: (2026)

FedSEA-LLaMA: A Secure, Efficient and Adaptive Federated Splitting Framework for Large Language Models
par: Zhang, Zishuai, et autres
Publié: (2025)

FilFL: Client Filtering for Optimized Client Participation in Federated Learning
par: Fourati, Fares, et autres
Publié: (2023)

An Upload-Efficient Scheme for Transferring Knowledge From a Server-Side Pre-trained Generator to Clients in Heterogeneous Federated Learning
par: Zhang, Jianqing, et autres
Publié: (2024)

Tackling Selfish Clients in Federated Learning
par: Augello, Andrea, et autres
Publié: (2024)

Accelerating Large Language Model Training with Hybrid GPU-based Compression
par: Xu, Lang, et autres
Publié: (2024)

FedFiTS: Fitness-Selected, Slotted Client Scheduling for Trustworthy Federated Learning in Healthcare AI
par: Kahenga, Ferdinand, et autres
Publié: (2025)

Federated Learning with Workload Reduction through Partial Training of Client Models and Entropy-Based Data Selection
par: Shi, Hongrui, et autres
Publié: (2024)

FedLECC: Cluster- and Loss-Guided Client Selection for Federated Learning under Non-IID Data
par: Jimenez-Gutierrez, Daniel M., et autres
Publié: (2026)

Pruning Federated Models through Loss Landscape Analysis and Client Agreement Scoring
par: Internò, Christian, et autres
Publié: (2024)

Beyond Aggregation: Guiding Clients in Heterogeneous Federated Learning
par: Wang, Zijian, et autres
Publié: (2025)

A Green Multi-Attribute Client Selection for Over-The-Air Federated Learning: A Grey-Wolf-Optimizer Approach
par: Driss, Maryam Ben, et autres
Publié: (2024)

RobustFSM: Submodular Maximization in Federated Setting with Malicious Clients
par: Tran, Duc A., et autres
Publié: (2025)

Mitigating Persistent Client Dropout in Asynchronous Decentralized Federated Learning
par: Stępka, Ignacy, et autres
Publié: (2025)

FedImpro: Measuring and Improving Client Update in Federated Learning
par: Tang, Zhenheng, et autres
Publié: (2024)

GC-Fed: Gradient Centralized Federated Learning with Partial Client Participation
par: Seo, Jungwon, et autres
Publié: (2025)

Towards Robust and Efficient Federated Low-Rank Adaptation with Heterogeneous Clients
par: Koo, Jabin, et autres
Publié: (2024)

TRAIL: Trust-Aware Client Scheduling for Semi-Decentralized Federated Learning
par: Hu, Gangqiang, et autres
Publié: (2024)

Online Client Scheduling and Resource Allocation for Efficient Federated Edge Learning
par: Gao, Zhidong, et autres
Publié: (2024)

Preventing Rank Collapse in Federated Low-Rank Adaptation with Client Heterogeneity
par: Wu, Fei, et autres
Publié: (2026)

CA-AFP: Cluster-Aware Adaptive Federated Pruning
par: Jha, Om Govind, et autres
Publié: (2026)

Beyond the GPU: The Strategic Role of FPGAs in the Next Wave of AI
par: Jiménez, Arturo Urías
Publié: (2025)

Data-Free Client Contribution Estimation via Logit Maximization for Federated Learning
par: Ukaye, Asim, et autres
Publié: (2026)

Training Heterogeneous Client Models using Knowledge Distillation in Serverless Federated Learning
par: Chadha, Mohak, et autres
Publié: (2024)

iOS as Acceleration
par: Chen, Alexander K.
Publié: (2025)

VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo
par: Ma, Qianli, et autres
Publié: (2025)

Glia: A Human-Inspired AI for Automated Systems Design and Optimization
par: Hamadanian, Pouya, et autres
Publié: (2025)

Elevating Semantic Exploration: A Novel Approach Utilizing Distributed Repositories
par: Bellandi, Valerio
Publié: (2025)

Training Foundation Models on a Full-Stack AMD Platform: Compute, Networking, and System Design
par: Anthony, Quentin, et autres
Publié: (2025)

FlowKV: A Disaggregated Inference Framework with Low-Latency KV Cache Transfer and Load-Aware Scheduling
par: Li, Weiqing, et autres
Publié: (2025)