Cover Image

Efficient Federated Finetuning of Tiny Transformers with Resource-Constrained Devices

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Pfeiffer, Kilian, Ahmed, Mohamed Aboelenien, Khalili, Ramin, Henkel, Jörg
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Efficient Zero-Order Federated Finetuning of Language Models for Resource-Constrained Devices
by: Ahmed, Mohamed Aboelenien, et al.
Published: (2025)

FedMHO: Heterogeneous One-Shot Federated Learning Towards Resource-Constrained Edge Devices
by: Yao, Dezhong, et al.
Published: (2025)

A Resource-Adaptive Approach for Federated Learning under Resource-Constrained Environments
by: Zhang, Ruirui, et al.
Published: (2024)

SFPrompt: Communication-Efficient Split Federated Fine-Tuning for Large Pre-Trained Models over Resource-Limited Devices
by: Cao, Linxiao, et al.
Published: (2024)

REFT: Resource-Efficient Federated Training Framework for Heterogeneous and Resource-Constrained Environments
by: Desai, Humaid Ahmed, et al.
Published: (2023)

Online Client Scheduling and Resource Allocation for Efficient Federated Edge Learning
by: Gao, Zhidong, et al.
Published: (2024)

Optimizing the Deployment of Tiny Transformers on Low-Power MCUs
by: Jung, Victor J. B., et al.
Published: (2024)

Tiny Deep Ensemble: Uncertainty Estimation in Edge AI Accelerators via Ensembling Normalization Layers with Shared Weights
by: Ahmed, Soyed Tuhin, et al.
Published: (2024)

FedTrans: Efficient Federated Learning via Multi-Model Transformation
by: Zhu, Yuxuan, et al.
Published: (2024)

Collaborative Split Federated Learning with Parallel Training and Aggregation
by: Papageorgiou, Yiannis, et al.
Published: (2025)

When Foresight Pruning Meets Zeroth-Order Optimization: Efficient Federated Learning for Low-Memory Devices
by: Zhang, Pengyu, et al.
Published: (2024)

Efficient Federated Learning Tiny Language Models for Mobile Network Feature Prediction
by: Becking, Daniel, et al.
Published: (2025)

Communication-Efficient Federated Learning for LEO Satellite Networks Integrated with HAPs Using Hybrid NOMA-OFDM
by: Elmahallawy, Mohamed, et al.
Published: (2024)

Learning Like Humans: Resource-Efficient Federated Fine-Tuning through Cognitive Developmental Stages
by: Wu, Yebo, et al.
Published: (2025)

SatFed: A Resource-Efficient LEO Satellite-Assisted Heterogeneous Federated Learning Framework
by: Zhang, Yuxin, et al.
Published: (2024)

FLStore: Efficient Federated Learning Storage for non-training workloads
by: Khan, Ahmad Faraz, et al.
Published: (2025)

Large Language Model Partitioning for Low-Latency Inference at the Edge
by: Kafetzis, Dimitrios, et al.
Published: (2025)

Fed-Sophia: A Communication-Efficient Second-Order Federated Learning Algorithm
by: Elbakary, Ahmed, et al.
Published: (2024)

Federated Fine-Tuning of Sparsely-Activated Large Language Models on Resource-Constrained Devices
by: Chen, Fahao, et al.
Published: (2025)

Efficient Deployment of Large Language Models on Resource-constrained Devices
by: Yao, Zhiwei, et al.
Published: (2025)

PIPO: Pipelined Offloading for Efficient Inference on Consumer Devices
by: Liu, Yangyijian, et al.
Published: (2025)

Adaptive and Resource-efficient Agentic AI Systems for Mobile and Embedded Devices: A Survey
by: Liu, Sicong, et al.
Published: (2025)

Efficient Client Selection in Federated Learning
by: Marfo, William, et al.
Published: (2025)

Empirical Analysis of Asynchronous Federated Learning on Heterogeneous Devices: Efficiency, Fairness, and Privacy Trade-offs
by: Mohammadi, Samaneh, et al.
Published: (2025)

FedZero: Leveraging Renewable Excess Energy in Federated Learning
by: Wiesner, Philipp, et al.
Published: (2023)

AdaptSFL: Adaptive Split Federated Learning in Resource-constrained Edge Networks
by: Lin, Zheng, et al.
Published: (2024)

Heterogeneity-Aware Resource Allocation and Topology Design for Hierarchical Federated Edge Learning
by: Gao, Zhidong, et al.
Published: (2024)

Efficient Federated Learning with Timely Update Dissemination
by: Jia, Juncheng, et al.
Published: (2025)

Efficient Asynchronous Federated Learning with Sparsification and Quantization
by: Jia, Juncheng, et al.
Published: (2023)

Boosting Resource-Constrained Federated Learning Systems with Guessed Updates
by: Boukhari, Mohamed Yassine, et al.
Published: (2021)

Hermes: Memory-Efficient Pipeline Inference for Large Models on Edge Devices
by: Han, Xueyuan, et al.
Published: (2024)

Efficient Federated Learning with Heterogeneous Data and Adaptive Dropout
by: Liu, Ji, et al.
Published: (2025)

FedHFT: Efficient Federated Finetuning with Heterogeneous Edge Clients
by: Ilhan, Fatih, et al.
Published: (2025)

Efficient Resource Scheduling for Distributed Infrastructures Using Negotiation Capabilities
by: Chu, Junjie, et al.
Published: (2024)

LCFed: An Efficient Clustered Federated Learning Framework for Heterogeneous Data
by: Zhang, Yuxin, et al.
Published: (2025)

Learning to Collaborate Over Graphs: A Selective Federated Multi-Task Learning Approach
by: Elbakary, Ahmed, et al.
Published: (2025)

EdgeLoRA: An Efficient Multi-Tenant LLM Serving System on Edge Devices
by: Shen, Zheyu, et al.
Published: (2025)

FilFL: Client Filtering for Optimized Client Participation in Federated Learning
by: Fourati, Fares, et al.
Published: (2023)

SSFL: Discovering Sparse Unified Subnetworks at Initialization for Efficient Federated Learning
by: Ohib, Riyasat, et al.
Published: (2024)

Towards Robust and Efficient Federated Low-Rank Adaptation with Heterogeneous Clients
by: Koo, Jabin, et al.
Published: (2024)