Copertina

Efficient Zero-Order Federated Finetuning of Language Models for Resource-Constrained Devices

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Ahmed, Mohamed Aboelenien, Pfeiffer, Kilian, Khalili, Ramin, Khdr, Heba, Henkel, Jörg
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Efficient Federated Finetuning of Tiny Transformers with Resource-Constrained Devices
di: Pfeiffer, Kilian, et al.
Pubblicazione: (2024)

Accelerated Training on Low-Power Edge Devices
di: Ahmed, Mohamed Aboelenien, et al.
Pubblicazione: (2025)

Split Federated Learning Architectures for High-Accuracy and Low-Delay Model Training
di: Papageorgiou, Yiannis, et al.
Pubblicazione: (2026)

FL-NAS: Towards Fairness of NAS for Resource Constrained Devices via Large Language Models
di: Qin, Ruiyang, et al.
Pubblicazione: (2024)

Logarithmic Memory Networks (LMNs): Efficient Long-Range Sequence Modeling for Resource-Constrained Environments
di: Taha, Mohamed A.
Pubblicazione: (2025)

Communication-Efficient Byzantine-Resilient Federated Zero-Order Optimization
di: Neto, Afonso de Sá Delgado, et al.
Pubblicazione: (2024)

SacFL: Self-Adaptive Federated Continual Learning for Resource-Constrained End Devices
di: Zhong, Zhengyi, et al.
Pubblicazione: (2025)

ESFL: Efficient Split Federated Learning over Resource-Constrained Heterogeneous Wireless Devices
di: Zhu, Guangyu, et al.
Pubblicazione: (2024)

A Safe Deep Reinforcement Learning Approach for Energy Efficient Federated Learning in Wireless Communication Networks
di: Koursioumpas, Nikolaos, et al.
Pubblicazione: (2023)

Order Independence With Finetuning
di: Brown, Katrina, et al.
Pubblicazione: (2025)

Generalizable and Stable Finetuning of Pretrained Language Models on Low-Resource Texts
di: Somayajula, Sai Ashish, et al.
Pubblicazione: (2024)

Differentially Private Zeroth-Order Methods for Scalable Large Language Model Finetuning
di: Liu, Z, et al.
Pubblicazione: (2024)

SplitFrozen: Split Learning with Device-side Model Frozen for Fine-Tuning LLM on Heterogeneous Resource-Constrained Devices
di: Ma, Jian, et al.
Pubblicazione: (2025)

Scaling Agentic Capabilities, Not Context: Efficient Reinforcement Finetuning for Large Toolspaces
di: Gupta, Karan, et al.
Pubblicazione: (2026)

An Efficient Training Algorithm for Models with Block-wise Sparsity
di: Zhu, Ding, et al.
Pubblicazione: (2025)

MetaCLBench: Meta Continual Learning Benchmark on Resource-Constrained Edge Devices
di: Li, Sijia, et al.
Pubblicazione: (2025)

Small or Large? Zero-Shot or Finetuned? Guiding Language Model Choice for Specialized Applications in Healthcare
di: Gondara, Lovedeep, et al.
Pubblicazione: (2025)

Simultaneous Training of First- and Second-Order Optimizers in Population-Based Reinforcement Learning
di: Pfeiffer, Felix, et al.
Pubblicazione: (2024)

Constrained multi-fidelity Bayesian optimization with automatic stop condition
di: Foumani, Zahra Zanjani, et al.
Pubblicazione: (2025)

Multi-Objective Optimization Using Adaptive Distributed Reinforcement Learning
di: Tan, Jing, et al.
Pubblicazione: (2024)

GeoAda: Efficiently Finetune Geometric Diffusion Models with Equivariant Adapters
di: Zhao, Wanjia, et al.
Pubblicazione: (2025)

Accelerate Model Parallel Training by Using Efficient Graph Traversal Order in Device Placement
di: Wang, Tianze, et al.
Pubblicazione: (2022)

Large Language Models to Diffusion Finetuning
di: Cetin, Edoardo, et al.
Pubblicazione: (2025)

An Experimental Design Framework for Label-Efficient Supervised Finetuning of Large Language Models
di: Bhatt, Gantavya, et al.
Pubblicazione: (2024)

XAMBA: Enabling Efficient State Space Models on Resource-Constrained Neural Processing Units
di: Das, Arghadip, et al.
Pubblicazione: (2025)

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs
di: Abillama, Pierre, et al.
Pubblicazione: (2025)

Robust Federated Finetuning of LLMs via Alternating Optimization of LoRA
di: Chen, Shuangyi, et al.
Pubblicazione: (2025)

MONAQ: Multi-Objective Neural Architecture Querying for Time-Series Analysis on Resource-Constrained Devices
di: Trirat, Patara, et al.
Pubblicazione: (2025)

FedMHO: Heterogeneous One-Shot Federated Learning Towards Resource-Constrained Edge Devices
di: Yao, Dezhong, et al.
Pubblicazione: (2025)

Federated Knowledge Transfer Fine-tuning Large Server Model with Resource-Constrained IoT Clients
di: Chen, Shaoyuan, et al.
Pubblicazione: (2024)

Squeeze the Soaked Sponge: Efficient Off-policy Reinforcement Finetuning for Large Language Model
di: Liang, Jing, et al.
Pubblicazione: (2025)

Warming Up for Zeroth-Order Federated Pre-Training with Low Resource Clients
di: Legate, Gwen, et al.
Pubblicazione: (2025)

Finetuning Large Language Models for Vulnerability Detection
di: Shestov, Alexey, et al.
Pubblicazione: (2024)

Vanishing Gradients in Reinforcement Finetuning of Language Models
di: Razin, Noam, et al.
Pubblicazione: (2023)

ReFT: Representation Finetuning for Language Models
di: Wu, Zhengxuan, et al.
Pubblicazione: (2024)

Grammar-Constrained Decoding for Structured NLP Tasks without Finetuning
di: Geng, Saibo, et al.
Pubblicazione: (2023)

A Zero-shot and Few-shot Study of Instruction-Finetuned Large Language Models Applied to Clinical and Biomedical Tasks
di: Labrak, Yanis, et al.
Pubblicazione: (2023)

Easy Adaptation: An Efficient Task-Specific Knowledge Injection Method for Large Models in Resource-Constrained Environments
di: Chen, Dong, et al.
Pubblicazione: (2025)

Leveraging Knowledge Distillation for Efficient Deep Reinforcement Learning in Resource-Constrained Environments
di: Meng, Guanlin
Pubblicazione: (2023)

Federated Learning-Enabled Hybrid Language Models for Communication-Efficient Token Transmission
di: Solat, Faranaksadat, et al.
Pubblicazione: (2025)