Cover Image

FedProxy: Federated Fine-Tuning of LLMs via Proxy SLMs and Heterogeneity-Aware Fusion

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Fan, Tao, Ma, Guoqiang, Song, Yuanfeng, Fan, Lixin, Chen, Kai, Yang, Qiang
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models
by: Fan, Tao, et al.
Published: (2024)

PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation
by: Fan, Tao, et al.
Published: (2025)

FedPFT: Federated Proxy Fine-Tuning of Foundation Models
by: Peng, Zhaopeng, et al.
Published: (2024)

FedCoT: Federated Chain-of-Thought Distillation for Large Language Models
by: Fan, Tao, et al.
Published: (2024)

Federated Co-tuning Framework for Large and Small Language Models
by: Fan, Tao, et al.
Published: (2024)

SecureBoost+: Large Scale and High-Performance Vertical Federated Gradient Boosting Decision Tree
by: Fan, Tao, et al.
Published: (2021)

FedPT: Federated Proxy-Tuning of Large Language Models on Resource-Constrained Edge Devices
by: Gao, Zhidong, et al.
Published: (2024)

A Meta-learning Framework for Tuning Parameters of Protection Mechanisms in Trustworthy Federated Learning
by: Zhang, Xiaojin, et al.
Published: (2023)

FedEval-LLM: Federated Evaluation of Large Language Models on Downstream Tasks with Collective Wisdom
by: He, Yuanqin, et al.
Published: (2024)

H2Tune: Federated Foundation Model Fine-Tuning with Hybrid Heterogeneity
by: Guo, Wei, et al.
Published: (2025)

FedMomentum: Preserving LoRA Training Momentum in Federated Fine-Tuning
by: Yan, Peishen, et al.
Published: (2026)

High Rank Matrix Completion via Grassmannian Proxy Fusion
by: Li, Huanran, et al.
Published: (2026)

FedTracker: Furnishing Ownership Verification and Traceability for Federated Learning Model
by: Shao, Shuo, et al.
Published: (2022)

Federated Graph Learning with Structure Proxy Alignment
by: Fu, Xingbo, et al.
Published: (2024)

G-Boost: Boosting Private SLMs with General LLMs
by: Fan, Yijiang, et al.
Published: (2025)

FedAdOb: Privacy-Preserving Federated Deep Learning with Adaptive Obfuscation
by: Gu, Hanlin, et al.
Published: (2024)

Grounding Foundation Models through Federated Transfer Learning: A General Framework
by: Kang, Yan, et al.
Published: (2023)

Position-Aware Parameter Efficient Fine-Tuning Approach for Reducing Positional Bias in LLMs
by: Zhang, Zheng, et al.
Published: (2024)

Handling Spatial-Temporal Data Heterogeneity for Federated Continual Learning via Tail Anchor
by: Yu, Hao, et al.
Published: (2024)

Proxy-RLHF: Decoupling Generation and Alignment in Large Language Model with Proxy
by: Zhu, Yu, et al.
Published: (2024)

Revitalizing Black-Box Interpretability: Actionable Interpretability for LLMs via Proxy Models
by: Liu, Junhao, et al.
Published: (2025)

FedTreeLoRA: Reconciling Statistical and Functional Heterogeneity in Federated LoRA Fine-Tuning
by: Bian, Jieming, et al.
Published: (2026)

Long-Document QA with Chain-of-Structured-Thought and Fine-Tuned SLMs
by: Liang, Zhuowen, et al.
Published: (2026)

ProxyKV: Cross-Model Proxy Pruning for Efficient Long-Context LLM Inference
by: Li, Junjie, et al.
Published: (2026)

OptiProxy-NAS: Optimization Proxy based End-to-End Neural Architecture Search
by: Lyu, Bo, et al.
Published: (2025)

A Tale of LLMs and Induced Small Proxies: Scalable Agents for Knowledge Mining
by: Zhang, Sipeng, et al.
Published: (2025)

Compact Optimality Verification for Optimization Proxies
by: Chen, Wenbo, et al.
Published: (2024)

ArchPilot: A Proxy-Guided Multi-Agent Approach for Machine Learning Engineering
by: Yuan, Zhuowen, et al.
Published: (2025)

C-3PO: Compact Plug-and-Play Proxy Optimization to Achieve Human-like Retrieval-Augmented Generation
by: Chen, Guoxin, et al.
Published: (2025)

ProxySPEX: Inference-Efficient Interpretability via Sparse Feature Interactions in LLMs
by: Butler, Landon, et al.
Published: (2025)

Snoopy: Effective and Efficient Semantic Join Discovery via Proxy Columns
by: Guo, Yuxiang, et al.
Published: (2025)

LLMs as Policy-Agnostic Teammates: A Case Study in Human Proxy Design for Heterogeneous Agent Teams
by: Justus, Aju Ani, et al.
Published: (2025)

FedKRSO: Communication and Memory Efficient Federated Fine-Tuning of Large Language Models
by: Yang, Guohao, et al.
Published: (2026)

Long-Context Reasoning Through Proxy-Based Chain-of-Thought Tuning
by: Li, Miao, et al.
Published: (2026)

Large-Small Model Collaborative Framework for Federated Continual Learning
by: Yu, Hao, et al.
Published: (2025)

60 Data Points are Sufficient to Fine-Tune LLMs for Question-Answering
by: Ye, Junjie, et al.
Published: (2024)

FedHPD: Heterogeneous Federated Reinforcement Learning via Policy Distillation
by: Jiang, Wenzheng, et al.
Published: (2025)

FedMentor: Domain-Aware Differential Privacy for Heterogeneous Federated LLMs in Mental Health
by: Sarwar, Nobin, et al.
Published: (2025)

FedConv: A Learning-on-Model Paradigm for Heterogeneous Federated Clients
by: Shen, Leming, et al.
Published: (2025)

Fast Proxies for LLM Robustness Evaluation
by: Beyer, Tim, et al.
Published: (2025)