Imagen de Portada

Data Quality Control in Federated Instruction-tuning of Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Du, Yaxin, Ye, Rui, Yuchi, Fengting, Zhao, Wanru, Qu, Jingjing, Wang, Yanfeng, Chen, Siheng
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Enhancing Data Quality in Federated Fine-Tuning of Foundation Models
por: Zhao, Wanru, et al.
Publicado: (2024)

Leveraging Unstructured Text Data for Federated Instruction Tuning of Large Language Models
por: Ye, Rui, et al.
Publicado: (2024)

FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models
por: Ye, Rui, et al.
Publicado: (2024)

OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learning
por: Ye, Rui, et al.
Publicado: (2024)

Optimizing Cross-Client Domain Coverage for Federated Instruction Tuning of Large Language Models
por: Wang, Zezhou, et al.
Publicado: (2024)

FedMABench: Benchmarking Mobile Agents on Decentralized Heterogeneous User Data
por: Wang, Wenhao, et al.
Publicado: (2025)

Emerging Safety Attack and Defense in Federated Instruction Tuning of Large Language Models
por: Ye, Rui, et al.
Publicado: (2024)

VLMGuard-R1: Proactive Safety Alignment for VLMs via Reasoning-Driven Prompt Optimization
por: Chen, Menglan, et al.
Publicado: (2025)

Learn What You Need in Personalized Federated Learning
por: Lv, Kexin, et al.
Publicado: (2024)

Decentralized and Lifelong-Adaptive Multi-Agent Collaborative Learning
por: Tang, Shuo, et al.
Publicado: (2024)

Hypergraph Transformer for Semi-Supervised Classification
por: Liu, Zexi, et al.
Publicado: (2023)

Federated Data-Efficient Instruction Tuning for Large Language Models
por: Qin, Zhen, et al.
Publicado: (2024)

Adapting Large Language Models for Content Moderation: Pitfalls in Data Engineering and Supervised Fine-tuning
por: Ma, Huan, et al.
Publicado: (2023)

A Survey on Federated Fine-tuning of Large Language Models
por: Wu, Yebo, et al.
Publicado: (2025)

Sparse is Enough in Fine-tuning Pre-trained Large Language Models
por: Song, Weixi, et al.
Publicado: (2023)

The Future of Large Language Model Pre-training is Federated
por: Sani, Lorenzo, et al.
Publicado: (2024)

Learning Instruction-Following Policies through Open-Ended Instruction Relabeling with Large Language Models
por: Zhang, Zhicheng, et al.
Publicado: (2025)

InstructAV: Instruction Fine-tuning Large Language Models for Authorship Verification
por: Hu, Yujia, et al.
Publicado: (2024)

Fine-tuning Large Language Model for Automated Algorithm Design
por: Liu, Fei, et al.
Publicado: (2025)

Forgetting: A New Mechanism Towards Better Large Language Model Fine-tuning
por: Taheri, Ali, et al.
Publicado: (2025)

Exploring Federated Pruning for Large Language Models
por: Guo, Pengxin, et al.
Publicado: (2025)

Instruction Mining: Instruction Data Selection for Tuning Large Language Models
por: Cao, Yihan, et al.
Publicado: (2023)

Exploring Memorization in Fine-tuned Language Models
por: Zeng, Shenglai, et al.
Publicado: (2023)

Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization
por: Liu, Yixin, et al.
Publicado: (2023)

LLMSurgeon: Diagnosing Data Mixture of Large Language Models
por: Luo, Yaxin, et al.
Publicado: (2026)

Instruction Lens Score: Your Instruction Contributes a Powerful Object Hallucination Detector for Multimodal Large Language Models
por: Lai, Runhe, et al.
Publicado: (2026)

Instruction-tuned Language Models are Better Knowledge Learners
por: Jiang, Zhengbao, et al.
Publicado: (2024)

Efficient Split Federated Learning for Large Language Models over Communication Networks
por: Zhao, Kai, et al.
Publicado: (2025)

AceGRPO: Adaptive Curriculum Enhanced Group Relative Policy Optimization for Autonomous Machine Learning Engineering
por: Cai, Yuzhu, et al.
Publicado: (2026)

Emotion Knowledge Enhancement for Vision Large Language Models: A Self-Verification Approach for High-Quality Emotion Instruction Data Generation
por: Wang, Feifan, et al.
Publicado: (2025)

TuneComp: Joint Fine-tuning and Compression for Large Foundation Models
por: Chen, Xiangyu, et al.
Publicado: (2025)

Are We There Yet? Revealing the Risks of Utilizing Large Language Models in Scholarly Peer Review
por: Ye, Rui, et al.
Publicado: (2024)

Federated Knowledge Transfer Fine-tuning Large Server Model with Resource-Constrained IoT Clients
por: Chen, Shaoyuan, et al.
Publicado: (2024)

Efficient Inference Using Large Language Models with Limited Human Data: Fine-Tuning then Rectification
por: Wang, Lei, et al.
Publicado: (2025)

Selecting Large Language Model to Fine-tune via Rectified Scaling Law
por: Lin, Haowei, et al.
Publicado: (2024)

Helpful or Harmful Data? Fine-tuning-free Shapley Attribution for Explaining Language Model Predictions
por: Wang, Jingtan, et al.
Publicado: (2024)

Non-instructional Fine-tuning: Enabling Instruction-Following Capabilities in Pre-trained Language Models without Instruction-Following Data
por: Xie, Juncheng, et al.
Publicado: (2024)

A Study of Optimizations for Fine-tuning Large Language Models
por: Singh, Arjun, et al.
Publicado: (2024)

FIT to Forget: Robust Continual Unlearning for Large Language Models
por: Xu, Xiaoyu, et al.
Publicado: (2026)

On Representation Redundancy in Large-Scale Instruction Tuning Data Selection
por: Shu, Youwei, et al.
Publicado: (2026)