Imagen de Portada

PAFT: A Parallel Training Paradigm for Effective LLM Fine-Tuning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Pentyala, Shiva Kumar, Wang, Zhichao, Bi, Bin, Ramnath, Kiran, Mao, Xiang-Bo, Radhakrishnan, Regunathan, Asur, Sitaram, Na, Cheng
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Reinforcement Learning for LLM Post-Training: A Survey
por: Wang, Zhichao, et al.
Publicado: (2024)

Rate, Explain and Cite (REC): Enhanced Explanation and Attribution in Automatic Evaluation by Large Language Models
por: Hsu, Aliyah R., et al.
Publicado: (2024)

Diversity Enhances an LLM's Performance in RAG and Long-context Task
por: Wang, Zhichao, et al.
Publicado: (2025)

UNA: A Unified Supervised Framework for Efficient LLM Alignment Across Feedback Types
por: Wang, Zhichao, et al.
Publicado: (2024)

PAFT: Prompt-Agnostic Fine-Tuning
por: Wei, Chenxing, et al.
Publicado: (2025)

PAFT: Preservation Aware Fine-Tuning for Minimal-Edit Program Repair
por: Yang, Boyang, et al.
Publicado: (2026)

BayesFlow: A Probability Inference Framework for Meta-Agent Assisted Workflow Generation
por: Yuan, Bo, et al.
Publicado: (2026)

UFT: Unifying Fine-Tuning of SFT and RLHF/DPO/UNA through a Generalized Implicit Reward Function
por: Wang, Zhichao, et al.
Publicado: (2024)

Token Cleaning: Fine-Grained Data Selection for LLM Supervised Fine-Tuning
por: Pang, Jinlong, et al.
Publicado: (2025)

Turning Conversations into Workflows: A Framework to Extract and Evaluate Dialog Workflows for Service AI Agents
por: Choubey, Prafulla Kumar, et al.
Publicado: (2025)

GIFT: Group-Relative Implicit Fine-Tuning Integrates GRPO with DPO and UNA
por: Wang, Zhichao
Publicado: (2025)

Exploring Continual Fine-Tuning for Enhancing Language Ability in Large Language Model
por: Aggarwal, Divyanshu, et al.
Publicado: (2024)

TaxaDiffusion: Progressively Trained Diffusion Model for Fine-Grained Species Generation
por: Monsefi, Amin Karimi, et al.
Publicado: (2025)

Training Large Language Models To Reason In Parallel With Global Forking Tokens
por: Jia, Sheng, et al.
Publicado: (2025)

TuningIQA: Fine-Grained Blind Image Quality Assessment for Livestreaming Camera Tuning
por: Sheng, Xiangfei, et al.
Publicado: (2025)

Bilevel ZOFO: Efficient LLM Fine-Tuning and Meta-Training
por: Shirkavand, Reza, et al.
Publicado: (2025)

Goal-Conditioned Supervised Learning for LLM Fine-Tuning
por: Li, Shijun, et al.
Publicado: (2026)

On the Effectiveness of LLM-Specific Fine-Tuning for Detecting AI-Generated Text
por: Gromadzki, Michał, et al.
Publicado: (2026)

JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuning
por: Tahir, Anique, et al.
Publicado: (2024)

Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate
por: Wang, Yubo, et al.
Publicado: (2025)

Absence of a Putative Mannose-Specific Phosphotransferase System Enzyme IIAB Component in a Leucocin A-Resistant Strain ofListeria monocytogenes, as Shown by Two-Dimensional Sodium Dodecyl Sulfate-Polyacrylamide Gel Electrophoresis. / M. Ramnath
por: Ramnath, M
Publicado: (2000)

Pixels Under Pressure: Exploring Fine-Tuning Paradigms for Foundation Models in High-Resolution Medical Imaging
por: TehraniNasab, Zahra, et al.
Publicado: (2025)

Amulet: Putting Complex Multi-Turn Conversations on the Stand with LLM Juries
por: Ramnath, Sahana, et al.
Publicado: (2025)

Decoupled Training with Local Reinforcement Fine-Tuning in Federated Learning
por: Ma, Yuting, et al.
Publicado: (2026)

FineMedLM-o1: Enhancing Medical Knowledge Reasoning Ability of LLM from Supervised Fine-Tuning to Test-Time Training
por: Yu, Hongzhou, et al.
Publicado: (2025)

A multi-phase-field model for fiber-reinforced composite laminates based on puck failure theory
por: Kumar, Pavan Kumar Asur Vijaya, et al.
Publicado: (2026)

Communication-Aware Knowledge Distillation for Federated LLM Fine-Tuning over Wireless Networks
por: Zhang, Xinlu, et al.
Publicado: (2025)

Learning to Ideate for Machine Learning Engineering Agents
por: Zhang, Yunxiang, et al.
Publicado: (2026)

Mitigating Training Imbalance in LLM Fine-Tuning via Selective Parameter Merging
por: Ju, Yiming, et al.
Publicado: (2024)

Selective Mixup Fine-Tuning for Optimizing Non-Decomposable Objectives
por: Ramasubramanian, Shrinivas, et al.
Publicado: (2024)

Effective Text Adaptation for LLM-based ASR through Soft Prompt Fine-Tuning
por: Ma, Yingyi, et al.
Publicado: (2024)

Quantum-Enhanced LLM Efficient Fine Tuning
por: Kong, Xiaofei, et al.
Publicado: (2025)

Heterogeneous Federated Fine-Tuning with Parallel One-Rank Adaptation
por: Zhang, Zikai, et al.
Publicado: (2026)

CDM-QTA: Quantized Training Acceleration for Efficient LoRA Fine-Tuning of Diffusion Model
por: Lu, Jinming, et al.
Publicado: (2025)

DynaTrain: Fast Online Parallelism Switching for Elastic LLM Training
por: Wang, Yuanqing, et al.
Publicado: (2026)

Teach for America, Relay Graduate School, and the Charter School Networks: The Making of a Parallel Education Structure
por: Angus Shiva Mungal
Publicado: (2016)

Skypilot: Fine-Tuning LLM with Physical Grounding for AAV Coverage Search
por: Chen, Zhongkai, et al.
Publicado: (2025)

Bayesimax Theory: Selecting Priors by Minimizing Total Information
por: Vangala, Sitaram
Publicado: (2025)

Towards Robust LLM Post-Training: Automatic Failure Management for Reinforcement Fine-Tuning
por: Zhang, Lingzhe, et al.
Publicado: (2026)

Leaner Training, Lower Leakage: Revisiting Memorization in LLM Fine-Tuning with LoRA
por: Wang, Fei, et al.
Publicado: (2025)