Cover Image

Transformer Copilot: Learning from The Mistake Log in LLM Fine-tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zou, Jiaru, Ban, Yikun, Li, Zihao, Qi, Yunzhe, Qiu, Ruizhong, Yang, Ling, He, Jingrui
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Influence-Preserving Proxies for Gradient-Based Data Selection in LLM Fine-tuning
by: Chen, Sirui, et al.
Published: (2026)

PageRank Bandits for Link Prediction
by: Ban, Yikun, et al.
Published: (2024)

Latent Collaboration in Multi-Agent Systems
by: Zou, Jiaru, et al.
Published: (2025)

LLM-Forest: Ensemble Learning of LLMs with Graph-Augmented Prompts for Data Imputation
by: He, Xinrui, et al.
Published: (2024)

Recursive Multi-Agent Systems
by: Yang, Xiyuan, et al.
Published: (2026)

PromptIntern: Saving Inference Costs by Internalizing Recurrent Prompt during Large Language Model Fine-tuning
by: Zou, Jiaru, et al.
Published: (2024)

Heterogeneous Scientific Foundation Model Collaboration
by: Li, Zihao, et al.
Published: (2026)

Utility-Diversity Aware Online Batch Selection for LLM Supervised Fine-tuning
by: Zou, Heming, et al.
Published: (2025)

Logic Query of Thoughts: Guiding Large Language Models to Answer Complex Logic Queries with Knowledge Graphs
by: Liu, Lihui, et al.
Published: (2024)

Harnessing Consistency for Robust Test-Time LLM Ensemble
by: Zeng, Zhichen, et al.
Published: (2025)

TaTToo: Tool-Grounded Thinking PRM for Test-Time Scaling in Tabular Reasoning
by: Zou, Jiaru, et al.
Published: (2025)

Automatic Replication of LLM Mistakes in Medical Conversations
by: Proniakin, Oleksii, et al.
Published: (2025)

AutoTool: Dynamic Tool Selection and Integration for Agentic Reasoning
by: Zou, Jiaru, et al.
Published: (2025)

Rethinking Parameter Sharing for LLM Fine-Tuning with Multiple LoRAs
by: Ban, Hao, et al.
Published: (2025)

Selecting Large Language Model to Fine-tune via Rectified Scaling Law
by: Lin, Haowei, et al.
Published: (2024)

Taming Sensitive Weights : Noise Perturbation Fine-tuning for Robust LLM Quantization
by: Wang, Dongwei, et al.
Published: (2024)

Outlier-weighed Layerwise Sampling for LLM Fine-tuning
by: Li, Pengxiang, et al.
Published: (2024)

Mechanistic Fine-tuning for In-context Learning
by: Cho, Hakaze, et al.
Published: (2025)

Learning Rate Matters: Vanilla LoRA May Suffice for LLM Fine-tuning
by: Lee, Yu-Ang, et al.
Published: (2026)

Geometric-disentangelment Unlearning
by: Zhou, Duo, et al.
Published: (2025)

Neural Active Learning Beyond Bandits
by: Ban, Yikun, et al.
Published: (2024)

Saffron-1: Safety Inference Scaling
by: Qiu, Ruizhong, et al.
Published: (2025)

LLM-AutoDP: Automatic Data Processing via LLM Agents for Model Fine-tuning
by: Huang, Wei, et al.
Published: (2026)

Can Graph Neural Networks Learn Language with Extremely Weak Text Supervision?
by: Li, Zihao, et al.
Published: (2024)

GeoLLM-Engine: A Realistic Environment for Building Geospatial Copilots
by: Singh, Simranjit, et al.
Published: (2024)

Exploring Memorization in Fine-tuned Language Models
by: Zeng, Shenglai, et al.
Published: (2023)

LoX: Low-Rank Extrapolation Robustifies LLM Safety Against Fine-tuning
by: Perin, Gabriel J., et al.
Published: (2025)

SEAL: Safety-enhanced Aligned LLM Fine-tuning via Bilevel Data Selection
by: Shen, Han, et al.
Published: (2024)

On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes
by: Agarwal, Rishabh, et al.
Published: (2023)

Learning From Mistakes Makes LLM Better Reasoner
by: An, Shengnan, et al.
Published: (2023)

Filter-then-Weight: Online Data Selection and Reweighting for LLM Fine-Tuning
by: Wang, Fangxin, et al.
Published: (2026)

Harmony in Divergence: Towards Fast, Accurate, and Memory-efficient Zeroth-order LLM Fine-tuning
by: Tan, Qitao, et al.
Published: (2025)

FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition
by: Yan, Yuxuan, et al.
Published: (2024)

LLM4DistReconfig: A Fine-tuned Large Language Model for Power Distribution Network Reconfiguration
by: Christou, Panayiotis, et al.
Published: (2025)

Towards the Resistance of Neural Network Watermarking to Fine-tuning
by: Tang, Ling, et al.
Published: (2025)

Fine-tuning with RAG for Improving LLM Learning of New Skills
by: Ibrahim, Humaid, et al.
Published: (2025)

Information Guided Regularization for Fine-tuning Language Models
by: Sharma, Mandar, et al.
Published: (2024)

Efficient Model Development through Fine-tuning Transfer
by: Lin, Pin-Jie, et al.
Published: (2025)

PFDial: A Structured Dialogue Instruction Fine-tuning Method Based on UML Flowcharts
by: Zhang, Ming, et al.
Published: (2025)

AdaFuse: Adaptive Ensemble Decoding with Test-Time Scaling for LLMs
by: Cui, Chengming, et al.
Published: (2026)