Imagen de Portada

Crafting Reversible SFT Behaviors in Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Lin, Yuping, He, Pengfei, Xing, Yue, Cui, Yingqian, Ding, Jiayuan, Mukherjee, Subhabrata, Liu, Hui, Xiang, Zhen
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

A Simple Plug-in for Improving Eviction-Based KV Cache Compression
por: Lin, Yuping, et al.
Publicado: (2026)

SoK: Machine Unlearning for Large Language Models
por: Ren, Jie, et al.
Publicado: (2025)

Towards the Effect of Examples on In-Context Learning: A Theoretical Case Study
por: He, Pengfei, et al.
Publicado: (2024)

Superiority of Multi-Head Attention in In-Context Linear Regression
por: Cui, Yingqian, et al.
Publicado: (2024)

Stepwise Perplexity-Guided Refinement for Efficient Chain-of-Thought Reasoning in Large Language Models
por: Cui, Yingqian, et al.
Publicado: (2025)

DiffusionShield: A Watermark for Copyright Protection against Generative Diffusion Models
por: Cui, Yingqian, et al.
Publicado: (2023)

A Theoretical Understanding of Chain-of-Thought: Coherent Reasoning and Error-Aware Demonstration
por: Cui, Yingqian, et al.
Publicado: (2024)

Multi-Faceted Studies on Data Poisoning can Advance LLM Development
por: He, Pengfei, et al.
Publicado: (2025)

ORION: Teaching Language Models to Reason Efficiently in the Language of Thought
por: Tanmay, Kumar, et al.
Publicado: (2025)

Adaptive Test-Time Reasoning via Reward-Guided Dual-Phase Search
por: Cui, Yingqian, et al.
Publicado: (2025)

RED QUEEN: Safeguarding Large Language Models against Concealed Multi-Turn Jailbreaking
por: Jiang, Yifan, et al.
Publicado: (2024)

SFT-GO: Supervised Fine-Tuning with Group Optimization for Large Language Models
por: Kim, Gyuhak, et al.
Publicado: (2025)

Crafting Large Language Models for Enhanced Interpretability
por: Sun, Chung-En, et al.
Publicado: (2024)

Bridging SFT and RL: Dynamic Policy Optimization for Robust Reasoning
por: Zhu, Taojie, et al.
Publicado: (2026)

TMS: Trajectory-Mixed Supervision for Reward-Free, On-Policy SFT
por: Khan, Rana Muhammad Shahroz, et al.
Publicado: (2026)

Copyright Protection in Generative AI: A Technical Perspective
por: Ren, Jie, et al.
Publicado: (2024)

Debunk the Myth of SFT Generalization
por: Lin, Xiaofeng, et al.
Publicado: (2025)

Do Language Models Have Bayesian Brains? Distinguishing Stochastic and Deterministic Decision Patterns within Large Language Models
por: Cui, Andrea Yaoyun, et al.
Publicado: (2025)

How Do Latent Reasoning Methods Perform Under Weak and Strong Supervision?
por: Cui, Yingqian, et al.
Publicado: (2026)

Correcting Large Language Model Behavior via Influence Function
por: Zhang, Han, et al.
Publicado: (2024)

Make LLMs better zero-shot reasoners: Structure-orientated autonomous reasoning
por: He, Pengfei, et al.
Publicado: (2024)

PEAR: Planner-Executor Agent Robustness Benchmark
por: Dong, Shen, et al.
Publicado: (2025)

Crafting Efficient Fine-Tuning Strategies for Large Language Models
por: Oliver, Michael, et al.
Publicado: (2024)

mSFT: Addressing Dataset Mixtures Overfitting Heterogeneously in Multi-task SFT
por: Koh, Woosung, et al.
Publicado: (2026)

Using Mechanistic Interpretability to Craft Adversarial Attacks against Large Language Models
por: Winninger, Thomas, et al.
Publicado: (2025)

Memory Injection Attacks on LLM Agents via Query-Only Interaction
por: Dong, Shen, et al.
Publicado: (2025)

Factual Self-Awareness in Language Models: Representation, Robustness, and Scaling
por: Tamoyan, Hovhannes, et al.
Publicado: (2025)

TPLLM: A Traffic Prediction Framework Based on Pretrained Large Language Models
por: Ren, Yilong, et al.
Publicado: (2024)

An Interpretable Automated Mechanism Design Framework with Large Language Models
por: Liu, Jiayuan, et al.
Publicado: (2025)

Patch the Distribution Mismatch: RL Rewriting Agent for Stable Off-Policy SFT
por: Wang, Jiacheng, et al.
Publicado: (2026)

Q-SFT: Q-Learning for Language Models via Supervised Fine-Tuning
por: Hong, Joey, et al.
Publicado: (2024)

FisherSFT: Data-Efficient Supervised Fine-Tuning of Language Models Using Information Gain
por: Deb, Rohan, et al.
Publicado: (2025)

RoleCraft-GLM: Advancing Personalized Role-Playing in Large Language Models
por: Tao, Meiling, et al.
Publicado: (2023)

Accurate Network Traffic Matrix Prediction via LEAD: a Large Language Model-Enhanced Adapter-Based Conditional Diffusion Model
por: Sun, Yu, et al.
Publicado: (2026)

Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning
por: Xi, Zhiheng, et al.
Publicado: (2024)

Consolidation or Adaptation? PRISM: Disentangling SFT and RL Data via Gradient Concentration
por: Zhao, Yang, et al.
Publicado: (2026)

Generating with Confidence: Uncertainty Quantification for Black-box Large Language Models
por: Lin, Zhen, et al.
Publicado: (2023)

Metis-RISE: RL Incentivizes and SFT Enhances Multimodal Reasoning Model Learning
por: Qiu, Haibo, et al.
Publicado: (2025)

An End-to-End Framework for Building Large Language Models for Software Operations
por: He, Jingkai, et al.
Publicado: (2026)

Reinforcement Learning Finetunes Small Subnetworks in Large Language Models
por: Mukherjee, Sagnik, et al.
Publicado: (2025)