Copertina

Learn Hard Problems During RL with Reference Guided Fine-tuning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wu, Yangzhen, Li, Shanda, Wen, Zixin, Zhou, Xin, Talwalkar, Ameet, Yang, Yiming, Huang, Wenhao, Cai, Tianle
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

CodePDE: An Inference Framework for LLM-driven PDE Solver Generation
di: Li, Shanda, et al.
Pubblicazione: (2025)

CoMind: Towards Community-Driven Agents for Machine Learning Engineering
di: Li, Sijie, et al.
Pubblicazione: (2025)

FrontierCO: Real-World and Large-Scale Evaluation of Machine Learning Solvers for Combinatorial Optimization
di: Feng, Shengyu, et al.
Pubblicazione: (2025)

Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Models
di: Wu, Yangzhen, et al.
Pubblicazione: (2024)

Spend Less, Fit Better: Budget-Efficient Scaling Law Fitting via Active Experiment Selection
di: Li, Sijie, et al.
Pubblicazione: (2026)

Do LLMs exhibit human-like response biases? A case study in survey design
di: Tjuatja, Lindia, et al.
Pubblicazione: (2023)

Sample Complexity and Representation Ability of Test-time Scaling Paradigms
di: Huang, Baihe, et al.
Pubblicazione: (2025)

CO-Bench: Benchmarking Language Model Agents in Algorithm Search for Combinatorial Optimization
di: Sun, Weiwei, et al.
Pubblicazione: (2025)

Provably tuning the ElasticNet across instances
di: Balcan, Maria-Florina, et al.
Pubblicazione: (2022)

An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning
di: Luo, Yun, et al.
Pubblicazione: (2023)

Explainable Token-level Noise Filtering for LLM Fine-tuning Datasets
di: Yang, Yuchen, et al.
Pubblicazione: (2026)

Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes
di: Kolawole, Steven, et al.
Pubblicazione: (2024)

Advancing Parameter Efficiency in Fine-tuning via Representation Editing
di: Wu, Muling, et al.
Pubblicazione: (2024)

ScribeAgent: Towards Specialized Web Agents Using Production-Scale Workflow Data
di: Shen, Junhong, et al.
Pubblicazione: (2024)

AlignSum: Data Pyramid Hierarchical Fine-tuning for Aligning with Human Summarization Preference
di: Han, Yang, et al.
Pubblicazione: (2024)

Learning or Self-aligning? Rethinking Instruction Fine-tuning
di: Ren, Mengjie, et al.
Pubblicazione: (2024)

Normalization through Fine-tuning: Understanding Wav2vec 2.0 Embeddings for Phonetic Analysis
di: Wang, Yiming, et al.
Pubblicazione: (2025)

COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuning
di: Bai, Yuelin, et al.
Pubblicazione: (2024)

Memento: Fine-tuning LLM Agents without Fine-tuning LLMs
di: Zhou, Huichi, et al.
Pubblicazione: (2025)

Enhancing Chain-of-Thought Reasoning with Critical Representation Fine-tuning
di: Huang, Chenxi, et al.
Pubblicazione: (2025)

Comparing Developer and LLM Biases in Code Evaluation
di: Mittal, Aditya, et al.
Pubblicazione: (2026)

Be Careful When Fine-tuning On Open-Source LLMs: Your Fine-tuning Data Could Be Secretly Stolen!
di: Zhang, Zhexin, et al.
Pubblicazione: (2025)

TemplateRL: Structured Template-Guided Reinforcement Learning for LLM Reasoning
di: Wu, Jinyang, et al.
Pubblicazione: (2025)

PoLi-RL: A Point-to-List Reinforcement Learning Framework for Conditional Semantic Textual Similarity
di: Song, Zixin, et al.
Pubblicazione: (2025)

Information Guided Regularization for Fine-tuning Language Models
di: Sharma, Mandar, et al.
Pubblicazione: (2024)

Reflect-RL: Two-Player Online RL Fine-Tuning for LMs
di: Zhou, Runlong, et al.
Pubblicazione: (2024)

UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptation
di: Shen, Junhong, et al.
Pubblicazione: (2024)

The Impact of Element Ordering on LM Agent Performance
di: Chi, Wayne, et al.
Pubblicazione: (2024)

ReSURE: Regularizing Supervision Unreliability for Multi-turn Dialogue Fine-tuning
di: Du, Yiming, et al.
Pubblicazione: (2025)

Investigating the Representation of Backchannels and Fillers in Fine-tuned Language Models
di: Wang, Yu, et al.
Pubblicazione: (2025)

Data-efficient LLM Fine-tuning for Code Generation
di: Lv, Weijie, et al.
Pubblicazione: (2025)

Mechanistic Fine-tuning for In-context Learning
di: Cho, Hakaze, et al.
Pubblicazione: (2025)

Preference-grounded Token-level Guidance for Language Model Fine-tuning
di: Yang, Shentao, et al.
Pubblicazione: (2023)

Reuse your FLOPs: Scaling RL on Hard Problems by Conditioning on Very Off-Policy Prefixes
di: Setlur, Amrith, et al.
Pubblicazione: (2026)

Improving Text Embeddings for Smaller Language Models Using Contrastive Fine-tuning
di: Ukarapol, Trapoom, et al.
Pubblicazione: (2024)

GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuning
di: Solatorio, Aivin V.
Pubblicazione: (2024)

Fine-tuning Done Right in Model Editing
di: Yang, Wanli, et al.
Pubblicazione: (2025)

Compositional Subspace Representation Fine-tuning for Adaptive Large Language Models
di: Zhou, Andy
Pubblicazione: (2025)

ExPO: Unlocking Hard Reasoning with Self-Explanation-Guided Reinforcement Learning
di: Zhou, Ruiyang, et al.
Pubblicazione: (2025)

SWE-Lego: Pushing the Limits of Supervised Fine-tuning for Software Issue Resolving
di: Tao, Chaofan, et al.
Pubblicazione: (2026)