Imagen de Portada

SPICE: Self-Play In Corpus Environments Improves Reasoning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Liu, Bo, Jin, Chuanyang, Kim, Seungone, Yuan, Weizhe, Zhao, Wenting, Kulikov, Ilia, Li, Xian, Sukhbaatar, Sainbayar, Lanchantin, Jack, Weston, Jason
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning tasks
por: Yu, Ping, et al.
Publicado: (2025)

Adaptive Decoding via Latent Preference Optimization
por: Dhuliawala, Shehzaad, et al.
Publicado: (2024)

Diverse Preference Optimization
por: Lanchantin, Jack, et al.
Publicado: (2025)

Following Length Constraints in Instructions
por: Yuan, Weizhe, et al.
Publicado: (2024)

StepWiser: Stepwise Generative Judges for Wiser Reasoning
por: Xiong, Wei, et al.
Publicado: (2025)

OptimalThinkingBench: Evaluating Over and Underthinking in LLMs
por: Aggarwal, Pranjal, et al.
Publicado: (2025)

Self-Improving Pretraining: using post-trained models to pretrain better models
por: Tan, Ellen Xiaoqing, et al.
Publicado: (2026)

Bridging Offline and Online Reinforcement Learning for LLMs
por: Lanchantin, Jack, et al.
Publicado: (2025)

Reasoning over mathematical objects: on-policy reward modeling and test time aggregation
por: Aggarwal, Pranjal, et al.
Publicado: (2026)

Iterative Reasoning Preference Optimization
por: Pang, Richard Yuanzhe, et al.
Publicado: (2024)

Self-Rewarding Language Models
por: Yuan, Weizhe, et al.
Publicado: (2024)

Self-Challenging Language Model Agents
por: Zhou, Yifei, et al.
Publicado: (2025)

NaturalThoughts: Selecting and Distilling Reasoning Traces for General Reasoning Tasks
por: Li, Yang, et al.
Publicado: (2025)

Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judge
por: Wu, Tianhao, et al.
Publicado: (2024)

Thinking LLMs: General Instruction Following with Thought Generation
por: Wu, Tianhao, et al.
Publicado: (2024)

Multi-Token Attention
por: Golovneva, Olga, et al.
Publicado: (2025)

Contextual Position Encoding: Learning to Count What's Important
por: Golovneva, Olga, et al.
Publicado: (2024)

Some things are more CRINGE than others: Iterative Preference Optimization with the Pairwise Cringe Loss
por: Xu, Jing, et al.
Publicado: (2023)

R.I.P.: Better Models by Survival of the Fittest Prompts
por: Yu, Ping, et al.
Publicado: (2025)

SWEET-RL: Training Multi-Turn LLM Agents on Collaborative Reasoning Tasks
por: Zhou, Yifei, et al.
Publicado: (2025)

Reverse Training to Nurse the Reversal Curse
por: Golovneva, Olga, et al.
Publicado: (2024)

Training Large Language Models to Reason in a Continuous Latent Space
por: Hao, Shibo, et al.
Publicado: (2024)

Self-Consistency Preference Optimization
por: Prasad, Archiki, et al.
Publicado: (2024)

Learning to Solve and Verify: A Self-Play Framework for Code and Test Generation
por: Lin, Zi, et al.
Publicado: (2025)

LLM Pretraining with Continuous Concepts
por: Tack, Jihoon, et al.
Publicado: (2025)

The Majority is not always right: RL training for solution aggregation
por: Zhao, Wenting, et al.
Publicado: (2025)

FREESON: Retriever-Free Retrieval-Augmented Reasoning via Corpus-Traversing MCTS
por: Kim, Chaeeun, et al.
Publicado: (2025)

NaturalReasoning: Reasoning in the Wild with 2.8M Challenging Questions
por: Yuan, Weizhe, et al.
Publicado: (2025)

Self-Taught Evaluators
por: Wang, Tianlu, et al.
Publicado: (2024)

Distilling System 2 into System 1
por: Yu, Ping, et al.
Publicado: (2024)

The Era of Real-World Human Interaction: RL from User Conversations
por: Jin, Chuanyang, et al.
Publicado: (2025)

System-Level Natural Language Feedback
por: Yuan, Weizhe, et al.
Publicado: (2023)

TOOLVERIFIER: Generalization to New Tools via Self-Verification
por: Mekala, Dheeraj, et al.
Publicado: (2024)

J1: Incentivizing Thinking in LLM-as-a-Judge via Reinforcement Learning
por: Whitehouse, Chenxi, et al.
Publicado: (2025)

Dualformer: Controllable Fast and Slow Thinking by Learning with Randomized Reasoning Traces
por: Su, DiJia, et al.
Publicado: (2024)

Learning to Reason for Factuality
por: Chen, Xilun, et al.
Publicado: (2025)

Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
por: Sukhbaatar, Sainbayar, et al.
Publicado: (2024)

Step-KTO: Optimizing Mathematical Reasoning through Stepwise Binary Feedback
por: Lin, Yen-Ting, et al.
Publicado: (2025)

Jointly Reinforcing Diversity and Quality in Language Model Generations
por: Li, Tianjian, et al.
Publicado: (2025)

Stochastic activations
por: Lomeli, Maria, et al.
Publicado: (2025)