Imagen de Portada

Understanding the Effect of Noise in LLM Training Data with Algorithmic Chains of Thought

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Havrilla, Alex, Iyer, Maia
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Understanding Scaling Laws with Statistical and Approximation Theory for Transformer Neural Networks on Intrinsically Low-dimensional Data
por: Havrilla, Alex, et al.
Publicado: (2024)

SPARQ: Synthetic Problem Generation for Reasoning via Quality-Diversity Algorithms
por: Havrilla, Alex, et al.
Publicado: (2025)

IGDA: Interactive Graph Discovery through Large Language Model Agents
por: Havrilla, Alex, et al.
Publicado: (2025)

Understanding Hidden Computations in Chain-of-Thought Reasoning
por: Bharadwaj, Aryasomayajula Ram
Publicado: (2024)

DFU: scale-robust diffusion model for zero-shot super-resolution image generation
por: Havrilla, Alex, et al.
Publicado: (2023)

Temporal Chain of Thought: Long-Video Understanding by Thinking in Frames
por: Arnab, Anurag, et al.
Publicado: (2025)

Constraint-Rectified Training for Efficient Chain-of-Thought
por: Wu, Qinhang, et al.
Publicado: (2026)

Emergence of Superposition: Unveiling the Training Dynamics of Chain of Continuous Thought
por: Zhu, Hanlin, et al.
Publicado: (2025)

GLoRe: When, Where, and How to Improve LLM Reasoning via Global and Local Refinements
por: Havrilla, Alex, et al.
Publicado: (2024)

Latent Chain-of-Thought Improves Structured-Data Transformers
por: Dudley, Carson, et al.
Publicado: (2026)

Utilizing Training Data to Improve LLM Reasoning for Tabular Understanding
por: Gao, Chufan, et al.
Publicado: (2025)

Understanding Chain-of-Thought in LLMs through Information Theory
por: Ton, Jean-Francois, et al.
Publicado: (2024)

Understanding Reasoning in Chain-of-Thought from the Hopfieldian View
por: Hu, Lijie, et al.
Publicado: (2024)

Transformers for Learning on Noisy and Task-Level Manifolds: Approximation and Generalization Insights
por: Shen, Zhaiming, et al.
Publicado: (2025)

Zipping the Thought: When and How Compressed Reasoning Data Works in LLM Post-Training
por: Matsutani, Kohsei, et al.
Publicado: (2026)

Make Still Further Progress: Chain of Thoughts for Tabular Data Leaderboard
por: Liu, Si-Yang, et al.
Publicado: (2025)

Faithfulness as Information Flow: Evaluating and Training Faithful Chain-of-Thought Reasoning
por: Jia, Jinghan, et al.
Publicado: (2026)

When More is Less: Understanding Chain-of-Thought Length in LLMs
por: Wu, Yuyang, et al.
Publicado: (2025)

Understanding Silent Data Corruption in LLM Training
por: Ma, Jeffrey, et al.
Publicado: (2025)

Output Supervision Can Obfuscate the Chain of Thought
por: Drori, Jacob, et al.
Publicado: (2025)

Training Nonlinear Transformers for Chain-of-Thought Inference: A Theoretical Generalization Analysis
por: Li, Hongkang, et al.
Publicado: (2024)

ProLLM: Protein Chain-of-Thoughts Enhanced LLM for Protein-Protein Interaction Prediction
por: Jin, Mingyu, et al.
Publicado: (2024)

Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Models
por: Havrilla, Alex, et al.
Publicado: (2024)

Analyzing the Effect of Noise in LLM Fine-tuning
por: Li, Lingfang, et al.
Publicado: (2026)

Audio Flamingo Sound-CoT Technical Report: Improving Chain-of-Thought Reasoning in Sound Understanding
por: Kong, Zhifeng, et al.
Publicado: (2025)

Transformers Provably Learn to Internalize Chain-of-Thought
por: Huang, Yixiao, et al.
Publicado: (2026)

Deep Thinking by Markov Chain of Continuous Thoughts
por: Liu, Jiayu, et al.
Publicado: (2025)

On Learning Verifiers and Implications to Chain-of-Thought Reasoning
por: Balcan, Maria-Florina, et al.
Publicado: (2025)

BC Protocol: Structured Dual-Expert Dialogue for Eliciting High-Quality Chain-of-Thought Post-Training Data
por: Zou, Bo, et al.
Publicado: (2026)

A Theoretical Understanding of Chain-of-Thought: Coherent Reasoning and Error-Aware Demonstration
por: Cui, Yingqian, et al.
Publicado: (2024)

Training Multimodal Large Reasoning Models Needs Better Thoughts: A Three-Stage Framework for Long Chain-of-Thought Synthesis and Selection
por: Wang, Yizhi, et al.
Publicado: (2025)

Chain-of-Thought Predictive Control
por: Jia, Zhiwei, et al.
Publicado: (2023)

Transformers Provably Solve Parity Efficiently with Chain of Thought
por: Kim, Juno, et al.
Publicado: (2024)

Convergence and Emergence of In-Context Reinforcement Learning with Chain of Thought
por: Xie, Zixuan, et al.
Publicado: (2026)

Continuous Chain of Thought Enables Parallel Exploration and Reasoning
por: Gozeten, Halil Alperen, et al.
Publicado: (2025)

Analyzing the Power of Chain of Thought through Memorization Capabilities
por: Yu, Lijia, et al.
Publicado: (2025)

Reasoning Models Sometimes Output Illegible Chains of Thought
por: Jose, Arun
Publicado: (2025)

Ehrenfeucht-Haussler Rank and Chain of Thought
por: Barceló, Pablo, et al.
Publicado: (2025)

Activation Steering for Chain-of-Thought Compression
por: Azizi, Seyedarmin, et al.
Publicado: (2025)

Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs
por: Zhang, Xuan, et al.
Publicado: (2024)