Cover Image

Listen and Chant Before You Read: The Ladder of Beauty in LM Pre-Training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Nomura, Yoshinori
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Read Before You Think: Mitigating LLM Comprehension Failures with Step-by-Step Reading
by: Han, Feijiang, et al.
Published: (2025)

Self-Train Before You Transcribe
by: Flynn, Robert, et al.
Published: (2024)

Continual Pre-Training is (not) What You Need in Domain Adaption
by: Chen, Pin-Er, et al.
Published: (2025)

Warm Up Before You Train: Unlocking General Reasoning in Resource-Constrained Settings
by: Shrestha, Safal, et al.
Published: (2025)

Watch Before You Answer: Learning from Visually Grounded Post-Training
by: Zhang, Yuxuan, et al.
Published: (2026)

ObscuraCoder: Powering Efficient Code LM Pre-Training Via Obfuscation Grounding
by: Paul, Indraneil, et al.
Published: (2025)

Kanbun-LM: Reading and Translating Classical Chinese in Japanese Methods by Language Models
by: Wang, Hao, et al.
Published: (2023)

Know You Before You Speak: User-State Modeling for LLM Personalization in Multi-Turn Conversation
by: Luo, Jiani, et al.
Published: (2026)

D.Va: Validate Your Demonstration First Before You Use It
by: Zhang, Qi, et al.
Published: (2025)

Listening, Reading, or Both? Rethinking the Comprehension Benefits of Reading‐While‐Listening
by: Bronson Hui, et al.
Published: (2025)

Listening or Reading? Evaluating Speech Awareness in Chain-of-Thought Speech-to-Text Translation
by: Romero-Díaz, Jacobo, et al.
Published: (2025)

Thinking Before You Speak: A Proactive Test-time Scaling Approach
by: Liu, Cong, et al.
Published: (2025)

Walk Before You Run! Concise LLM Reasoning via Reinforcement Learning
by: Song, Mingyang, et al.
Published: (2025)

DebugLM: Learning Traceable Training Data Provenance for LLMs
by: Mo, Wenjie Jacky, et al.
Published: (2026)

Look Before You Leap: Autonomous Exploration for LLM Agents
by: Ye, Ziang, et al.
Published: (2026)

OCR-Enhanced Multimodal ASR Can Read While Listening
by: Chen, Junli, et al.
Published: (2026)

Talk Before You Retrieve: Agent-Led Discussions for Better RAG in Medical QA
by: Dong, Xuanzhao, et al.
Published: (2025)

Enhancing Pre-Trained Generative Language Models with Question Attended Span Extraction on Machine Reading Comprehension
by: Ai, Lin, et al.
Published: (2024)

The Reading/Listening Library.
by: Krashen, Stephen D.
Published: (1995)

Understanding Before Reasoning: Enhancing Chain-of-Thought with Iterative Summarization Pre-Prompting
by: Zhu, Dong-Hai, et al.
Published: (2025)

SnapKV: LLM Knows What You are Looking for Before Generation
by: Li, Yuhong, et al.
Published: (2024)

Think Twice Before You Judge: Mixture of Dual Reasoning Experts for Multimodal Sarcasm Detection
by: Jana, Soumyadeep, et al.
Published: (2025)

Think Before You Prune: Selective Self-Generated Calibration for Pruning Large Reasoning Models
by: Xiang, Yang, et al.
Published: (2025)

Check Yourself Before You Wreck Yourself: Selectively Quitting Improves LLM Agent Safety
by: Bonagiri, Vamshi Krishna, et al.
Published: (2025)

BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Data
by: Jumelet, Jaap, et al.
Published: (2025)

Summarize Before You Speak with ARACH: A Training-Free Inference-Time Plug-In for Enhancing LLMs via Global Attention Reallocation
by: Wang, Jingtao, et al.
Published: (2026)

Can ChatGPT Read Who You Are?
by: Derner, Erik, et al.
Published: (2023)

Synthetic Pre-Pre-Training Improves Language Model Robustness to Noisy Pre-Training Data
by: Guo, Xu, et al.
Published: (2026)

Think Before You Lie: How Reasoning Leads to Honesty
by: Yuan, Ann, et al.
Published: (2026)

Think Before You Act: Decision Transformers with Working Memory
by: Kang, Jikun, et al.
Published: (2023)

SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models
by: Li, Hongxing, et al.
Published: (2025)

Before You Interpret the Profile: Validity Scaling for LLM Metacognitive Self-Report
by: Cacioli, Jon-Paul
Published: (2026)

Score Before You Speak: Improving Persona Consistency in Dialogue Generation using Response Quality Scores
by: Saggar, Arpita, et al.
Published: (2025)

Look Before You Leap: Towards Decision-Aware and Generalizable Tool-Usage for Large Language Models
by: Gui, Anchun, et al.
Published: (2024)

Reinforcement Pre-Training
by: Dong, Qingxiu, et al.
Published: (2025)

KaLM-Embedding: Superior Training Data Brings A Stronger Embedding Model
by: Hu, Xinshuo, et al.
Published: (2025)

BabyLM Challenge: Exploring the Effect of Variation Sets on Language Model Training Efficiency
by: Haga, Akari, et al.
Published: (2024)

Training LayoutLM from Scratch for Efficient Named-Entity Recognition in the Insurance Domain
by: Uthayasooriyar, Benno, et al.
Published: (2024)

BAMBINO-LM: (Bilingual-)Human-Inspired Continual Pretraining of BabyLM
by: Shen, Zhewen, et al.
Published: (2024)

B-cos LM: Efficiently Transforming Pre-trained Language Models for Improved Explainability
by: Wang, Yifan, et al.
Published: (2025)