:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Author:	Allen-Zhu, Zeyuan
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	https://arxiv.org/abs/2512.17351
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Physics of Language Models: Part 1, Learning Hierarchical Language Structures
by: Allen-Zhu, Zeyuan, et al.
Published: (2023)

Physics of Language Models: Part 3.1, Knowledge Storage and Extraction
by: Allen-Zhu, Zeyuan, et al.
Published: (2023)

Physics of Language Models: Part 3.2, Knowledge Manipulation
by: Allen-Zhu, Zeyuan, et al.
Published: (2023)

Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws
by: Allen-Zhu, Zeyuan, et al.
Published: (2024)

Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process
by: Ye, Tian, et al.
Published: (2024)

Physics of Language Models: Part 2.2, How to Learn From Mistakes on Grade-School Math Problems
by: Ye, Tian, et al.
Published: (2024)

Reverse Training to Nurse the Reversal Curse
by: Golovneva, Olga, et al.
Published: (2024)

Language Models over Canonical Byte-Pair Encodings
by: Vieira, Tim, et al.
Published: (2025)

Hybrid Architectures for Language Models: Systematic Analysis and Design Insights
by: Bae, Sangmin, et al.
Published: (2025)

Architectural Foundations for the Large Language Model Infrastructures
by: Zhu, Hongyin
Published: (2024)

Magical: Medical Lay Language Generation via Semantic Invariance and Layperson-tailored Adaptation
by: Liao, Weibin, et al.
Published: (2025)

Model Editing with Canonical Examples
by: Hewitt, John, et al.
Published: (2024)

How Far Are Vision-Language Models from Constructing the Real World? A Benchmark for Physical Generative Reasoning
by: Yang, Luyu, et al.
Published: (2026)

Structured In-context Environment Scaling for Large Language Model Reasoning
by: Yu, Peng, et al.
Published: (2025)

Balancing Rigor and Utility: Mitigating Cognitive Biases in Large Language Models for Multiple-Choice Questions
by: Zhong, Hanyang, et al.
Published: (2024)

Same Evidence, Different Answers: Canonical-Context On-Policy Distillation for Multi-Turn Language Models
by: Lin, Zizhuo, et al.
Published: (2026)

Beyond Magic Words: Sharpness-Aware Prompt Evolving for Robust Large Language Models with TARE
by: Wan, Guancheng, et al.
Published: (2025)

Broken Tokens? Your Language Model can Secretly Handle Non-Canonical Tokenizations
by: Zheng, Brian Siyuan, et al.
Published: (2025)

Behind the Magic, MERLIM: Multi-modal Evaluation Benchmark for Large Image-Language Models
by: Villa, Andrés, et al.
Published: (2023)

Similarity-Distance-Magnitude Language Models
by: Schmaltz, Allen
Published: (2025)

Jailbreaking LLMs' Safeguard with Universal Magic Words for Text Embedding Models
by: Liang, Haoyu, et al.
Published: (2025)

Language-Specific Layer Matters: Efficient Multilingual Enhancement for Large Vision-Language Models
by: Fan, Yuchun, et al.
Published: (2025)

Persona-Conditioned Risk Behavior in Large Language Models: A Simulated Gambling Study with GPT-4.1
by: Dubedy, Sankalp
Published: (2026)

Design Principle Transfer in Neural Architecture Search via Large Language Models
by: Zhou, Xun, et al.
Published: (2024)

Nanbeige4.1-3B: A Small General Model that Reasons, Aligns, and Acts
by: Yang, Chen, et al.
Published: (2026)

You Only Cache Once: Decoder-Decoder Architectures for Language Models
by: Sun, Yutao, et al.
Published: (2024)

A Reference Architecture for Designing Foundation Model based Systems
by: Lu, Qinghua, et al.
Published: (2023)

How Does Sequence Modeling Architecture Influence Base Capabilities of Pre-trained Language Models? Exploring Key Architecture Design Principles to Avoid Base Capabilities Degradation
by: Lu, Xin, et al.
Published: (2025)

Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Models
by: Li, You, et al.
Published: (2025)

The Compressor-Retriever Architecture for Language Model OS
by: Yang, Yuan, et al.
Published: (2024)

FastSpell: the LangId Magic Spell
by: Bañón, Marta, et al.
Published: (2024)

Learning Less Is More: Premature Upper-Layer Attention Specialization Hurts Language Model Pretraining
by: Zhu, Jinchang, et al.
Published: (2026)

NL2GenSym: Natural Language to Generative Symbolic Rules for SOAR Cognitive Architecture via Large Language Models
by: Yuan, Fang, et al.
Published: (2025)

Curriculum-Guided Layer Scaling for Language Model Pretraining
by: Singh, Karanpartap, et al.
Published: (2025)

LayerTracer: A Joint Task-Particle and Vulnerable-Layer Analysis framework for Arbitrary Large Language Model Architectures
by: Wu, Yuhang, et al.
Published: (2026)

Architecture, Not Scale: Circuit Localization in Large Language Models
by: Venkatesh, Sohan
Published: (2026)

Scaling Embedding Layers in Language Models
by: Yu, Da, et al.
Published: (2025)

Masked Language Models are Good Heterogeneous Graph Generalizers
by: Yang, Jinyu, et al.
Published: (2025)

Foundations of Large Language Model Compression -- Part 1: Weight Quantization
by: Young, Sean I.
Published: (2024)

Magic Markup: Maintaining Document-External Markup with an LLM
by: Misback, Edward, et al.
Published: (2024)