Cover Image

Critical Windows of Complexity Control: When Transformers Decide to Reason or Memorize

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Ali, Sarwan
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Pitfalls of Memorization: When Memorization Hurts Generalization
by: Bayat, Reza, et al.
Published: (2024)

Deciding When Not to Decide: Indeterminacy-Aware Intrusion Detection with NeutroSENSE
by: Al-Masri, Eyhab
Published: (2025)

When Counterfactual Reasoning Fails: Chaos and Real-World Complexity
by: Aalaila, Yahya, et al.
Published: (2025)

Membership and Memorization in LLM Knowledge Distillation
by: Zhang, Ziqi, et al.
Published: (2025)

When Tables Leak: Attacking String Memorization in LLM-Based Tabular Data Generation
by: Ward, Joshua, et al.
Published: (2025)

Memorize Theorems, Not Instances: Probing SFT Generalization through Mathematical Reasoning
by: Peng, Ruiying, et al.
Published: (2026)

Memorization Sinks: Isolating Memorization during LLM Training
by: Ghosal, Gaurav R., et al.
Published: (2025)

Nearest Neighbor CCP-Based Molecular Sequence Analysis
by: Ali, Sarwan, et al.
Published: (2024)

MAnchors: Memorization-Based Acceleration of Anchors via Rule Reuse and Transformation
by: Yu, Haonan, et al.
Published: (2025)

Memorization Control in Diffusion Models from Denoising-centric Perspective
by: Vu, Thuy Phuong, et al.
Published: (2026)

Auditing Reasoning-Trace Memorization Claims after Unlearning with Head-Conditioned Canaries
by: Li, Yanhang, et al.
Published: (2026)

The Cost of Robustness: Tighter Bounds on Parameter Complexity for Robust Memorization in ReLU Nets
by: Kim, Yujun, et al.
Published: (2025)

Beyond Memorization: Extending Reasoning Depth with Recurrence, Memory and Test-Time Compute Scaling
by: Rodkin, Ivan, et al.
Published: (2025)

Titans: Learning to Memorize at Test Time
by: Behrouz, Ali, et al.
Published: (2024)

Memorization vs. Reasoning: Updating LLMs with New Knowledge
by: Li, Aochong Oliver, et al.
Published: (2025)

TNT: Improving Chunkwise Training for Test-Time Memorization
by: Li, Zeman, et al.
Published: (2025)

Generalizability of Memorization Neural Networks
by: Yu, Lijia, et al.
Published: (2024)

Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination
by: Wu, Mingqi, et al.
Published: (2025)

It's All Connected: A Journey Through Test-Time Memorization, Attentional Bias, Retention, and Online Optimization
by: Behrouz, Ali, et al.
Published: (2025)

On the Memorization of Consistency Distillation for Diffusion Models
by: Jiang, Bingqing, et al.
Published: (2026)

Memorization in deep learning: A survey
by: Wei, Jiaheng, et al.
Published: (2024)

Too Big to Think: Capacity, Memorization, and Generalization in Pre-Trained Transformers
by: Barron, Joshua, et al.
Published: (2025)

Re-understanding Graph Unlearning through Memorization
by: Ding, Pengfei, et al.
Published: (2026)

Batch Normalization Amplifies Memorization and Privacy Risks
by: Doan, Ngoc Phu, et al.
Published: (2026)

Decoding Generalization from Memorization in Deep Neural Networks
by: Ketha, Simran, et al.
Published: (2025)

Memorization in In-Context Learning
by: Golchin, Shahriar, et al.
Published: (2024)

When Can LLMs Learn to Reason with Weak Supervision?
by: Rahman, Salman, et al.
Published: (2026)

When Reasoning Meets Compression: Understanding the Effects of LLMs Compression on Large Reasoning Models
by: Zhang, Nan, et al.
Published: (2025)

Sequence-to-Image Transformation for Sequence Classification Using Rips Complex Construction and Chaos Game Representation
by: Ali, Sarwan, et al.
Published: (2025)

Beyond Frequency: The Role of Redundancy in Large Language Model Memorization
by: Zhang, Jie, et al.
Published: (2025)

From Teacher to Student: Tracking Memorization Through Model Distillation
by: Singh, Simardeep
Published: (2025)

When Can Proxies Improve the Sample Complexity of Preference Learning?
by: Zhu, Yuchen, et al.
Published: (2024)

When and How Long? The Readout-Mediator Angle in Temporal Reasoning
by: Fadnavis, Shreyas, et al.
Published: (2026)

When to Trust the Cheap Check: Weak and Strong Verification for Reasoning
by: Kiyani, Shayan, et al.
Published: (2026)

Mitigating Memorization In Language Models
by: Sakarvadia, Mansi, et al.
Published: (2024)

Subgoal Search For Complex Reasoning Tasks
by: Czechowski, Konrad, et al.
Published: (2021)

On the Empirical Complexity of Reasoning and Planning in LLMs
by: Kang, Liwei, et al.
Published: (2024)

When Learning Rates Go Wrong: Early Structural Signals in PPO Actor-Critic
by: Fernández-Hernández, Alberto, et al.
Published: (2026)

Understanding the Impact of Differentially Private Training on Memorization of Long-Tailed Data
by: Zhang, Jiaming, et al.
Published: (2026)

Analysis of the Memorization and Generalization Capabilities of AI Agents: Are Continual Learners Robust?
by: Kim, Minsu, et al.
Published: (2023)