:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Wu, Lyumin, Zhang, Chenyang, Cao, Yuan
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2606.00605
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Transformers Efficiently Perform In-Context Logistic Regression via Normalized Gradient Descent
by: Zhang, Chenyang, et al.
Published: (2026)

Transformers Trained via Gradient Descent Can Provably Learn a Class of Teacher Models
by: Zhang, Chenyang, et al.
Published: (2026)

Transformer Learns Optimal Variable Selection in Group-Sparse Classification
by: Zhang, Chenyang, et al.
Published: (2025)

One-Layer Transformer Provably Learns One-Nearest Neighbor In Context
by: Li, Zihao, et al.
Published: (2024)

On The Concurrence of Layer-wise Preconditioning Methods and Provable Feature Learning
by: Zhang, Thomas T., et al.
Published: (2025)

Towards Understanding Generalization in DP-GD: A Case Study in Training Two-Layer CNNs
by: Shi, Zhongjie, et al.
Published: (2025)

Analogies between Transformer Layers and Power Method
by: Li, Chenglong, et al.
Published: (2026)

Towards Simple and Provable Parameter-Free Adaptive Gradient Methods
by: Tao, Yuanzhe, et al.
Published: (2024)

Provable Knowledge Acquisition and Extraction in One-Layer Transformers
by: Xu, Ruichen, et al.
Published: (2025)

Residual Connections and Normalization Can Provably Prevent Oversmoothing in GNNs
by: Scholkemper, Michael, et al.
Published: (2024)

Learning Spectral Methods by Transformers
by: He, Yihan, et al.
Published: (2025)

Stability of Transformers under Layer Normalization
by: Kan, Kelvin, et al.
Published: (2025)

Gradient Descent Robustly Learns the Intrinsic Dimension of Data in Training Convolutional Neural Networks
by: Zhang, Chenyang, et al.
Published: (2025)

Transformers Provably Learn to Internalize Chain-of-Thought
by: Huang, Yixiao, et al.
Published: (2026)

Provable In-Context Learning of Nonlinear Regression with Transformers
by: Li, Hongbo, et al.
Published: (2025)

The Implicit Bias of Adam on Separable Data
by: Zhang, Chenyang, et al.
Published: (2024)

On the Robustness of Transformers against Context Hijacking for Linear Classification
by: Li, Tianle, et al.
Published: (2025)

Transformers Provably Learn Sparse XOR with Polylogarithmic Parameters
by: Han, Yaomengxi, et al.
Published: (2025)

Non-Adversarial Imitation Learning Provably Free of Compounding Errors: The Role of Bellman Constraints
by: Xu, Tian, et al.
Published: (2026)

Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks
by: Nichani, Eshaan, et al.
Published: (2023)

An Efficient Subgraph GNN with Provable Substructure Counting Power
by: Yan, Zuoyu, et al.
Published: (2023)

A Single-Loop Deep Actor-Critic Algorithm for Constrained Reinforcement Learning with Provable Convergence
by: Wang, Kexuan, et al.
Published: (2023)

Understanding the Role of Layer Normalization in Label-Skewed Federated Learning
by: Zhang, Guojun, et al.
Published: (2023)

Momentum Benefits Non-IID Federated Learning Simply and Provably
by: Cheng, Ziheng, et al.
Published: (2023)

Energy-Entropy Regularization: The True Power of Minimal Looped Transformers
by: Lam, Wai-Lun
Published: (2026)

Unlabeled Data Can Provably Enhance In-Context Learning of Transformers
by: Liu, Renpu, et al.
Published: (2026)

Learning on Transformers is Provable Low-Rank and Sparse: A One-layer Analysis
by: Li, Hongkang, et al.
Published: (2024)

Stochastic Runge-Kutta Methods: Provable Acceleration of Diffusion Models
by: Wu, Yuchen, et al.
Published: (2024)

Closing the Loop: A Control-Theoretic Framework for Provably Stable Time Series Forecasting with LLMs
by: Zhang, Xingyu, et al.
Published: (2026)

Parallel Layer Normalization for Universal Approximation
by: Ni, Yunhao, et al.
Published: (2025)

Provably Transformers Harness Multi-Concept Word Semantics for Efficient In-Context Learning
by: Bu, Dake, et al.
Published: (2024)

Transformers Provably Learn Directed Acyclic Graphs via Kernel-Guided Mutual Information
by: Cheng, Yuan, et al.
Published: (2025)

Reasoning with Latent Thoughts: On the Power of Looped Transformers
by: Saunshi, Nikunj, et al.
Published: (2025)

Learning Normal Patterns in Musical Loops
by: Dadman, Shayan, et al.
Published: (2025)

Transformers are Efficient Compilers, Provably
by: Zhai, Xiyu, et al.
Published: (2024)

CoPS: Empowering LLM Agents with Provable Cross-Task Experience Sharing
by: Yang, Chen, et al.
Published: (2024)

The Hidden Power of Normalization Layers in Neural Networks: Exponential Capacity Control
by: Than, Khoat
Published: (2025)

Peri-LN: Revisiting Normalization Layer in the Transformer Architecture
by: Kim, Jeonghoon, et al.
Published: (2025)

Towards Understanding Transformers in Learning Random Walks
by: Shi, Wei, et al.
Published: (2025)

Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networks
by: Collins, Liam, et al.
Published: (2023)