Cover Image

Transformer Learns Optimal Variable Selection in Group-Sparse Classification

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Chenyang, Meng, Xuran, Cao, Yuan
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Looped Transformers with Layer Normalization Provably Learn the Power Method
by: Wu, Lyumin, et al.
Published: (2026)

Transformers Efficiently Perform In-Context Logistic Regression via Normalized Gradient Descent
by: Zhang, Chenyang, et al.
Published: (2026)

Initialization Matters: On the Benign Overfitting of Two-Layer ReLU CNN with Fully Trainable Layers
by: Shang, Shuning, et al.
Published: (2024)

Transformers Trained via Gradient Descent Can Provably Learn a Class of Teacher Models
by: Zhang, Chenyang, et al.
Published: (2026)

On the Robustness of Transformers against Context Hijacking for Linear Classification
by: Li, Tianle, et al.
Published: (2025)

An Empirical Study of Sample Selection Strategies for Large Language Model Repair
by: Li, Xuran, et al.
Published: (2025)

Inference for Deep Neural Network Estimators in Generalized Nonparametric Models
by: Meng, Xuran, et al.
Published: (2025)

Gradient Descent Robustly Learns the Intrinsic Dimension of Data in Training Convolutional Neural Networks
by: Zhang, Chenyang, et al.
Published: (2025)

The Implicit Bias of Adam on Separable Data
by: Zhang, Chenyang, et al.
Published: (2024)

Beyond Consistency: Inference for the Relative risk functional in Deep Nonparametric Cox Models
by: Ghosal, Sattwik, et al.
Published: (2026)

Sparse PCA with False Discovery Rate Controlled Variable Selection
by: Machkour, Jasin, et al.
Published: (2024)

Learning on Transformers is Provable Low-Rank and Sparse: A One-layer Analysis
by: Li, Hongkang, et al.
Published: (2024)

Nonconvex Optimization Framework for Group-Sparse Feedback Linear-Quadratic Optimal Control: Penalty Approach
by: Feng, Lechen, et al.
Published: (2025)

Cross-Modal Domain Adaptation in Brain Disease Diagnosis: Maximum Mean Discrepancy-based Convolutional Neural Networks
by: Zhu, Xuran
Published: (2024)

Nonconvex Optimization Framework for Group-Sparse Feedback Linear-Quadratic Optimal Control: Non-Penalty Approach
by: Feng, Lechen, et al.
Published: (2025)

Towards Understanding Transformers in Learning Random Walks
by: Shi, Wei, et al.
Published: (2025)

Conformal Classification with Equalized Coverage for Adaptively Selected Groups
by: Zhou, Yanfei, et al.
Published: (2024)

Stochastic Sparse Sampling: A Framework for Variable-Length Medical Time Series Classification
by: Mootoo, Xavier, et al.
Published: (2024)

Towards Understanding Generalization in DP-GD: A Case Study in Training Two-Layer CNNs
by: Shi, Zhongjie, et al.
Published: (2025)

Towards Understanding Feature Learning in Parameter Transfer
by: Yuan, Hua, et al.
Published: (2025)

DriVLM: Domain Adaptation of Vision-Language Models in Autonomous Driving
by: Zheng, Xuran, et al.
Published: (2025)

DAM-GT: Dual Positional Encoding-Based Attention Masking Graph Transformer for Node Classification
by: Li, Chenyang, et al.
Published: (2025)

Optimal Sparse Survival Trees
by: Zhang, Rui, et al.
Published: (2024)

Fair Conformal Classification via Learning Representation-Based Groups
by: Xu, Senrong, et al.
Published: (2026)

Rethinking Tokenized Graph Transformers for Node Classification
by: Chen, Jinsong, et al.
Published: (2025)

Selecting Optimal Variable Order in Autoregressive Ising Models
by: Biswal, Shiba, et al.
Published: (2026)

PRUNE: A Patching Based Repair Framework for Certifiable Unlearning of Neural Networks
by: Li, Xuran, et al.
Published: (2025)

Accelerating Sparse Transformer Inference on GPU
by: Dai, Wenhao, et al.
Published: (2025)

Deep Variable-Block Chain with Adaptive Variable Selection
by: Zhang, Lixiang, et al.
Published: (2019)

Transformers Provably Learn Sparse Token Selection While Fully-Connected Nets Cannot
by: Wang, Zixuan, et al.
Published: (2024)

Pruning is Optimal for Learning Sparse Features in High-Dimensions
by: Vural, Nuri Mert, et al.
Published: (2024)

RAxSS: Retrieval-Augmented Sparse Sampling for Explainable Variable-Length Medical Time Series Classification
by: Javadov, Aydin, et al.
Published: (2025)

Adaptive Sparse Möbius Transforms for Learning Polynomials
by: Erginbas, Yigit Efe, et al.
Published: (2026)

Scaling Law Analysis in Federated Learning: How to Select the Optimal Model Size?
by: Chen, Xuanyu, et al.
Published: (2025)

Sequential Knockoffs for Variable Selection in Reinforcement Learning
by: Ma, Tao, et al.
Published: (2023)

Optimizing the Optimal Weighted Average: Efficient Distributed Sparse Classification
by: Lu, Fred, et al.
Published: (2024)

Two-Timescale Optimization Framework for Sparse-Feedback Linear-Quadratic Optimal Control
by: Feng, Lechen, et al.
Published: (2024)

Causal Representation Learning Made Identifiable by Grouping of Observational Variables
by: Morioka, Hiroshi, et al.
Published: (2023)

Learning Soft Sparse Shapes for Efficient Time-Series Classification
by: Liu, Zhen, et al.
Published: (2025)

Ab Initio Nonparametric Variable Selection for Scalable Symbolic Regression with Large $p$
by: Ye, Shengbin, et al.
Published: (2024)