:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Sanford, Clayton, Hsu, Daniel, Telgarsky, Matus
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2402.09268
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

One-layer transformers fail to solve the induction heads task
by: Sanford, Clayton, et al.
Published: (2024)

Fast attention mechanisms: a tale of parallelism
by: Liu, Jingwen, et al.
Published: (2025)

On Achieving Optimal Adversarial Test Error
by: Li, Justin D., et al.
Published: (2023)

Astral Space: Convex Analysis at Infinity
by: Dudík, Miroslav, et al.
Published: (2022)

Benefits of Early Stopping in Gradient Descent for Overparameterized Logistic Regression
by: Wu, Jingfeng, et al.
Published: (2025)

Spectrum Extraction and Clipping for Implicitly Linear Layers
by: Boroojeny, Ali Ebrahimpour, et al.
Published: (2024)

Large Stepsize Gradient Descent for Logistic Loss: Non-Monotonicity of the Loss Improves Optimization Efficiency
by: Wu, Jingfeng, et al.
Published: (2024)

Basic Inequalities for First-Order Optimization with Applications to Statistical Risk Analysis
by: Paik, Seunghoon, et al.
Published: (2025)

When Do Transformers Outperform Feedforward and Recurrent Networks? A Statistical Perspective
by: Mousavi-Hosseini, Alireza, et al.
Published: (2025)

Lost in Tokenization: Fundamental Trade-offs in Graph Tokenization for Transformers
by: Bechler-Speicher, Maya, et al.
Published: (2026)

Depth-Width tradeoffs in Algorithmic Reasoning of Graph Tasks with Transformers
by: Yehudai, Gilad, et al.
Published: (2025)

Understanding Transformer Reasoning Capabilities via Graph Algorithms
by: Sanford, Clayton, et al.
Published: (2024)

Lower bounds for one-layer transformers that compute parity
by: Hsu, Daniel
Published: (2026)

Next-Token Prediction and Regret Minimization
by: Mohri, Mehryar, et al.
Published: (2026)

Tensor-based computation of the Koopman generator via operator logarithm
by: Kishimoto, Tatsuya, et al.
Published: (2026)

Best of Both Worlds: Advantages of Hybrid Graph Sequence Models
by: Behrouz, Ali, et al.
Published: (2024)

Engineering Verifiable Modularity in Transformers via Per-Layer Supervision
by: Kerce, J. Clayton
Published: (2026)

Fixed Universal Transformers
by: Liu, Jingwen, et al.
Published: (2026)

Interpretable-by-Design Transformers via Architectural Stream Independence
by: Kerce, Clayton, et al.
Published: (2026)

The Dual-Stream Transformer: Channelized Architecture for Interpretable Language Modeling
by: Kerce, J. Clayton, et al.
Published: (2026)

Transformer-Based Approaches for Sensor-Based Human Activity Recognition: Opportunities and Challenges
by: Leite, Clayton Souza, et al.
Published: (2024)

Stream separation improves Bregman conditioning in transformers
by: Kerce, James Clayton
Published: (2026)

Adversarial Debiasing for Unbiased Parameter Recovery
by: Sanford, Luke C, et al.
Published: (2025)

The Implicit Bias of Gradient Descent on Separable Multiclass Data
by: Ravi, Hrithik, et al.
Published: (2024)

Dimension lower bounds for linear approaches to function approximation
by: Hsu, Daniel
Published: (2025)

Enhancing Motion Variation in Text-to-Motion Models via Pose and Video Conditioned Editing
by: Leite, Clayton, et al.
Published: (2024)

Flow Straight and Fast in Hilbert Space: Functional Rectified Flow
by: Zhang, Jianxin, et al.
Published: (2025)

Label Embedding via Low-Coherence Matrices
by: Zhang, Jianxin, et al.
Published: (2023)

Unified Binary and Multiclass Margin-Based Classification
by: Wang, Yutong, et al.
Published: (2023)

Hierarchical Motion Captioning Utilizing External Text Data Source
by: Leite, Clayton, et al.
Published: (2025)

Discovering influential text using convolutional neural networks
by: Ayers, Megan, et al.
Published: (2024)

Transformers Provably Learn Sparse Token Selection While Fully-Connected Nets Cannot
by: Wang, Zixuan, et al.
Published: (2024)

Data-Driven Hamiltonian Reduction for Superconducting Qubits via Meta-Learning
by: Sanford, Arielle, et al.
Published: (2026)

Multi-group Learning for Hierarchical Groups
by: Deng, Samuel, et al.
Published: (2024)

Simple and near-optimal algorithms for hidden stratification and multi-group learning
by: Tosh, Christopher, et al.
Published: (2021)

Learning Compositional Functions with Transformers from Easy-to-Hard Data
by: Wang, Zixuan, et al.
Published: (2025)

Transformer Model for Alzheimer's Disease Progression Prediction Using Longitudinal Visit Sequences
by: Moghaddami, Mahdi, et al.
Published: (2025)

Can AI-predicted complexes teach machine learning to compute drug binding affinity?
by: Hsu, Wei-Tse, et al.
Published: (2025)

Deep Learning Methods for Detecting Thermal Runaway Events in Battery Production Lines
by: Athanasopoulos, Athanasios, et al.
Published: (2025)

Unifying Interpretability and Explainability for Alzheimer's Disease Progression Prediction
by: Ali, Raja Farrukh, et al.
Published: (2024)