Enregistré dans:
| Auteur principal: | Gumaan, Esmail |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | https://arxiv.org/abs/2507.10581 |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
Mixture of Attention Schemes (MoAS): Learning to Route Between MHA, GQA, and MQA
par: Gumaan, Esmail
Publié: (2025)
par: Gumaan, Esmail
Publié: (2025)
Theoretical Foundations and Mitigation of Hallucination in Large Language Models
par: Gumaan, Esmail
Publié: (2025)
par: Gumaan, Esmail
Publié: (2025)
ExpertRAG: Efficient RAG with Mixture of Experts -- Optimizing Context Retrieval for Adaptive LLM Responses
par: Gumaan, Esmail
Publié: (2025)
par: Gumaan, Esmail
Publié: (2025)
From Universal Approximation Theorem to Tropical Geometry of Multi-Layer Perceptrons
par: Chu, Yi-Shan, et autres
Publié: (2025)
par: Chu, Yi-Shan, et autres
Publié: (2025)
SGFormer: Single-Layer Graph Transformers with Approximation-Free Linear Complexity
par: Wu, Qitian, et autres
Publié: (2024)
par: Wu, Qitian, et autres
Publié: (2024)
Universal Approximation Theorem of Deep Q-Networks
par: Qi, Qian
Publié: (2025)
par: Qi, Qian
Publié: (2025)
Galvatron: Automatic Distributed Training for Large Transformer Models
par: Gumaan, Esmail
Publié: (2025)
par: Gumaan, Esmail
Publié: (2025)
Universal Approximation Theorem for Deep Q-Learning via FBSDE System
par: Qi, Qian
Publié: (2025)
par: Qi, Qian
Publié: (2025)
Prompting a Pretrained Transformer Can Be a Universal Approximator
par: Petrov, Aleksandar, et autres
Publié: (2024)
par: Petrov, Aleksandar, et autres
Publié: (2024)
Multi-Layer Transformers Gradient Can be Approximated in Almost Linear Time
par: Liang, Yingyu, et autres
Publié: (2024)
par: Liang, Yingyu, et autres
Publié: (2024)
Universal Approximation with Softmax Attention
par: Hu, Jerry Yao-Chieh, et autres
Publié: (2025)
par: Hu, Jerry Yao-Chieh, et autres
Publié: (2025)
On the Mathematical Impossibility of Safe Universal Approximators
par: Yao, Jasper
Publié: (2025)
par: Yao, Jasper
Publié: (2025)
Gradient Boosting within a Single Attention Layer
par: Sargolzaei, Saleh
Publié: (2026)
par: Sargolzaei, Saleh
Publié: (2026)
Transformer Approximations from ReLUs
par: Hu, Jerry Yao-Chieh, et autres
Publié: (2026)
par: Hu, Jerry Yao-Chieh, et autres
Publié: (2026)
Universal Approximation of Visual Autoregressive Transformers
par: Chen, Yifang, et autres
Publié: (2025)
par: Chen, Yifang, et autres
Publié: (2025)
Categorical Equivariant Deep Learning: Category-Equivariant Neural Networks and Universal Approximation Theorems
par: Maruyama, Yoshihiro
Publié: (2025)
par: Maruyama, Yoshihiro
Publié: (2025)
Dynamic Universal Approximation Theory: The Basic Theory for Transformer-based Large Language Models
par: Wang, Wei, et autres
Publié: (2024)
par: Wang, Wei, et autres
Publié: (2024)
Attention Mechanism, Max-Affine Partition, and Universal Approximation
par: Liu, Hude, et autres
Publié: (2025)
par: Liu, Hude, et autres
Publié: (2025)
2-Cats: 2D Copula Approximating Transforms
par: Figueiredo, Flavio, et autres
Publié: (2023)
par: Figueiredo, Flavio, et autres
Publié: (2023)
Layer Specialization Underlying Compositional Reasoning in Transformers
par: Liu, Jing
Publié: (2025)
par: Liu, Jing
Publié: (2025)
Transformer Normalisation Layers and the Independence of Semantic Subspaces
par: Menary, Stephen, et autres
Publié: (2024)
par: Menary, Stephen, et autres
Publié: (2024)
Dynamic Layer Tying for Parameter-Efficient Transformers
par: Hay, Tamir David, et autres
Publié: (2024)
par: Hay, Tamir David, et autres
Publié: (2024)
A General Method for Proving Networks Universal Approximation Property
par: Wang, Wei
Publié: (2025)
par: Wang, Wei
Publié: (2025)
Dynamic Universal Approximation Theory: Foundations for Parallelism in Neural Networks
par: Wang, Wei, et autres
Publié: (2024)
par: Wang, Wei, et autres
Publié: (2024)
Stacked Universal Successor Feature Approximators for Safety in Reinforcement Learning
par: Cannon, Ian, et autres
Publié: (2024)
par: Cannon, Ian, et autres
Publié: (2024)
WARP: Guaranteed Inner-Layer Repair of NLP Transformers
par: Hsu, Hsin-Ling, et autres
Publié: (2026)
par: Hsu, Hsin-Ling, et autres
Publié: (2026)
HardNet: Hard-Constrained Neural Networks with Universal Approximation Guarantees
par: Min, Youngjae, et autres
Publié: (2024)
par: Min, Youngjae, et autres
Publié: (2024)
Implicit Statistical Inference in Transformers: Approximating Likelihood-Ratio Tests In-Context
par: Chaudhry, Faris, et autres
Publié: (2026)
par: Chaudhry, Faris, et autres
Publié: (2026)
MambaSL: Exploring Single-Layer Mamba for Time Series Classification
par: Jung, Yoo-Min, et autres
Publié: (2026)
par: Jung, Yoo-Min, et autres
Publié: (2026)
On the Role of Transformer Feed-Forward Layers in Nonlinear In-Context Learning
par: Sun, Haoyuan, et autres
Publié: (2025)
par: Sun, Haoyuan, et autres
Publié: (2025)
Engineering Verifiable Modularity in Transformers via Per-Layer Supervision
par: Kerce, J. Clayton
Publié: (2026)
par: Kerce, J. Clayton
Publié: (2026)
Outlier-Efficient Hopfield Layers for Large Transformer-Based Models
par: Hu, Jerry Yao-Chieh, et autres
Publié: (2024)
par: Hu, Jerry Yao-Chieh, et autres
Publié: (2024)
Revisiting Transformer Layer Parameterization Through Causal Energy Minimization
par: Xu, Jin, et autres
Publié: (2026)
par: Xu, Jin, et autres
Publié: (2026)
GPG: Generalized Policy Gradient Theorem for Transformer-based Policies
par: Mao, Hangyu, et autres
Publié: (2025)
par: Mao, Hangyu, et autres
Publié: (2025)
The Condensate Theorem: Transformers are O(n), Not $O(n^2)$
par: Williams, Jorge L. Ruiz
Publié: (2026)
par: Williams, Jorge L. Ruiz
Publié: (2026)
Non-Asymptotic Analysis for Single-Loop (Natural) Actor-Critic with Compatible Function Approximation
par: Wang, Yudan, et autres
Publié: (2024)
par: Wang, Yudan, et autres
Publié: (2024)
AGaLiTe: Approximate Gated Linear Transformers for Online Reinforcement Learning
par: Pramanik, Subhojeet, et autres
Publié: (2023)
par: Pramanik, Subhojeet, et autres
Publié: (2023)
StagFormer: Time Staggering Transformer Decoding for RunningLayers In Parallel
par: Cutler, Dylan, et autres
Publié: (2025)
par: Cutler, Dylan, et autres
Publié: (2025)
Multi-Layer Attention-Based Explainability via Transformers for Tabular Data
par: Gavito, Andrea Treviño, et autres
Publié: (2023)
par: Gavito, Andrea Treviño, et autres
Publié: (2023)
ReSAE: Residualized Sparse Autoencoders for Multi-Layer Transformer Interventions
par: Poduval, Prathyush, et autres
Publié: (2026)
par: Poduval, Prathyush, et autres
Publié: (2026)
Documents similaires
-
Mixture of Attention Schemes (MoAS): Learning to Route Between MHA, GQA, and MQA
par: Gumaan, Esmail
Publié: (2025) -
Theoretical Foundations and Mitigation of Hallucination in Large Language Models
par: Gumaan, Esmail
Publié: (2025) -
ExpertRAG: Efficient RAG with Mixture of Experts -- Optimizing Context Retrieval for Adaptive LLM Responses
par: Gumaan, Esmail
Publié: (2025) -
From Universal Approximation Theorem to Tropical Geometry of Multi-Layer Perceptrons
par: Chu, Yi-Shan, et autres
Publié: (2025) -
SGFormer: Single-Layer Graph Transformers with Approximation-Free Linear Complexity
par: Wu, Qitian, et autres
Publié: (2024)