Image de couverture de livre

Softlog-Softmax Layers and Divergences Contribute to a Computationally Dependable Ensemble Learning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Atto, Abdourrahmane Mahamane
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Time Distributed Deep Learning Models for Purely Exogenous Forecasting: Application to Water Table Depth Prediction using Weather Image Time Series
par: Salis, Matteo, et autres
Publié: (2024)

Pure and Physics-Guided Deep Learning Solutions for Spatio-Temporal Groundwater Level Prediction at Arbitrary Locations
par: Salis, Matteo, et autres
Publié: (2026)

Adaptive Sparse Softmax: An Effective and Efficient Softmax Variant
par: Lv, Qi, et autres
Publié: (2025)

Reusing Softmax Hardware Unit for GELU Computation in Transformers
par: Peltekis, Christodoulos, et autres
Publié: (2024)

Smooth SCAD: A Raised Cosine SCAD Type Thresholding Rule for Wavelet Denoising
par: Kulkarni, Radhika, et autres
Publié: (2026)

Hardware-Efficient Softmax and Layer Normalization with Guaranteed Normalization for Edge Devices
par: Choi, Dawon, et autres
Publié: (2026)

Online Continual Learning via Logit Adjusted Softmax
par: Huang, Zhehao, et autres
Publié: (2023)

Implicit Regularization of Gradient Flow on One-Layer Softmax Attention
par: Sheen, Heejune, et autres
Publié: (2024)

To Softmax, or not to Softmax: that is the question when applying Active Learning for Transformer Models
par: Gonsior, Julius, et autres
Publié: (2022)

Softmax as a Lagrangian-Legendrian Seam
par: Lee-Jenkins, Christopher R.
Publié: (2025)

Is Softmax Loss All You Need? A Principled Analysis of Softmax-family Loss
par: Pu, Yuanhao, et autres
Publié: (2026)

Vertex-Softmax: Tight Transformer Verification via Exact Softmax Optimization
par: Rezazadeh, Navid, et autres
Publié: (2026)

SOLE: Hardware-Software Co-design of Softmax and LayerNorm for Efficient Transformer Inference
par: Wang, Wenxun, et autres
Publié: (2025)

Beyond Linear Attention: Softmax Transformers Implement In-Context Reinforcement Learning
par: Xie, Zixuan, et autres
Publié: (2026)

A Boundary-Layer Mechanism for One-Third Scaling in Online Softmax Classification
par: Kühn, Marcel, et autres
Publié: (2026)

Scalable Hyperparameter-Divergent Ensemble Training with Automatic Learning Rate Exploration for Large Models
par: Cheng, Hailing, et autres
Publié: (2026)

Divergent Ensemble Networks: Enhancing Uncertainty Estimation with Shared Representations and Independent Branching
par: Kharbanda, Arnav, et autres
Publié: (2024)

Learning Theory of Transformers: Local-to-Global Approximation via Softmax Partition of Unity
par: Shi, Zhongjie, et autres
Publié: (2026)

Universal Approximation with Softmax Attention
par: Hu, Jerry Yao-Chieh, et autres
Publié: (2025)

Gumbel-MPNN: Graph Rewiring with Gumbel-Softmax
par: Hoffmann, Marcel, et autres
Publié: (2025)

Convergence Rates for Softmax Gating Mixture of Experts
par: Nguyen, Huy, et autres
Publié: (2025)

NDCG-Consistent Softmax Approximation with Accelerated Convergence
par: Pu, Yuanhao, et autres
Publié: (2025)

CGF-Softmax: A Cumulant-Based Softmax Reformulation for Efficient Inference under Homomorphic Encryption
par: Park, Hanjun, et autres
Publié: (2026)

Minimalist Softmax Attention Provably Learns Constrained Boolean Functions
par: Hu, Jerry Yao-Chieh, et autres
Publié: (2025)

Towards Understanding Layer Contributions in Tabular In-Context Learning Models
par: Balef, Amir Rezaei, et autres
Publié: (2025)

On Minimax Estimation of Parameters in Softmax-Contaminated Mixture of Experts
par: Yan, Fanqi, et autres
Publié: (2025)

Softpick: No Attention Sink, No Massive Activations with Rectified Softmax
par: Zuhri, Zayd M. K., et autres
Publié: (2025)

On Least Square Estimation in Softmax Gating Mixture of Experts
par: Nguyen, Huy, et autres
Publié: (2024)

Is Temperature Sample Efficient for Softmax Gaussian Mixture of Experts?
par: Nguyen, Huy, et autres
Publié: (2024)

VEXP: A Low-Cost RISC-V ISA Extension for Accelerated Softmax Computation in Transformers
par: Wang, Run, et autres
Publié: (2025)

Softmax is not Enough (for Adaptive Conformal Classification)
par: Attar, Navid Akhavan, et autres
Publié: (2026)

Batch Ensemble for Variance Dependent Regret in Stochastic Bandits
par: Cassel, Asaf, et autres
Publié: (2024)

LOTOS: Layer-wise Orthogonalization for Training Robust Ensembles
par: Ebrahimpour-Boroojeny, Ali, et autres
Publié: (2024)

Scalable-Softmax Is Superior for Attention
par: Nakanishi, Ken M.
Publié: (2025)

On the Expressiveness of Softmax Attention: A Recurrent Neural Network Perspective
par: Mongaras, Gabriel, et autres
Publié: (2025)

Beyond Softmax: A Natural Parameterization for Categorical Random Variables
par: Manenti, Alessandro, et autres
Publié: (2025)

Customizing the Inductive Biases of Softmax Attention using Structured Matrices
par: Kuang, Yilun, et autres
Publié: (2025)

Binary Hypothesis Testing for Softmax Models and Leverage Score Models
par: Gu, Yuzhou, et autres
Publié: (2024)

A Lyapunov Analysis of Softmax Policy Gradient for Stochastic Bandits
par: Lattimore, Tor
Publié: (2026)

In-Context Learning with Transformers: Softmax Attention Adapts to Function Lipschitzness
par: Collins, Liam, et autres
Publié: (2024)