Image de couverture de livre

PolyGLU: State-Conditional Activation Routing in Transformer Feed-Forward Networks

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Medeiros, Daniel Nobrega
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Artificial Intelligence Emerging Technologies 68T07 I.2.6; I.5.1
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Optimizing Inference in Transformer-Based Models: A Multi-Method Benchmark
par: Ho, Siu Hang, et autres
Publié: (2025)

Explicit Dropout: Deterministic Regularization for Transformer Architectures
par: Agrawal, Vidhi, et autres
Publié: (2026)

Massive Redundancy in Gradient Transport Enables Sparse Online Learning
par: Merin, Aur Shalev
Publié: (2026)

Is Cambodia the World's Largest Cashew Producer?
par: Chaya, Veasna, et autres
Publié: (2024)

CVCM Track Circuits Pre-emptive Failure Diagnostics for Predictive Maintenance Using Deep Neural Networks
par: Mukherjee, Debdeep, et autres
Publié: (2025)

multivariateGPT: a decoder-only transformer for multivariate categorical and numeric data
par: Loza, Andrew J., et autres
Publié: (2025)

DecompKAN: Decomposed Patch-KAN for Long-Term Time Series Forecasting
par: Mysore, Naveen
Publié: (2026)

Scaling Laws in the Tiny Regime: How Small Models Change Their Mistakes
par: Alnemari, Mohammed, et autres
Publié: (2026)

Energy-Efficient Neuromorphic Computing for Edge AI: A Framework with Adaptive Spiking Neural Networks and Hardware-Aware Optimization
par: Imanov, Olaf Yunus Laitinen, et autres
Publié: (2026)

Efficient Morphology-Control Co-Design via Stackelberg Proximal Policy Optimization
par: Dai, Yanning, et autres
Publié: (2026)

torchsom: The Reference PyTorch Library for Self-Organizing Maps
par: Berthier, Louis, et autres
Publié: (2025)

EchoLSTM: A Self-Reflective Recurrent Network for Stabilizing Long-Range Memory
par: K, Prasanth K, et autres
Publié: (2025)

Tricks and Plug-ins for Gradient Boosting with Transformers
par: Fang, Biyi, et autres
Publié: (2025)

Closing the Theory-Practice Gap in Spiking Transformers via Effective Dimension
par: Guo, Dongxin, et autres
Publié: (2026)

CellARC: Measuring Intelligence with Cellular Automata
par: Lžičař, Miroslav
Publié: (2025)

H-Model: Dynamic Neural Architectures for Adaptive Processing
par: Hospodarchuk, Dmytro
Publié: (2025)

VDW-GNNs: Vector diffusion wavelets for geometric graph neural networks
par: Johnson, David R., et autres
Publié: (2025)

Revisiting GAN with Bayes-Optimal Discrimination
par: Naeini, Mohammadreza Tavasoli, et autres
Publié: (2025)

Predicting Traffic Accident Severity with Deep Neural Networks
par: Bibb, Meghan, et autres
Publié: (2025)

A Hybrid Inductive-Transductive Network for Traffic Flow Imputation on Unsampled Locations
par: Rahimiasl, Mohammadmahdi, et autres
Publié: (2025)

Scalable, Technology-Agnostic Diagnosis and Predictive Maintenance for Point Machine using Deep Learning
par: Di Santi, Eduardo, et autres
Publié: (2025)

JacNet: Learning Functions with Structured Jacobians
par: Lorraine, Jonathan, et autres
Publié: (2024)

Revisiting Non-separable Binary Classification and its Applications in Anomaly Detection
par: Lau, Matthew, et autres
Publié: (2023)

On the Convergence and Stability of Upside-Down Reinforcement Learning, Goal-Conditioned Supervised Learning, and Online Decision Transformers
par: Štrupl, Miroslav, et autres
Publié: (2025)

Eventprop training for efficient neuromorphic applications
par: Shoesmith, Thomas, et autres
Publié: (2025)

SigGate-GT: Taming Over-Smoothing in Graph Transformers via Sigmoid-Gated Attention
par: Guo, Dongxin, et autres
Publié: (2026)

Pulse-Driven Neural Architecture: Learnable Oscillatory Dynamics for Robust Continuous-Time Sequence Processing
par: Sharma, Paras
Publié: (2026)

GraphNNK -- Graph Classification and Interpretability
par: Bolevic, Zeljko, et autres
Publié: (2026)

Temporal Functional Circuits: From Spline Plots to Faithful Explanations in KAN Forecasting
par: Mysore, Naveen
Publié: (2026)

Understanding Generalization, Robustness, and Interpretability in Low-Capacity Neural Networks
par: Kumar, Yash
Publié: (2025)

An in-depth look at approximation via deep and narrow neural networks
par: Dommel, Joris, et autres
Publié: (2025)

Adaptive Negative Scheduling for Graph Contrastive Learning
par: Ali, Adnan, et autres
Publié: (2026)

The Impact of Data Characteristics on GNN Evaluation for Detecting Fake News
par: Karn, Isha, et autres
Publié: (2025)

The Normalized Difference Layer: A Differentiable Spectral Index Formulation for Deep Learning
par: Lotfi, Ali, et autres
Publié: (2026)

A Boltzmann-machine-enhanced Transformer For DNA Sequence Classification
par: Cao, Zhixuan, et autres
Publié: (2026)

Functional Similarity Metric for Neural Networks: Overcoming Parametric Ambiguity via Activation Region Analysis
par: Hennadii, Kutomanov
Publié: (2026)

Predictive Modeling of Maritime Radar Data Using Transformer Architecture
par: Qesaraku, Bjorna, et autres
Publié: (2025)

Complex-Valued Phase-Coherent Transformer
par: Hioki, Leona
Publié: (2026)

TGraphX: Tensor-Aware Graph Neural Network for Multi-Dimensional Feature Learning
par: Sajjadi, Arash, et autres
Publié: (2025)

Contract-Driven QoE Auditing for Speech and Singing Services: From MOS Regression to Service Graphs
par: Du, Wenzhang
Publié: (2025)