Image de couverture de livre

Masked Gated Linear Unit

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Tajima, Yukito, Inoue, Nakamasa, Sekikawa, Yusuke, Sato, Ikuro, Yokota, Rio
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Rectified Lagrangian for Out-of-Distribution Detection in Modern Hopfield Networks
par: Moriai, Ryo, et autres
Publié: (2025)

DF-Mamba: Deformable State Space Modeling for 3D Hand Pose Estimation in Interactions
par: Zhou, Yifan, et autres
Publié: (2025)

On the Relationship Between Double Descent of CNNs and Shape/Texture Bias Under Learning Process
par: Iwase, Shun, et autres
Publié: (2025)

On the Optimal Reasoning Length for RL-Trained Language Models
par: Nohara, Daisuke, et autres
Publié: (2026)

Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization
par: Nakamura, Taishi, et autres
Publié: (2025)

Takeuchi's Information Criteria as Generalization Measures for DNNs Close to NTK Regime
par: Naganuma, Hiroki, et autres
Publié: (2026)

Gated Linear Attention Transformers with Hardware-Efficient Training
par: Yang, Songlin, et autres
Publié: (2023)

SEA: Sparse Linear Attention with Estimated Attention Mask
par: Lee, Heejun, et autres
Publié: (2023)

ELP-Adapters: Parameter Efficient Adapter Tuning for Various Speech Processing Tasks
par: Inoue, Nakamasa, et autres
Publié: (2024)

Text Sentiment Analysis and Classification Based on Bidirectional Gated Recurrent Units (GRUs) Model
par: Xu, Wei, et autres
Publié: (2024)

Enhancing Bangla Fake News Detection Using Bidirectional Gated Recurrent Units and Deep Learning Techniques
par: Roy, Utsha, et autres
Publié: (2024)

GUMBEL-NERF: Representing Unseen Objects as Part-Compositional Neural Radiance Fields
par: Sekikawa, Yusuke, et autres
Publié: (2024)

Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
par: De, Soham, et autres
Publié: (2024)

Dissecting Linear Recurrent Models: How Different Gating Strategies Drive Selectivity and Generalization
par: Bouhadjar, Younes, et autres
Publié: (2026)

Improving LoRA with Variational Learning
par: Cong, Bai, et autres
Publié: (2025)

Liger: Linearizing Large Language Models to Gated Recurrent Structures
par: Lan, Disen, et autres
Publié: (2025)

Gating is Weighting: Understanding Gated Linear Attention through In-context Learning
par: Li, Yingcong, et autres
Publié: (2025)

Optimal Sparsity of Mixture-of-Experts Language Models for Reasoning Tasks
par: Nakamura, Taishi, et autres
Publié: (2025)

Variational Low-Rank Adaptation Using IVON
par: Cong, Bai, et autres
Publié: (2024)

Pre-training Vision Transformers with Formula-driven Supervised Learning
par: Kataoka, Hirokatsu, et autres
Publié: (2022)

Faithfulness Measurable Masked Language Models
par: Madsen, Andreas, et autres
Publié: (2023)

Representation Deficiency in Masked Language Modeling
par: Meng, Yu, et autres
Publié: (2023)

Multi-Agent Debate with Memory Masking
par: Tian, Hongduan, et autres
Publié: (2026)

Masked Mixers for Language Generation and Retrieval
par: Badger, Benjamin L.
Publié: (2024)

CoGate-LSTM: Prototype-Guided Feature-Space Gating for Mitigating Gradient Dilution in Imbalanced Toxic Comment Classification
par: Mohammad, Noor Islam S.
Publié: (2025)

Contextual Text Denoising with Masked Language Models
par: Sun, Yifu, et autres
Publié: (2019)

Scaling Beyond Masked Diffusion Language Models
par: Sahoo, Subham Sekhar, et autres
Publié: (2026)

FGGM: Fisher-Guided Gradient Masking for Continual Learning
par: Tan, Chao-Hong, et autres
Publié: (2026)

Improving Rare Word Translation With Dictionaries and Attention Masking
par: Sible, Kenneth J., et autres
Publié: (2024)

Understanding Gated Neurons in Transformers from Their Input-Output Functionality
par: Gerstner, Sebastian, et autres
Publié: (2025)

In-context KV-Cache Eviction for LLMs via Attention-Gate
par: Zeng, Zihao, et autres
Publié: (2024)

Gated Delta Networks: Improving Mamba2 with Delta Rule
par: Yang, Songlin, et autres
Publié: (2024)

GATES: Self-Distillation under Privileged Context with Consensus Gating
par: Stein, Alex, et autres
Publié: (2026)

Max-pooling Network Revisited: Analyzing the Role of Semantic Probability in Multiple Instance Learning for Hallucination Detection
par: Fujikawa, Shota, et autres
Publié: (2026)

Rethinking Associative Memory Mechanism in Induction Head
par: Wang, Shuo, et autres
Publié: (2024)

Stopping Computation for Converged Tokens in Masked Diffusion-LM Decoding
par: Oba, Daisuke, et autres
Publié: (2026)

Towards Probabilistically-Sound Beam Search with Masked Language Models
par: Brooks, Creston, et autres
Publié: (2024)

Diffusion-State Policy Optimization for Masked Diffusion Language Models
par: Oba, Daisuke, et autres
Publié: (2026)

Faster Transformer Decoding: N-gram Masked Self-Attention
par: Chelba, Ciprian, et autres
Publié: (2020)

DOS: Dependency-Oriented Sampler for Masked Diffusion Language Models
par: Zhou, Xueyu, et autres
Publié: (2026)