DynamicGate MLP Conditional Computation via Learned Structural Dropout and Input Dependent Gating for Functional Plasticity
Fuente:
arXiv
Guardado en:
| Autor principal: | Choi, Yong Il |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Learning Inference Concurrency in DynamicGate MLP Structural and Mathematical Justification
por: Choi, Yongil
Publicado: (2026)
por: Choi, Yongil
Publicado: (2026)
Rethinking Gating Mechanism in Sparse MoE: Handling Arbitrary Modality Inputs with Confidence-Guided Gate
por: Zheng, Liangwei Nathan, et al.
Publicado: (2025)
por: Zheng, Liangwei Nathan, et al.
Publicado: (2025)
Cross-Gate MLP with Protein Complex Invariant Embedding is A One-Shot Antibody Designer
por: Tan, Cheng, et al.
Publicado: (2023)
por: Tan, Cheng, et al.
Publicado: (2023)
Smooth Gate Functions for Soft Advantage Policy Optimization
por: Denisov, Egor, et al.
Publicado: (2026)
por: Denisov, Egor, et al.
Publicado: (2026)
Yet Unnoticed in LSTM: Binary Tree Based Input Reordering, Weight Regularization, and Gate Nonlinearization
por: Moattari, Mojtaba
Publicado: (2025)
por: Moattari, Mojtaba
Publicado: (2025)
Improving Dictionary Learning with Gated Sparse Autoencoders
por: Rajamanoharan, Senthooran, et al.
Publicado: (2024)
por: Rajamanoharan, Senthooran, et al.
Publicado: (2024)
Minion Gated Recurrent Unit for Continual Learning
por: Zyarah, Abdullah M., et al.
Publicado: (2025)
por: Zyarah, Abdullah M., et al.
Publicado: (2025)
Spectral Gating Networks
por: Zhang, Jusheng, et al.
Publicado: (2026)
por: Zhang, Jusheng, et al.
Publicado: (2026)
Gated Adaptation for Continual Learning in Human Activity Recognition
por: Azghan, Reza Rahimi, et al.
Publicado: (2026)
por: Azghan, Reza Rahimi, et al.
Publicado: (2026)
Hierarchically Gated Experts for Efficient Online Continual Learning
por: Luong, Kevin, et al.
Publicado: (2024)
por: Luong, Kevin, et al.
Publicado: (2024)
STABLE: Gated Continual Learning for Large Language Models
por: Hoy, William, et al.
Publicado: (2025)
por: Hoy, William, et al.
Publicado: (2025)
When to Stop Reusing: Dynamic Gradient Gating for Sample-Efficient RLVR
por: Miao, Yuchun, et al.
Publicado: (2026)
por: Miao, Yuchun, et al.
Publicado: (2026)
Pareto Continual Learning: Preference-Conditioned Learning and Adaption for Dynamic Stability-Plasticity Trade-off
por: Lai, Song, et al.
Publicado: (2025)
por: Lai, Song, et al.
Publicado: (2025)
When to ASK: Uncertainty-Gated Language Assistance for Reinforcement Learning
por: Monteiro, Juarez, et al.
Publicado: (2026)
por: Monteiro, Juarez, et al.
Publicado: (2026)
DeepGate3: Towards Scalable Circuit Representation Learning
por: Shi, Zhengyuan, et al.
Publicado: (2024)
por: Shi, Zhengyuan, et al.
Publicado: (2024)
Activation by Interval-wise Dropout: A Simple Way to Prevent Neural Networks from Plasticity Loss
por: Park, Sangyeon, et al.
Publicado: (2025)
por: Park, Sangyeon, et al.
Publicado: (2025)
Gating is Weighting: Understanding Gated Linear Attention through In-context Learning
por: Li, Yingcong, et al.
Publicado: (2025)
por: Li, Yingcong, et al.
Publicado: (2025)
KAN v.s. MLP for Offline Reinforcement Learning
por: Guo, Haihong, et al.
Publicado: (2024)
por: Guo, Haihong, et al.
Publicado: (2024)
From MLP to NeoMLP: Leveraging Self-Attention for Neural Fields
por: Kofinas, Miltiadis, et al.
Publicado: (2024)
por: Kofinas, Miltiadis, et al.
Publicado: (2024)
CADENT: Gated Hybrid Distillation for Sample-Efficient Transfer in Reinforcement Learning
por: Alinejad, Mahyar, et al.
Publicado: (2026)
por: Alinejad, Mahyar, et al.
Publicado: (2026)
Contrast-Enhanced Gating in GRUs for Robust Low-Data Sequence Learning
por: Subramanian, Barathi, et al.
Publicado: (2024)
por: Subramanian, Barathi, et al.
Publicado: (2024)
Relevance-driven Input Dropout: an Explanation-guided Regularization Technique
por: Gururaj, Shreyas, et al.
Publicado: (2025)
por: Gururaj, Shreyas, et al.
Publicado: (2025)
Fitting Multilinear Polynomials for Logic Gate Networks
por: Kim, Youngsung
Publicado: (2026)
por: Kim, Youngsung
Publicado: (2026)
Uncertainty Estimation using Variance-Gated Distributions
por: Gillis, H. Martin, et al.
Publicado: (2025)
por: Gillis, H. Martin, et al.
Publicado: (2025)
Action-Conditioned Risk Gating for Safety-Critical Control under Partial Observability
por: Liu, Yushen, et al.
Publicado: (2026)
por: Liu, Yushen, et al.
Publicado: (2026)
Liger: Linearizing Large Language Models to Gated Recurrent Structures
por: Lan, Disen, et al.
Publicado: (2025)
por: Lan, Disen, et al.
Publicado: (2025)
Looking to Learn: Token-wise Dynamic Gating for Low-Resource Vision-Language Modelling
por: Ganescu, Bianca-Mihaela, et al.
Publicado: (2025)
por: Ganescu, Bianca-Mihaela, et al.
Publicado: (2025)
Toward Efficient Influence Function: Dropout as a Compression Tool
por: Zhang, Yuchen, et al.
Publicado: (2025)
por: Zhang, Yuchen, et al.
Publicado: (2025)
Robot-Gated Interactive Imitation Learning with Adaptive Intervention Mechanism
por: Cai, Haoyuan, et al.
Publicado: (2025)
por: Cai, Haoyuan, et al.
Publicado: (2025)
FedSSG: Expectation-Gated and History-Aware Drift Alignment for Federated Learning
por: Zhou, Zhanting, et al.
Publicado: (2025)
por: Zhou, Zhanting, et al.
Publicado: (2025)
AGaLiTe: Approximate Gated Linear Transformers for Online Reinforcement Learning
por: Pramanik, Subhojeet, et al.
Publicado: (2023)
por: Pramanik, Subhojeet, et al.
Publicado: (2023)
CosineGate: Semantic Dynamic Routing via Cosine Incompatibility in Residual Networks
por: Thota, Yogeswar Reddy
Publicado: (2025)
por: Thota, Yogeswar Reddy
Publicado: (2025)
Fate: Fast Edge Inference of Mixture-of-Experts Models via Cross-Layer Gate
por: Fang, Zhiyuan, et al.
Publicado: (2025)
por: Fang, Zhiyuan, et al.
Publicado: (2025)
Rethinking the shape convention of an MLP
por: Chen, Meng-Hsi, et al.
Publicado: (2025)
por: Chen, Meng-Hsi, et al.
Publicado: (2025)
Uncertainty Gating for Cost-Aware Explainable Artificial Intelligence
por: Mikriukov, Georgii, et al.
Publicado: (2026)
por: Mikriukov, Georgii, et al.
Publicado: (2026)
Beyond Importance Sampling: Rejection-Gated Policy Optimization
por: Sun, Ziwu, et al.
Publicado: (2026)
por: Sun, Ziwu, et al.
Publicado: (2026)
Gate Recurrent Unit for Efficient Industrial Gas Identification
por: Wang, Ding
Publicado: (2024)
por: Wang, Ding
Publicado: (2024)
$λ$-GELU: Learning Gating Hardness for Controlled ReLU-ization in Deep Networks
por: Pérez-Corral, Cristian, et al.
Publicado: (2026)
por: Pérez-Corral, Cristian, et al.
Publicado: (2026)
Reinforcement Learning for Synchronised Flow Control in a Dual-Gate Resin Infusion System
por: Camacho-Sánchez, Miguel, et al.
Publicado: (2025)
por: Camacho-Sánchez, Miguel, et al.
Publicado: (2025)
ParaGate: Parasitic-Driven Domain Adaptation Transfer Learning for Netlist Performance Prediction
por: Sun, Bin, et al.
Publicado: (2025)
por: Sun, Bin, et al.
Publicado: (2025)
Ejemplares similares
-
Learning Inference Concurrency in DynamicGate MLP Structural and Mathematical Justification
por: Choi, Yongil
Publicado: (2026) -
Rethinking Gating Mechanism in Sparse MoE: Handling Arbitrary Modality Inputs with Confidence-Guided Gate
por: Zheng, Liangwei Nathan, et al.
Publicado: (2025) -
Cross-Gate MLP with Protein Complex Invariant Embedding is A One-Shot Antibody Designer
por: Tan, Cheng, et al.
Publicado: (2023) -
Smooth Gate Functions for Soft Advantage Policy Optimization
por: Denisov, Egor, et al.
Publicado: (2026) -
Yet Unnoticed in LSTM: Binary Tree Based Input Reordering, Weight Regularization, and Gate Nonlinearization
por: Moattari, Mojtaba
Publicado: (2025)