Copertina

ANAct: Adaptive Normalization for Activation Functions

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Peiwen, Yuan, Liu, Henan, Changsheng, Zhu, Wang, Yuyi
Natura:	Preprint
Pubblicazione:	2022
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

FedAPA: Federated Learning with Adaptive Prototype Aggregation Toward Heterogeneous Wi-Fi CSI-based Crowd Counting
di: Guo, Jingtao, et al.
Pubblicazione: (2025)

Astro: Activation-guided Structured Regularization for Outlier-Robust LLM Post-Training Quantization
di: Chen, Xi, et al.
Pubblicazione: (2026)

On the Mathematical Relationship Between Layer Normalization and Dynamic Activation Functions
di: Stollenwerk, Felix
Pubblicazione: (2025)

A Method on Searching Better Activation Functions
di: Sun, Haoyuan, et al.
Pubblicazione: (2024)

MetaSymNet: A Tree-like Symbol Network with Adaptive Architecture and Activation Functions
di: Li, Yanjie, et al.
Pubblicazione: (2023)

GRANOLA: Adaptive Normalization for Graph Neural Networks
di: Eliasof, Moshe, et al.
Pubblicazione: (2024)

Continuous-Time Analysis of Adaptive Optimization and Normalization
di: Gould, Rhys, et al.
Pubblicazione: (2024)

RepAct: The Re-parameterizable Adaptive Activation Function
di: Wu, Xian, et al.
Pubblicazione: (2024)

CLeAN: Continual Learning Adaptive Normalization in Dynamic Environments
di: Marasco, Isabella, et al.
Pubblicazione: (2026)

SmartMixed: A Two-Phase Training Strategy for Adaptive Activation Function Learning in Neural Networks
di: Omidvar, Amin
Pubblicazione: (2025)

Global Convergence in Neural ODEs: Impact of Activation Functions
di: Gao, Tianxiang, et al.
Pubblicazione: (2025)

Mining Generalizable Activation Functions
di: Vitvitskyi, Alex, et al.
Pubblicazione: (2026)

SCALA: Split Federated Learning with Concatenated Activations and Logit Adjustments
di: Yang, Jiarong, et al.
Pubblicazione: (2024)

Frequency Adaptive Normalization For Non-stationary Time Series Forecasting
di: Ye, Weiwei, et al.
Pubblicazione: (2024)

TimeGMM: Single-Pass Probabilistic Forecasting via Adaptive Gaussian Mixture Models with Reversible Normalization
di: Liu, Lei, et al.
Pubblicazione: (2026)

WiSparse: Boosting LLM Inference Efficiency with Weight-Aware Mixed Activation Sparsity
di: Chen, Lei, et al.
Pubblicazione: (2026)

More Expressive Feedforward Layers: Part I. Token-Adaptive Mixing of Activations
di: Wang, Mingze, et al.
Pubblicazione: (2026)

Learning to refine domain knowledge for biological network inference
di: Li, Peiwen, et al.
Pubblicazione: (2024)

DREAM: Domain-agnostic Reverse Engineering Attributes of Black-box Model
di: Li, Rongqing, et al.
Pubblicazione: (2024)

FusionCast: Enhancing Precipitation Nowcasting with Asymmetric Cross-Modal Fusion and Future Radar Priors
di: Wang, Henan, et al.
Pubblicazione: (2026)

Causal-aware Graph Neural Architecture Search under Distribution Shifts
di: Li, Peiwen, et al.
Pubblicazione: (2024)

RealTCD: Temporal Causal Discovery from Interventional Data with Large Language Model
di: Li, Peiwen, et al.
Pubblicazione: (2024)

ScoresActivation: A New Activation Function for Model Agnostic Global Explainability by Design
di: Covaci, Emanuel, et al.
Pubblicazione: (2025)

Efficient Search for Customized Activation Functions with Gradient Descent
di: Strack, Lukas, et al.
Pubblicazione: (2024)

TimeAPN: Adaptive Amplitude-Phase Non-Stationarity Normalization for Time Series Forecasting
di: Hu, Yue, et al.
Pubblicazione: (2026)

Adaptive Normalization Mamba with Multi Scale Trend Decomposition and Patch MoE Encoding
di: Jeon, MinCheol
Pubblicazione: (2025)

IBNorm: Information-Bottleneck Inspired Normalization for Representation Learning
di: Zou, Xiandong, et al.
Pubblicazione: (2025)

FAME: Adaptive Functional Attention with Expert Routing for Function-on-Function Regression
di: Gao, Yifei, et al.
Pubblicazione: (2025)

DyTTP: Trajectory Prediction with Normalization-Free Transformers
di: Zhu, JianLin, et al.
Pubblicazione: (2025)

SpherE: Expressive and Interpretable Knowledge Graph Embedding for Set Retrieval
di: Li, Zihao, et al.
Pubblicazione: (2024)

On the Expressive Power and Limitations of Multi-Layer SSMs
di: Zubić, Nikola, et al.
Pubblicazione: (2026)

Unifying Perplexing Behaviors in Modified BP Attributions through Alignment Perspective
di: Zheng, Guanhua, et al.
Pubblicazione: (2025)

Revisiting Essential and Nonessential Settings of Evidential Deep Learning
di: Chen, Mengyuan, et al.
Pubblicazione: (2024)

Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?
di: Chen, Xi, et al.
Pubblicazione: (2024)

ReLU$^2$ Wins: Discovering Efficient Activation Functions for Sparse LLMs
di: Zhang, Zhengyan, et al.
Pubblicazione: (2024)

Adaptive Transformer Modelling of Density Function for Nonparametric Survival Analysis
di: Zhang, Xin, et al.
Pubblicazione: (2024)

Meta-Learning Adaptive Loss Functions
di: Raymond, Christian, et al.
Pubblicazione: (2023)

HoReN: Normalized Hopfield Retrieval for Large-Scale Sequential Model Editing
di: Fang, Yuan, et al.
Pubblicazione: (2026)

Doubly Stochastic Adaptive Neighbors Clustering via the Marcus Mapping
di: Yuan, Jinghui, et al.
Pubblicazione: (2024)

Adaptive Friction in Deep Learning: Enhancing Optimizers with Sigmoid and Tanh Function
di: Zheng, Hongye, et al.
Pubblicazione: (2024)