Imagen de Portada

Hidden Synergy: $L_1$ Weight Normalization and 1-Path-Norm Regularization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Biswas, Aditya
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Learning Spatially Adaptive $\ell_1$-Norms Weights for Convolutional Synthesis Regularization
por: Kofler, Andreas, et al.
Publicado: (2025)

IterL2Norm: Fast Iterative L2-Normalization
por: Ye, ChangMin, et al.
Publicado: (2024)

Robust Implicit Regularization via Weight Normalization
por: Chou, Hung-Hsu, et al.
Publicado: (2023)

Implicit Regularization Paths of Weighted Neural Representations
por: Du, Jin-Hong, et al.
Publicado: (2024)

FlashNorm: Fast Normalization for Transformers
por: Graef, Nils, et al.
Publicado: (2024)

Nuclear Norm Regularization for Deep Learning
por: Scarvelis, Christopher, et al.
Publicado: (2024)

L1 Regularization Paths in Linear Models by Parametric Gaussian Message Passing
por: Li, Yun-Peng, et al.
Publicado: (2026)

UnitNorm: Rethinking Normalization for Transformers in Time Series
por: Huang, Nan, et al.
Publicado: (2024)

Adaptive Norm-Based Regularization for Neural Networks
por: Qasim, Muhammad, et al.
Publicado: (2026)

MimicNorm: Weight Mean and Last BN Layer Mimic the Dynamic of Batch Normalization
por: Fei, Wen, et al.
Publicado: (2020)

Neural Weight Norm = Kolmogorov Complexity
por: Musat, Tiberiu
Publicado: (2026)

Generalized Gradient Norm Clipping & Non-Euclidean $(L_0,L_1)$-Smoothness
por: Pethick, Thomas, et al.
Publicado: (2025)

Weight-Sharing Regularization
por: Shakerinava, Mehran, et al.
Publicado: (2023)

Conflicting Biases at the Edge of Stability: Norm versus Sharpness Regularization
por: Matveev, Maria, et al.
Publicado: (2025)

Nuclear Norm Regularized Estimation of Panel Regression Models
por: Moon, Hyungsik Roger, et al.
Publicado: (2018)

Relative Error Bound Analysis for Nuclear Norm Regularized Matrix Completion
por: Zhang, Lijun, et al.
Publicado: (2015)

Universal Architectures for the Learning of Polyhedral Norms and Convex Regularizers
por: Unser, Michael, et al.
Publicado: (2025)

Error Feedback under $(L_0,L_1)$-Smoothness: Normalization and Momentum
por: Khirirat, Sarit, et al.
Publicado: (2024)

FedNAR: Federated Optimization with Normalized Annealing Regularization
por: Li, Junbo, et al.
Publicado: (2023)

Fast and Unified Path Gradient Estimators for Normalizing Flows
por: Vaitl, Lorenz, et al.
Publicado: (2024)

Towards Optimal Sobolev Norm Rates for the Vector-Valued Regularized Least-Squares Algorithm
por: Li, Zhu, et al.
Publicado: (2023)

$L_1$-norm Regularized Indefinite Kernel Logistic Regression
por: Wang, Shaoxin, et al.
Publicado: (2025)

L1-Regularized Functional Support Vector Machine
por: Liu, Bingfan, et al.
Publicado: (2025)

Stable and Steerable Sparse Autoencoders with Weight Regularization
por: Jedryszek, Piotr, et al.
Publicado: (2026)

Normalized Space Alignment: A Versatile Metric for Representation Analysis
por: Ebadulla, Danish, et al.
Publicado: (2024)

Scaling CrossQ with Weight Normalization
por: Palenicek, Daniel, et al.
Publicado: (2025)

On the Weight Dynamics of Deep Normalized Networks
por: Mehmeti-Göpel, Christian H. X. Ali, et al.
Publicado: (2023)

PolyNorm: Few-Shot LLM-Based Text Normalization for Text-to-Speech
por: Wong, Michel, et al.
Publicado: (2025)

GAS-Norm: Score-Driven Adaptive Normalization for Non-Stationary Time Series Forecasting in Deep Learning
por: Urettini, Edoardo, et al.
Publicado: (2024)

QuadNorm: Resolution-Robust Normalization for Neural Operators
por: Kim, Bum Jun, et al.
Publicado: (2026)

Revisiting Weight Regularization for Low-Rank Continual Learning
por: Zheng, Yaoyue, et al.
Publicado: (2026)

Norm-Q: Effective Compression Method for Hidden Markov Models in Neuro-Symbolic Applications
por: Gao, Hanyuan, et al.
Publicado: (2025)

Weighted Averaged Stochastic Gradient Descent: Asymptotic Normality and Optimality
por: Wei, Ziyang, et al.
Publicado: (2023)

Path-Weighted Integrated Gradients for Interpretable Dementia Classification
por: Kamalov, Firuz, et al.
Publicado: (2025)

The Hidden Power of Normalization Layers in Neural Networks: Exponential Capacity Control
por: Than, Khoat
Publicado: (2025)

Nonnegative Matrix Factorization in the Component-Wise L1 Norm for Sparse Data
por: Seraghiti, Giovanni, et al.
Publicado: (2026)

Robust Tensor Completion via Gradient Tensor Nulclear L1-L2 Norm for Traffic Data Recovery
por: Shu, Hao, et al.
Publicado: (2025)

Contraction-Aligned Analysis of Soft Bellman Residual Minimization with Weighted Lp-Norm for Markov Decision Problem
por: Yang, Hyukjun, et al.
Publicado: (2026)

Decoupled Weight Decay for Any $p$ Norm
por: Outmezguine, Nadav Joseph, et al.
Publicado: (2024)

Towards Understanding Neural Collapse: The Effects of Batch Normalization and Weight Decay
por: Pan, Leyan, et al.
Publicado: (2023)