Cover Image

OUIDecay: Adaptive Layer-wise Weight Decay for CNNs Using Online Activation Patterns

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Fernández-Hernández, Alberto, Mestre, Jose I., Pérez-Corral, Cristian, Dolz, Manuel F., Duato, Jose, Quintana-Ortí, Enrique S.
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

OUI Need to Talk About Weight Decay: A New Perspective on Overfitting Detection
by: Fernández-Hernández, Alberto, et al.
Published: (2025)

FedOUI: OUI-Guided Client Weighting for Federated Aggregation
by: Fernández-Hernández, Alberto, et al.
Published: (2026)

FedSQ: Optimized Weight Averaging via Fixed Gating
by: Pérez-Corral, Cristian, et al.
Published: (2026)

OUI as a Structural Observable: Towards an Activation-Centric View of Neural Network Training
by: Fernández-Hernández, Alberto, et al.
Published: (2026)

When Learning Rates Go Wrong: Early Structural Signals in PPO Actor-Critic
by: Fernández-Hernández, Alberto, et al.
Published: (2026)

GLAI: GreenLightningAI for Accelerated Training through Knowledge Decoupling
by: Mestre, Jose I., et al.
Published: (2025)

Regime Change Hypothesis: Foundations for Decoupled Dynamics in Neural Network Training
by: Pérez-Corral, Cristian, et al.
Published: (2026)

Sinusoidal Initialization, Time for a New Start
by: Fernández-Hernández, Alberto, et al.
Published: (2025)

Refresh-Scaling the Memory of Balanced Adam
by: Fernández-Hernández, Alberto, et al.
Published: (2026)

$λ$-GELU: Learning Gating Hardness for Controlled ReLU-ization in Deep Networks
by: Pérez-Corral, Cristian, et al.
Published: (2026)

StableGrad: Backward Scale Control without Batch Normalization
by: Mestre, Jose I., et al.
Published: (2026)

Why Adam Works Better with $β_1 = β_2$: The Missing Gradient Scale Invariance Principle
by: Fernández-Hernández, Alberto, et al.
Published: (2026)

Detecting Atypical Clients in Federated Learning via Representation-Level Divergence
by: Pérez-Corral, Cristian, et al.
Published: (2026)

Mapping Parallel Matrix Multiplication in GotoBLAS2 to the AMD Versal ACAP for Deep Learning
by: Lei, Jie, et al.
Published: (2024)

Performance Analysis of Matrix Multiplication for Deep Learning on the Edge
by: Ramírez, Cristian, et al.
Published: (2024)

AlphaDecay: Module-wise Weight Decay for Heavy-Tailed Balancing in LLMs
by: He, Di, et al.
Published: (2025)

FedLWS: Federated Learning with Adaptive Layer-wise Weight Shrinking
by: Shi, Changlong, et al.
Published: (2025)

LayerAct: Advanced Activation Mechanism for Robust Inference of CNNs
by: Yoon, Kihyuk, et al.
Published: (2023)

Fast Truncated SVD of Sparse and Dense Matrices on Graphics Processors
by: Tomas, Andres E., et al.
Published: (2024)

Implementing Basic Arithmetic in $\mathbb{F}_p$ via $\mathbb{F}_2$, and Its Application for Computing the Hamming Distance of Linear Codes
by: Hernando, Fernando, et al.
Published: (2026)

Taxa de contaminação de testes hematológicos e seus fatores determinantes
by: José Enrique De La Rubia-Ortí
Published: (2014)

Accelerating Learnt Video Codecs with Gradient Decay and Layer-wise Distillation
by: Peng, Tianhao, et al.
Published: (2023)

Integrative CAM: Adaptive Layer Fusion for Comprehensive Interpretation of CNNs
by: Singh, Aniket K., et al.
Published: (2024)

FedQuad: Adaptive Layer-wise LoRA Deployment and Activation Quantization for Federated Fine-Tuning
by: Li, Rukuo, et al.
Published: (2025)

Universidad abierta en periodos POSTCOVID-19. Experiencia colaborativa en la formación de maestras: Estudio de caso
by: José Antonio Ortí-Martínez
Published: (2023)

DMRlib: Easy-coding and Efficient Resource Management for Job Malleability
by: Iserte, Sergio, et al.
Published: (2026)

The Cambrian Explosion of Mixed-Precision Matrix Multiplication for Quantized Deep Learning Inference
by: Martínez, Héctor, et al.
Published: (2025)

Fast Algorithms and Implementations for Computing the Minimum Distance of Quantum Codes
by: Hernando, Fernando, et al.
Published: (2024)

Layer-wise Weight Selection for Power-Efficient Neural Network Acceleration
by: Fang, Jiaxun, et al.
Published: (2025)

Sample-wise Adaptive Weighting for Transfer Consistency in Adversarial Distillation
by: Lee, Hongsin, et al.
Published: (2025)

La metodología multicriterial y los métodos de valoración de impactos ambientales
by: Serafín Corral Quintana
Published: (2007)

Highly Accurate Robot Calibration Using Adaptive and Momental Bound with Decoupled Weight Decay
by: Chen, Tinghui, et al.
Published: (2024)

Learning to Forget: Continual Learning with Adaptive Weight Decay
by: Ramesh, Aditya A., et al.
Published: (2026)

Leadership in the face of digital transformation in an Ecuadorian manufacturing company in 2020
by: Carlos Alberto Ortí Maldonado
Published: (2022)

Weight Decay Regimes in Grokking Transformers: Cheap Online Diagnostics
by: Verma, Lucky
Published: (2026)

Using Exception Handling to Build Opaque Predicates in Intermediate Code Obfuscation Techniques
by: Daniel Dolz
Published: (2008)

PREVALENCIA DE TRIPANOSOMIASIS AMERICANA EN MUJERES GESTANTES DE UN ÁREA DE SALUD. VALENCIA, 2005-2007
by: Rafael Manuel Ortí Lucas
Published: (2009)

Exploiting nested task-parallelism in the $\mathcal{H}-LU$ factorization
by: Carratalá-Sáez, Rocío, et al.
Published: (2019)

Thermally Activated Stereoinversion in Benzotrithiophene‐Based Supramolecular Polymers with Water as the Effector
by: Lucía López‐Gandul, et al.
Published: (2025)

Thermally Activated Stereoinversion in Benzotrithiophene‐Based Supramolecular Polymers with Water as the Effector
by: Lucía López‐Gandul, et al.
Published: (2025)