Image de couverture de livre

Representations learnt by SGD and Adaptive learning rules: Conditions that vary sparsity and selectivity in neural networks

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Park, Jin Hyun
Format:	Preprint
Publié:	2022
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Adaptive multiple optimal learning factors for neural network training
par: Challagundla, Jeshwanth
Publié: (2024)

Anon: Extrapolating Adaptivity Beyond SGD and Adam
par: Zhang, Yiheng, et autres
Publié: (2026)

LayerCollapse: Adaptive compression of neural networks
par: Shabgahi, Soheil Zibakhsh, et autres
Publié: (2023)

Conditional computation in neural networks: principles and research trends
par: Scardapane, Simone, et autres
Publié: (2024)

Flow reconstruction in time-varying geometries using graph neural networks
par: Danciu, Bogdan A., et autres
Publié: (2024)

Understanding the learned look-ahead behavior of chess neural networks
par: Cruz, Diogo
Publié: (2025)

Time-varying Interaction Graph ODE for Dynamic Graph Representation Learning
par: Wang, Xiaoyi, et autres
Publié: (2026)

Enhancing DP-SGD through Non-monotonous Adaptive Scaling Gradient Weight
par: Huang, Tao, et autres
Publié: (2024)

Discrete Dictionary-based Decomposition Layer for Structured Representation Learning
par: Park, Taewon, et autres
Publié: (2024)

Why Adam Can Beat SGD: Second-Moment Normalization Yields Sharper Tails
par: Jin, Ruinan, et autres
Publié: (2026)

Less is more: Embracing sparsity and interpolation with Esiformer for time series forecasting
par: Guo, Yangyang, et autres
Publié: (2024)

TLDR: Unsupervised Goal-Conditioned RL via Temporal Distance-Aware Representations
par: Bae, Junik, et autres
Publié: (2024)

Adaptive Selection of LoRA Components in Privacy-Preserving Federated Learning
par: Kim, Myoungjun, et autres
Publié: (2026)

Multiverse: Language-Conditioned Multi-Game Level Blending via Shared Representation
par: Baek, In-Chang, et autres
Publié: (2026)

PIG: Physics-Informed Gaussians as Adaptive Parametric Mesh Representations
par: Kang, Namgyu, et autres
Publié: (2024)

Feature learning as alignment: a structural property of gradient descent in non-linear neural networks
par: Beaglehole, Daniel, et autres
Publié: (2024)

Bootstrap SGD: Algorithmic Stability and Robustness
par: Christmann, Andreas, et autres
Publié: (2024)

MoE-PHDS: One MoE checkpoint for flexible runtime sparsity
par: Hannah, Lauren. A, et autres
Publié: (2025)

On permutation-invariant neural networks
par: Kimura, Masanari, et autres
Publié: (2024)

Sobolev acceleration for neural networks
par: Oh, Jong Kwon, et autres
Publié: (2025)

Attention mechanisms in neural networks
par: Hays, Hasi
Publié: (2026)

MORE-CLEAR: Multimodal Offline Reinforcement learning for Clinical notes Leveraged Enhanced State Representation
par: Lim, Yooseok, et autres
Publié: (2025)

Target noise: A pre-training based neural network initialization for efficient high resolution learning
par: Wang, Shaowen, et autres
Publié: (2026)

Interpolating neural network: A novel unification of machine learning and interpolation theory
par: Park, Chanwook, et autres
Publié: (2024)

Zero-Incentive Dynamics: a look at reward sparsity through the lens of unrewarded subgoals
par: Molinghen, Yannick, et autres
Publié: (2025)

Accumulative SGD Influence Estimation for Data Attribution
par: Shi, Yunxiao, et autres
Publié: (2025)

APOLLO: SGD-like Memory, AdamW-level Performance
par: Zhu, Hanqing, et autres
Publié: (2024)

Principles of Lipschitz continuity in neural networks
par: Luo, Róisín
Publié: (2026)

Linearity-based neural network compression
par: Dobler, Silas, et autres
Publié: (2025)

On-site estimation of battery electrochemical parameters via transfer learning based physics-informed neural network approach
par: Yeregui, Josu, et autres
Publié: (2025)

From 2:4 to 8:16 sparsity patterns in LLMs for Outliers and Weights with Variance Correction
par: Maximov, Egor, et autres
Publié: (2025)

Beyond 2:4: exploring V:N:M sparsity for efficient transformer inference on GPUs
par: Zhao, Kang, et autres
Publié: (2024)

Scaling Laws of SignSGD in Linear Regression: When Does It Outperform SGD?
par: Kim, Jihwan, et autres
Publié: (2026)

Worker Disagreement Reveals Sharp Directions in Local SGD
par: Dimlioglu, Tolga, et autres
Publié: (2026)

Applying graph neural network to SupplyGraph for supply chain network
par: Han, Kihwan
Publié: (2024)

Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning models
par: Testolin, Alberto
Publié: (2023)

Active teacher selection for reward learning
par: Freedman, Rachel, et autres
Publié: (2023)

Understanding the dynamics of the frequency bias in neural networks
par: Molina, Juan, et autres
Publié: (2024)

Graph neural networks informed locally by thermodynamics
par: Tierz, Alicia, et autres
Publié: (2024)

Graph neural networks and non-commuting operators
par: Velasco, Mauricio, et autres
Publié: (2024)