:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Author:	Yun, Juyoung
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2408.01215
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Mitigating Gradient Overlap in Deep Residual Networks with Gradient Normalization for Improved Non-Convex Optimization
by: Yun, Juyoung
Published: (2024)

Stochastic Gradient Sampling for Enhancing Neural Networks Training
by: Yun, Juyoung
Published: (2023)

Robust Neural Pruning with Gradient Sampling Optimization for Residual Neural Networks
by: Yun, Juyoung
Published: (2023)

Stabilizing Backpropagation in 16-bit Neural Training with Modified Adam Optimizer
by: Yun, Juyoung
Published: (2023)

Predictive Modeling of Coronal Hole Areas Using Long Short-Term Memory Networks
by: Yun, Juyoung
Published: (2023)

Extreme Solar Flare Prediction Using Residual Networks with HMI Magnetograms and Intensitygrams
by: Yun, Juyoung, et al.
Published: (2024)

Computing Linear Regions in Neural Networks with Skip Connections
by: Joyce, Johnny, et al.
Published: (2025)

Sharpness-Aware Minimization with Z-Score Gradient Filtering
by: Yun, Vincent-Daniel
Published: (2025)

Accelerating Recommender Model Training by Dynamically Skipping Stale Embeddings
by: Maboud, Yassaman Ebrahimzadeh, et al.
Published: (2024)

Probabilistic Skip Connections for Deterministic Uncertainty Quantification in Deep Neural Networks
by: Jimenez, Felix, et al.
Published: (2025)

Analysis and Predictive Modeling of Solar Coronal Holes Using Computer Vision and ARIMA-LSTM Networks
by: Yun, Juyoung, et al.
Published: (2024)

The Hidden Power of Pure 16-bit Floating-Point Neural Networks
by: Yun, Juyoung, et al.
Published: (2023)

Sparse-ProxSkip: Accelerated Sparse-to-Sparse Training in Federated Learning
by: Meinhardt, Georg, et al.
Published: (2024)

Stick-Breaking Mixture Normalizing Flows with Component-Wise Tail Adaptation for Variational Inference
by: Han, Seungsu, et al.
Published: (2025)

On the Adversarial Transferability of Generalized "Skip Connections"
by: Wang, Yisen, et al.
Published: (2024)

Can an MLP Absorb Its Own Skip Connection?
by: Mijoski, Antonij, et al.
Published: (2026)

Skip-Connected Policy Optimization for Implicit Advantage
by: Teng, Fengwei, et al.
Published: (2026)

GradSkip: Communication-Accelerated Local Gradient Methods with Better Computational Complexity
by: Maranjyan, Artavazd, et al.
Published: (2022)

Revisiting 16-bit Neural Network Training: A Practical Approach for Resource-Limited Learning
by: Yun, Juyoung, et al.
Published: (2023)

Lambda-Skip Connections: the architectural component that prevents Rank Collapse
by: Joseph, Federico Arangath, et al.
Published: (2024)

Physics-Informed Neural Networks with Skip Connections for Modeling and Control of Gas-Lifted Oil Wells
by: Kittelsen, Jonas Ekeland, et al.
Published: (2024)

Cutting the Skip: Training Residual-Free Transformers
by: Ji, Yiping, et al.
Published: (2025)

Orthogonal Weight Modification Enhances Learning Scalability and Convergence Efficiency without Gradient Backpropagation
by: Ma, Guoqing, et al.
Published: (2026)

SkipViT: Speeding Up Vision Transformers with a Token-Level Skip Connection
by: Ataiefard, Foozhan, et al.
Published: (2024)

Impact of Bottleneck Layers and Skip Connections on the Generalization of Linear Denoising Autoencoders
by: Ham, Jonghyun, et al.
Published: (2025)

Insights from Gradient Dynamics: Gradient Autoscaled Normalization
by: Yun, Vincent-Daniel
Published: (2025)

Efficient Skip Connections Realization for Secure Inference on Encrypted Data
by: Drucker, Nir, et al.
Published: (2023)

Stochastic Normalized Gradient Descent with Momentum for Large-Batch Training
by: Zhao, Shen-Yi, et al.
Published: (2020)

Only Large Weights (And Not Skip Connections) Can Prevent the Perils of Rank Collapse
by: Alman, Josh, et al.
Published: (2025)

Gradient Multi-Normalization for Stateless and Scalable LLM Training
by: Scetbon, Meyer, et al.
Published: (2025)

SparseOpt: Addressing Normalization-induced Gradient Skew in Sparse Training
by: Adnan, Mohammed, et al.
Published: (2026)

SkipPipe: Partial and Reordered Pipelining Framework for Training LLMs in Heterogeneous Networks
by: Blagoev, Nikolay, et al.
Published: (2025)

Rethinking Image Skip Connections in StyleGAN2
by: Park, Seung, et al.
Published: (2024)

DASH: Warm-Starting Neural Network Training in Stationary Settings without Loss of Plasticity
by: Shin, Baekrok, et al.
Published: (2024)

A Curious Case of Remarkable Resilience to Gradient Attacks via Fully Convolutional and Differentiable Front End with a Skip Connection
by: Boytsov, Leonid, et al.
Published: (2024)

Benign Overfitting without Linearity: Neural Network Classifiers Trained by Gradient Descent for Noisy Linear Data
by: Frei, Spencer, et al.
Published: (2022)

Accelerated Training through Iterative Gradient Propagation Along the Residual Path
by: Fagnou, Erwan, et al.
Published: (2025)

Optimizing Connectivity through Network Gradients for Restricted Boltzmann Machines
by: de Oliveira, A. C. N., et al.
Published: (2022)

LION-DG: Layer-Informed Initialization with Deep Gradient Protocols for Accelerated Neural Network Training
by: Kim, Hyunjun
Published: (2026)

Gradient Boosted Risk Scores
by: Georgantas, Costa, et al.
Published: (2026)