:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Yu, Yueyao, Zhang, Yin
Format:	Preprint
Published:	2021
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2106.04088
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Why "classic" Transformers are shallow and how to make them go deep
by: Yu, Yueyao, et al.
Published: (2023)

Efficient, Accurate and Stable Gradients for Neural ODEs
by: McCallum, Sam, et al.
Published: (2024)

Generalization Guarantees of Gradient Descent for Multi-Layer Neural Networks
by: Wang, Puyu, et al.
Published: (2023)

Turning Stale Gradients into Stable Gradients: Coherent Coordinate Descent with Implicit Landscape Smoothing for Lightweight Zeroth-Order Optimization
by: Liang, Chen, et al.
Published: (2026)

DeepDefense: Layer-Wise Gradient-Feature Alignment for Building Robust Neural Networks
by: Lin, Ci, et al.
Published: (2025)

AdaBet: Gradient-free Layer Selection for Efficient Training of Deep Neural Networks
by: Tenison, Irene, et al.
Published: (2025)

A Theory of Non-Linear Feature Learning with One Gradient Step in Two-Layer Neural Networks
by: Moniri, Behrad, et al.
Published: (2023)

Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients
by: Zhang, Zhenyu, et al.
Published: (2024)

Neural Sinkhorn Gradient Flow
by: Zhu, Huminhao, et al.
Published: (2024)

How Does Gradient Descent Learn Features -- A Local Analysis for Regularized Two-Layer Neural Networks
by: Zhou, Mo, et al.
Published: (2024)

An Analysis of Embedding Layers and Similarity Scores using Siamese Neural Networks
by: Bingi, Yash, et al.
Published: (2023)

BK-SDM: A Lightweight, Fast, and Cheap Version of Stable Diffusion
by: Kim, Bo-Kyeong, et al.
Published: (2023)

Convergence of Stochastic Gradient Methods for Wide Two-Layer Physics-Informed Neural Networks
by: Jin, Bangti, et al.
Published: (2025)

Convergence of Implicit Gradient Descent for Training Two-Layer Physics-Informed Neural Networks
by: Xu, Xianliang, et al.
Published: (2024)

Targeted Unlearning with Single Layer Unlearning Gradient
by: Cai, Zikui, et al.
Published: (2024)

Stable Gradients for Stable Learning at Scale in Deep Reinforcement Learning
by: Castanyer, Roger Creus, et al.
Published: (2025)

Obtaining Lower Query Complexities through Lightweight Zeroth-Order Proximal Gradient Algorithms
by: Gu, Bin, et al.
Published: (2024)

LION-DG: Layer-Informed Initialization with Deep Gradient Protocols for Accelerated Neural Network Training
by: Kim, Hyunjun
Published: (2026)

Asymptotic Analysis of Two-Layer Neural Networks after One Gradient Step under Gaussian Mixtures Data with Structure
by: Demir, Samet, et al.
Published: (2025)

Layer-diverse Negative Sampling for Graph Neural Networks
by: Duan, Wei, et al.
Published: (2024)

ZNO: Stable Rational Neural Operators in the Z-Domain for Discrete-Time Dynamics
by: Zhu, Xianli, et al.
Published: (2026)

Layer-to-Layer Knowledge Mixing in Graph Neural Network for Chemical Property Prediction
by: See, Teng Jiek, et al.
Published: (2025)

TreeLoRA: Efficient Continual Learning via Layer-Wise LoRAs Guided by a Hierarchical Gradient-Similarity Tree
by: Qian, Yu-Yang, et al.
Published: (2025)

Provable Unlearning with Gradient Ascent on Two-Layer ReLU Neural Networks
by: Melamed, Odelia, et al.
Published: (2025)

A Lightweight Gradient-based Causal Discovery Framework with Applications to Complex Industrial Processes
by: Liu, Meiliang, et al.
Published: (2025)

Improving Infinitely Deep Bayesian Neural Networks with Nesterov's Accelerated Gradient Method
by: Yu, Chenxu, et al.
Published: (2026)

MTL-FNO: A Lightweight Multi-Task Fourier Neural Operator for Sparse Field Reconstruction
by: Ye, Siyu, et al.
Published: (2026)

Adaptive Gradient Regularization: A Faster and Generalizable Optimization Technique for Deep Neural Networks
by: Jiang, Huixiu, et al.
Published: (2024)

A Framework for Variational Inference of Lightweight Bayesian Neural Networks with Heteroscedastic Uncertainties
by: Schodt, David J., et al.
Published: (2024)

Why GRPO Needs Normalization: A Local-Curvature Perspective on Adaptive Gradients
by: Ge, Cheng, et al.
Published: (2026)

Half-Layered Neural Networks
by: Alpaydin, Ethem
Published: (2025)

Fast and Lightweight Backdoor Detection via Head Random Probing
by: Yu, Yinbo, et al.
Published: (2026)

IDInit: A Universal and Stable Initialization Method for Neural Network Training
by: Pan, Yu, et al.
Published: (2025)

Metric-Gradient Projection for Stable Multi-Agent Policy Learning
by: Zhang, Zuyuan, et al.
Published: (2026)

Gradient Purification: Defense Against Poisoning Attack in Decentralized Federated Learning
by: Li, Bin, et al.
Published: (2025)

Robustness Verification of Graph Neural Networks Via Lightweight Satisfiability Testing
by: Lu, Chia-Hsuan, et al.
Published: (2025)

Gradient Boosting within a Single Attention Layer
by: Sargolzaei, Saleh
Published: (2026)

MuonEq: Balancing Before Orthogonalization with Lightweight Equilibration
by: Chang, Da, et al.
Published: (2026)

Functional Gradient Flows for Constrained Sampling
by: Zhang, Shiyue, et al.
Published: (2024)

Just One Layer Norm Guarantees Stable Extrapolation
by: Ziomek, Juliusz, et al.
Published: (2025)