Cover Image

Axiomatization of Gradient Smoothing in Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhou, Linjiang, Shi, Xiaochuan, Ma, Chao, Wang, Zepeng
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

$\mathrm{E^{2}CFD}$: Towards Effective and Efficient Cost Function Design for Safe Reinforcement Learning via Large Language Model
by: Wang, Zepeng, et al.
Published: (2024)

AdaptGrad: Adaptive Sampling to Reduce Noise
by: Zhou, Linjiang, et al.
Published: (2024)

From Sorting Algorithms to Scalable Kernels: Bayesian Optimization in High-Dimensional Permutation Spaces
by: Xie, Zikai, et al.
Published: (2025)

Bridging Smoothness and Approximation: Theoretical Insights into Over-Smoothing in Graph Neural Networks
by: Yang, Guangrui, et al.
Published: (2024)

Gradient Routing: Masking Gradients to Localize Computation in Neural Networks
by: Cloud, Alex, et al.
Published: (2024)

CFNN: Continued Fraction Neural Network
by: Wang, Chao, et al.
Published: (2026)

Guarding Graph Neural Networks for Unsupervised Graph Anomaly Detection
by: Bei, Yuanchen, et al.
Published: (2024)

Soft Deterministic Policy Gradient with Gaussian Smoothing
by: Na, Hyunjun, et al.
Published: (2026)

IRNN: Innovation-driven Recurrent Neural Network for Time-Series Data Modeling and Prediction
by: Zhou, Yifan, et al.
Published: (2025)

Gradient Inversion Attack on Graph Neural Networks
by: Sinha, Divya Anand, et al.
Published: (2024)

GradINN: Gradient Informed Neural Network
by: Aglietti, Filippo, et al.
Published: (2024)

Gradient-Free Training of Quantized Neural Networks
by: Cohen, Noa, et al.
Published: (2024)

NeuralGrok: Accelerate Grokking by Neural Gradient Transformation
by: Zhou, Xinyu, et al.
Published: (2025)

Turning Stale Gradients into Stable Gradients: Coherent Coordinate Descent with Implicit Landscape Smoothing for Lightweight Zeroth-Order Optimization
by: Liang, Chen, et al.
Published: (2026)

Deep Manifold Part 2: Neural Network Mathematics
by: Ma, Max Y., et al.
Published: (2025)

Rank Collapse Causes Over-Smoothing and Over-Correlation in Graph Neural Networks
by: Roth, Andreas, et al.
Published: (2023)

Towards Green Wearable Computing: A Physics-Aware Spiking Neural Network for Energy-Efficient IMU-based Human Activity Recognition
by: Zheng, Naichuan, et al.
Published: (2026)

Stabilizing the Q-Gradient Field for Policy Smoothness in Actor-Critic
by: Lee, Jeong Woon, et al.
Published: (2026)

Deep Manifold Part 1: Anatomy of Neural Network Manifold
by: Ma, Max Y., et al.
Published: (2024)

Uncertainty Quantification for Gradient-based Explanations in Neural Networks
by: Mulye, Mihir, et al.
Published: (2024)

SURGE: Surrogate Gradient Adaptation in Binary Neural Networks
by: Huang, Haoyu, et al.
Published: (2026)

Signal-Adaptive Trust Regions for Gradient-Free Optimization of Recurrent Spiking Neural Networks
by: Li, Jinhao, et al.
Published: (2026)

Enhancing Deep Learning with Optimized Gradient Descent: Bridging Numerical Methods and Neural Network Training
by: Ma, Yuhan, et al.
Published: (2024)

Beyond Scalar Rewards: An Axiomatic Framework for Lexicographic MDPs
by: Shakerinava, Mehran, et al.
Published: (2025)

Federated Smoothing Proximal Gradient for Quantile Regression with Non-Convex Penalties
by: Mirzaeifard, Reza, et al.
Published: (2024)

Closed-Form Interpretation of Neural Network Classifiers with Symbolic Gradients
by: Wetzel, Sebastian Johann
Published: (2024)

Gradient Flow Convergence Guarantee for General Neural Network Architectures
by: Jakhmola, Yash
Published: (2025)

Understanding the Generalization of Stochastic Gradient Adam in Learning Neural Networks
by: Tang, Xuan, et al.
Published: (2025)

Gradient Multi-Normalization for Stateless and Scalable LLM Training
by: Scetbon, Meyer, et al.
Published: (2025)

A Polynomial-Time Axiomatic Alternative to SHAP for Feature Attribution
by: Hiraki, Kazuhiro, et al.
Published: (2026)

Closed-Form Interpretation of Neural Network Latent Spaces with Symbolic Gradients
by: Wetzel, Sebastian J., et al.
Published: (2024)

Compressing Neural Networks Using Tensor Networks with Exponentially Fewer Variational Parameters
by: Qing, Yong, et al.
Published: (2023)

AnyExperts: On-Demand Expert Allocation for Multimodal Language Models with Mixture of Expert
by: Gao, Yuting, et al.
Published: (2025)

Smooth Min-Max Monotonic Networks
by: Igel, Christian
Published: (2023)

Beyond RLHF and NLHF: Population-Proportional Alignment under an Axiomatic Framework
by: Kim, Kihyun, et al.
Published: (2025)

AGSOA:Graph Neural Network Targeted Attack Based on Average Gradient and Structure Optimization
by: Chen, Yang, et al.
Published: (2024)

On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph Learning
by: Arroyo, Álvaro, et al.
Published: (2025)

Optimization, Generalization and Differential Privacy Bounds for Gradient Descent on Kolmogorov-Arnold Networks
by: Wang, Puyu, et al.
Published: (2026)

Reconstructing Deep Neural Networks: Unleashing the Optimization Potential of Natural Gradient Descent
by: Liu, Weihua, et al.
Published: (2024)

Generalizing Graph Neural Networks on Out-Of-Distribution Graphs
by: Fan, Shaohua, et al.
Published: (2021)