Cover Image

S2O: Enhancing Adversarial Training with Second-Order Statistics of Weights

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Jin, Gaojie, Yi, Xinping, Huang, Wei, Schewe, Sven, Huang, Xiaowei
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Reconcile Certified Robustness and Accuracy for DNN-based Smoothed Majority Vote Classifier
by: Jin, Gaojie, et al.
Published: (2025)

Towards A Unified PAC-Bayesian Framework for Norm-based Generalization Bounds
by: Yi, Xinping, et al.
Published: (2026)

Invariant Correlation of Representation with Label: Enhancing Domain Generalization in Noisy Environments
by: Jin, Gaojie, et al.
Published: (2024)

Adversarial Training for Graph Neural Networks via Graph Subspace Energy Optimization
by: Liu, Ganlin, et al.
Published: (2024)

Direct Training Needs Regularisation: Anytime Optimal Inference Spiking Neural Network
by: Wu, Dengyu, et al.
Published: (2024)

Principal Eigenvalue Regularization for Improved Worst-Class Certified Robustness of Smoothed Classifiers
by: Jin, Gaojie, et al.
Published: (2025)

DeepHGCN: Toward Deeper Hyperbolic Graph Convolutional Networks
by: Liu, Jiaxu, et al.
Published: (2023)

Symplectic Structure-Aware Hamiltonian (Graph) Embeddings
by: Liu, Jiaxu, et al.
Published: (2023)

POT: Inducing Overthinking in LLMs via Black-Box Iterative Optimization
by: Li, Xinyu, et al.
Published: (2025)

Continuous Geometry-Aware Graph Diffusion via Hyperbolic Neural PDE
by: Liu, Jiaxu, et al.
Published: (2024)

Enhancing Robust Fairness via Confusional Spectral Regularization
by: Jin, Gaojie, et al.
Published: (2025)

SORA: Free Second-Order Attacks in Fast Adversarial Training
by: Teymourian, Mazdak, et al.
Published: (2026)

Data Augmentation for Continual RL via Adversarial Gradient Episodic Memory
by: Wu, Sihao, et al.
Published: (2024)

Topology-Aware PAC-Bayesian Generalization Analysis for Graph Neural Networks
by: Yi, Xinping
Published: (2026)

Adversarially Trained Weighted Actor-Critic for Safe Offline Reinforcement Learning
by: Wei, Honghao, et al.
Published: (2024)

Margin-Adaptive Confidence Ranking for Reliable LLM Judgement
by: Jin, Gaojie, et al.
Published: (2026)

SPAM: Spike-Aware Adam with Momentum Reset for Stable LLM Training
by: Huang, Tianjin, et al.
Published: (2025)

ES-GNN: Generalizing Graph Neural Networks Beyond Homophily with Edge Splitting
by: Guo, Jingwei, et al.
Published: (2022)

Near-Optimal Second-Order Guarantees for Model-Based Adversarial Imitation Learning
by: Li, Shangzhe, et al.
Published: (2025)

On the Impact of Hard Adversarial Instances on Overfitting in Adversarial Training
by: Liu, Chen, et al.
Published: (2021)

OTora: A Unified Red Teaming Framework for Reasoning-Level Denial-of-Service in LLM Agents
by: Li, Xinyu, et al.
Published: (2026)

Enhancing Adversarial Training via Reweighting Optimization Trajectory
by: Huang, Tianjin, et al.
Published: (2023)

Optimising Event-Driven Spiking Neural Network with Regularisation and Cutoff
by: Wu, Dengyu, et al.
Published: (2023)

Trainable Weight Averaging: Accelerating Training and Improving Generalization
by: Li, Tao, et al.
Published: (2022)

Enhancing Adversarial Attacks via Parameter Adaptive Adversarial Attack
by: Jin, Zhibo, et al.
Published: (2024)

How to Enhance Downstream Adversarial Robustness (almost) without Touching the Pre-Trained Foundation Model?
by: Liu, Meiqi, et al.
Published: (2025)

Second-Order, First-Class: A Composable Stack for Curvature-Aware Training
by: Korbit, Mikalai, et al.
Published: (2026)

Preference Alignment on Diffusion Model: A Comprehensive Survey for Image Generation and Editing
by: Wu, Sihao, et al.
Published: (2025)

Graph Neural Networks with Diverse Spectral Filtering
by: Guo, Jingwei, et al.
Published: (2023)

When Muon Optimizer Meets Adversarial Training: A Theoretical and Empirical Study
by: Yan, Jun, et al.
Published: (2026)

Enhancing DP-SGD through Non-monotonous Adaptive Scaling Gradient Weight
by: Huang, Tao, et al.
Published: (2024)

Gradient Inversion Transcript: Leveraging Robust Generative Priors to Reconstruct Training Data from Gradient Leakage
by: Chen, Xinping, et al.
Published: (2025)

MemLoss: Enhancing Adversarial Training with Recycling Adversarial Examples
by: Mahdi, Soroush, et al.
Published: (2025)

Regularity of Second-Order Elliptic PDEs in Spectral Barron Spaces
by: Chen, Ziang, et al.
Published: (2026)

SWAT-NN: Simultaneous Weights and Architecture Training for Neural Networks in a Latent Space
by: Huang, Zitong, et al.
Published: (2025)

Second-Order Fine-Tuning without Pain for LLMs:A Hessian Informed Zeroth-Order Optimizer
by: Zhao, Yanjun, et al.
Published: (2024)

Runtime-Orchestrated Second-Order Optimization for Scalable LLM Training
by: Lu, Yishun, et al.
Published: (2026)

Explore and Establish Synergistic Effects Between Weight Pruning and Coreset Selection in Neural Network Training
by: Wan, Weilin, et al.
Published: (2025)

FUSE: First-Order and Second-Order Unified SynthEsis in Stochastic Optimization
by: Jiang, Zhanhong, et al.
Published: (2025)

Simultaneous Training of First- and Second-Order Optimizers in Population-Based Reinforcement Learning
by: Pfeiffer, Felix, et al.
Published: (2024)