Copertina

REG: A Regularization Optimizer for Robust Training Dynamics

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liu, Zehua, Wu, Han, Fu, Xiaojin, Liu, Shuqi, Han, Xiongwei, Zhong, Tao, Yuan, Mingxuan
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

RIFT: Repurposing Negative Samples via Reward-Informed Fine-Tuning
di: Liu, Zehua, et al.
Pubblicazione: (2026)

MoLAE: Mixture of Latent Experts for Parameter-Efficient Language Models
di: Liu, Zehua, et al.
Pubblicazione: (2025)

T-REG: Preference Optimization with Token-Level Reward Regularization
di: Zhou, Wenxuan, et al.
Pubblicazione: (2024)

Automated Optimization Modeling via a Localizable Error-Driven Perspective
di: Liu, Weiting, et al.
Pubblicazione: (2026)

LoRE-Merging: Exploring Low-Rank Estimation For Large Language Model Merging
di: Liu, Zehua, et al.
Pubblicazione: (2025)

Sens-Merging: Sensitivity-Guided Parameter Balancing for Merging Large Language Models
di: Liu, Shuqi, et al.
Pubblicazione: (2025)

FedEAT: A Robustness Optimization Framework for Federated LLMs
di: Pang, Yahao, et al.
Pubblicazione: (2025)

ROOT: Robust Orthogonalized Optimizer for Neural Network Training
di: He, Wei, et al.
Pubblicazione: (2025)

Selective Learning: Towards Robust Calibration with Dynamic Regularization
di: Han, Zongbo, et al.
Pubblicazione: (2024)

TrimR: Verifier-based Training-Free Thinking Compression for Efficient Test-Time Scaling
di: Lin, Weizhe, et al.
Pubblicazione: (2025)

Fast and Interpretable Mixed-Integer Linear Program Solving by Learning Model Reduction
di: Li, Yixuan, et al.
Pubblicazione: (2024)

Value-Based Pre-Training with Downstream Feedback
di: Ke, Shuqi, et al.
Pubblicazione: (2026)

BackSlash: Rate Constrained Optimized Training of Large Language Models
di: Wu, Jun, et al.
Pubblicazione: (2025)

Fairness-Regularized Online Optimization with Switching Costs
di: Li, Pengfei, et al.
Pubblicazione: (2025)

State Regularized Policy Optimization on Data with Dynamics Shift
di: Xue, Zhenghai, et al.
Pubblicazione: (2023)

From Pruning to Grafting: Dynamic Knowledge Redistribution via Learnable Layer Fusion
di: Pei, Zehua, et al.
Pubblicazione: (2024)

Adversarial Instance Generation and Robust Training for Neural Combinatorial Optimization with Multiple Objectives
di: Liu, Wei, et al.
Pubblicazione: (2026)

Self-Improved Learning for Scalable Neural Combinatorial Optimization
di: Luo, Fu, et al.
Pubblicazione: (2024)

Iterative Length-Regularized Direct Preference Optimization: A Case Study on Improving 7B Language Models to GPT-4 Level
di: Liu, Jie, et al.
Pubblicazione: (2024)

Bridging Privacy and Robustness for Trustworthy Machine Learning
di: Zhang, Xiaojin, et al.
Pubblicazione: (2024)

Astro: Activation-guided Structured Regularization for Outlier-Robust LLM Post-Training Quantization
di: Chen, Xi, et al.
Pubblicazione: (2026)

Perturbation-Induced Linearization: Constructing Unlearnable Data with Solely Linear Classifiers
di: Liu, Jinlin, et al.
Pubblicazione: (2026)

Analytical FFN-to-MoE Restructuring via Activation Pattern Analysis
di: Pei, Zehua, et al.
Pubblicazione: (2025)

Dr. Post-Training: A Data Regularization Perspective on LLM Post-Training
di: Hu, Pingbang, et al.
Pubblicazione: (2026)

Unbiased Online Curvature Approximation for Regularized Graph Continual Learning
di: Yin, Jie, et al.
Pubblicazione: (2025)

MOSS: Efficient and Accurate FP8 LLM Training with Microscaling and Automatic Scaling
di: Zhang, Yu, et al.
Pubblicazione: (2025)

REG: Rectified Gradient Guidance for Conditional Diffusion Models
di: Gao, Zhengqi, et al.
Pubblicazione: (2025)

Theoretical Analysis of Privacy Leakage in Trustworthy Federated Learning: A Perspective from Linear Algebra and Optimization Theory
di: Zhang, Xiaojin, et al.
Pubblicazione: (2024)

Ratio-Variance Regularized Policy Optimization for Efficient LLM Fine-tuning
di: Luo, Yu, et al.
Pubblicazione: (2026)

Handling Label Noise via Instance-Level Difficulty Modeling and Dynamic Optimization
di: Zhang, Kuan, et al.
Pubblicazione: (2025)

It Takes a Good Model to Train a Good Model: Generalized Gaussian Priors for Optimized LLMs
di: Wu, Jun, et al.
Pubblicazione: (2025)

Rethinking KL Regularization in RLHF: From Value Estimation to Gradient Optimization
di: Liu, Kezhao, et al.
Pubblicazione: (2025)

Toward Reproducible Cross-Backend Compatibility for Deep Learning: A Configuration-First Framework with Three-Tier Verification
di: Li, Zehua
Pubblicazione: (2025)

RW-NSGCN: A Robust Approach to Structural Attacks via Negative Sampling
di: He, Shuqi, et al.
Pubblicazione: (2024)

Rethinking Invariance Regularization in Adversarial Training to Improve Robustness-Accuracy Trade-off
di: Waseda, Futa, et al.
Pubblicazione: (2024)

COAT: Compressing Optimizer states and Activation for Memory-Efficient FP8 Training
di: Xi, Haocheng, et al.
Pubblicazione: (2024)

Robust Regularized Policy Iteration under Transition Uncertainty
di: Lin, Hongqiang, et al.
Pubblicazione: (2026)

Periodic Regularized Q-Learning
di: Yang, Hyukjun, et al.
Pubblicazione: (2026)

Circuit-Aware Reward Training: A Mechanistic Framework for Longtail Robustness in RLHF
di: Liu, Jing
Pubblicazione: (2025)

LLM Data Selection and Utilization via Dynamic Bi-level Optimization
di: Yu, Yang, et al.
Pubblicazione: (2025)