Cover Image

A Stable Whitening Optimizer for Efficient Neural Network Training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Frans, Kevin, Levine, Sergey, Abbeel, Pieter
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

What Really Matters in Matrix-Whitening Optimizers?
by: Frans, Kevin, et al.
Published: (2025)

Diffusion Guidance Is a Controllable Policy Improvement Operator
by: Frans, Kevin, et al.
Published: (2025)

Unsupervised Zero-Shot Reinforcement Learning via Functional Reward Encodings
by: Frans, Kevin, et al.
Published: (2024)

One Step Diffusion via Shortcut Models
by: Frans, Kevin, et al.
Published: (2024)

Prioritized Generative Replay
by: Wang, Renhao, et al.
Published: (2024)

Cliqueformer: Model-Based Optimization with Structured Transformers
by: Kuba, Jakub Grudzien, et al.
Published: (2024)

Functional Graphical Models: Structure Enables Offline Data-Driven Optimization
by: Kuba, Jakub Grudzien, et al.
Published: (2024)

Leveraging Skills from Unlabeled Prior Data for Efficient Online Exploration
by: Wilcoxson, Max, et al.
Published: (2024)

Coarse-to-fine Q-Network with Action Sequence for Data-Efficient Reinforcement Learning
by: Seo, Younggyo, et al.
Published: (2024)

Is Value Learning Really the Main Bottleneck in Offline RL?
by: Park, Seohong, et al.
Published: (2024)

OGBench: Benchmarking Offline Goal-Conditioned RL
by: Park, Seohong, et al.
Published: (2024)

Compute-Optimal Scaling for Value-Based Deep RL
by: Fu, Preston, et al.
Published: (2025)

Value-Based Deep RL Scales Predictably
by: Rybkin, Oleh, et al.
Published: (2025)

SEMDICE: Off-policy State Entropy Maximization via Stationary Distribution Correction Estimation
by: Lee, Jongmin, et al.
Published: (2025)

Reward-Conditioned Reinforcement Learning
by: Nauman, Michal, et al.
Published: (2026)

Deep Neural Networks Tend To Extrapolate Predictably
by: Kang, Katie, et al.
Published: (2023)

Horizon Reduction Makes RL Scalable
by: Park, Seohong, et al.
Published: (2025)

Depth-Aware Initialization for Stable and Efficient Neural Network Training
by: Pandey, Vijay
Published: (2025)

Offline Imitation Learning Through Graph Search and Retrieval
by: Yin, Zhao-Heng, et al.
Published: (2024)

Bigger, Regularized, Categorical: High-Capacity Value Functions are Efficient Multi-Task Learners
by: Nauman, Michal, et al.
Published: (2025)

Zipfian Whitening
by: Yokoi, Sho, et al.
Published: (2024)

Automated Evolutionary Optimization for Resource-Efficient Neural Network Training
by: Revin, Ilia, et al.
Published: (2025)

DreamSmooth: Improving Model-based Reinforcement Learning via Reward Smoothing
by: Lee, Vint, et al.
Published: (2023)

World Model on Million-Length Video And Language With Blockwise RingAttention
by: Liu, Hao, et al.
Published: (2024)

SWAN: SGD with Normalization and Whitening Enables Stateless LLM Training
by: Ma, Chao, et al.
Published: (2024)

Visual Pre-Training on Unlabeled Images using Reinforcement Learning
by: Ghosh, Dibya, et al.
Published: (2025)

Training-Free Policy Violation Detection via Activation-Space Whitening in LLMs
by: Rachmil, Oren, et al.
Published: (2025)

A Training Framework for Optimal and Stable Training of Polynomial Neural Networks
by: Hossain, Forsad Al, et al.
Published: (2025)

Cross-Entropy Optimization for Hyperparameter Optimization in Stochastic Gradient-based Approaches to Train Deep Neural Networks
by: Li, Kevin, et al.
Published: (2024)

Learning a Diffusion Model Policy from Rewards via Q-Score Matching
by: Psenka, Michael, et al.
Published: (2023)

Accelerating Reinforcement Learning with Value-Conditional State Entropy Exploration
by: Kim, Dongyoung, et al.
Published: (2023)

ViVa: Video-Trained Value Functions for Guiding Online RL from Diverse Data
by: Dashora, Nitish, et al.
Published: (2025)

Training Diffusion Models with Reinforcement Learning
by: Black, Kevin, et al.
Published: (2023)

Efficient Long Video Tokenization via Coordinate-based Patch Reconstruction
by: Jang, Huiwon, et al.
Published: (2024)

Understanding SOAP from the Perspective of Gradient Whitening
by: Lu, Yanqing, et al.
Published: (2025)

Training Neural Networks by Optimizing Neuron Positions
by: Erb, Laura, et al.
Published: (2025)

Real-Time Execution of Action Chunking Flow Policies
by: Black, Kevin, et al.
Published: (2025)

Whitening Spherical Gaussian Mixtures in the Large-Dimensional Regime
by: Boudjemaa, Mohammed Racim Moussa, et al.
Published: (2025)

Contextual Bandit Optimization with Pre-Trained Neural Networks
by: Terekhov, Mikhail
Published: (2025)

UnifiedNN: Efficient Neural Network Training on the Cloud
by: Taki, Sifat Ut, et al.
Published: (2024)