Copertina

Natural Spectral Fusion: p-Exponent Cyclic Scheduling and Early Decision-Boundary Alignment in First-Order Optimization

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Gongyue, Liu, Honghai
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

The Unified Balance Theory of Second-Moment Exponential Scaling Optimizers in Visual Tasks
di: Zhang, Gongyue, et al.
Pubblicazione: (2024)

Scaling Exponents Across Parameterizations and Optimizers
di: Everett, Katie, et al.
Pubblicazione: (2024)

Gradient-based Discrete Sampling with Automatic Cyclical Scheduling
di: Pynadath, Patrick, et al.
Pubblicazione: (2024)

Anytime Training with Schedule-Free Spectral Optimization
di: Apte, Anuj, et al.
Pubblicazione: (2026)

FOSI: Hybrid First and Second Order Optimization
di: Sivan, Hadar, et al.
Pubblicazione: (2023)

A Fully First-Order Layer for Differentiable Optimization
di: Zhao, Zihao, et al.
Pubblicazione: (2025)

POP: Prior-Fitted First-Order Optimization Policies
di: Kobiolka, Jan, et al.
Pubblicazione: (2026)

Cyclical Log Annealing as a Learning Rate Scheduler
di: Naveen, Philip
Pubblicazione: (2024)

First-Order Methods for Linearly Constrained Bilevel Optimization
di: Kornowski, Guy, et al.
Pubblicazione: (2024)

Optimizing Load Scheduling in Power Grids Using Reinforcement Learning and Markov Decision Processes
di: Luo, Dongwen
Pubblicazione: (2024)

Adversarial Data Augmentation for Single Domain Generalization via Lyapunov Exponent-Guided Optimization
di: Zhang, Zuyu, et al.
Pubblicazione: (2025)

Battery-aware Cyclic Scheduling in Energy-harvesting Federated Learning
di: Jeong, Eunjeong, et al.
Pubblicazione: (2025)

Accelerating Zeroth-Order Spectral Optimization with Partial Orthogonalization from Power Iteration
di: Chen, Jiahe, et al.
Pubblicazione: (2026)

A First-Order Multi-Gradient Algorithm for Multi-Objective Bi-Level Optimization
di: Ye, Feiyang, et al.
Pubblicazione: (2024)

Fully First-Order Algorithms for Online Bilevel Optimization
di: Jia, Tingkai, et al.
Pubblicazione: (2026)

On the Complexity of First-Order Methods in Stochastic Bilevel Optimization
di: Kwon, Jeongyeol, et al.
Pubblicazione: (2024)

A Study of Condition Numbers for First-Order Optimization
di: Guille-Escuret, Charles, et al.
Pubblicazione: (2020)

Spectral Analysis of Diffusion Models with Application to Schedule Design
di: Benita, Roi, et al.
Pubblicazione: (2025)

Learning to Optimize Job Shop Scheduling Under Structural Uncertainty
di: Zhang, Rui, et al.
Pubblicazione: (2026)

MEGA: Second-Order Gradient Alignment for Catastrophic Forgetting Mitigation in GFSCIL
di: Pang, Jinhui, et al.
Pubblicazione: (2025)

FP8 Quantization: The Power of the Exponent
di: Kuzmin, Andrey, et al.
Pubblicazione: (2022)

Error Exponent in Agnostic PAC Learning
di: Hendel, Adi, et al.
Pubblicazione: (2024)

Computation-aware Energy-harvesting Federated Learning: Cyclic Scheduling with Selective Participation
di: Jeong, Eunjeong, et al.
Pubblicazione: (2025)

Accelerated Fully First-Order Methods for Bilevel and Minimax Optimization
di: Li, Chris Junchi
Pubblicazione: (2024)

Online Optimization Perspective on First-Order and Zero-Order Decentralized Nonsmooth Nonconvex Stochastic Optimization
di: Sahinoglu, Emre, et al.
Pubblicazione: (2024)

Primitive Agentic First-Order Optimization
di: Sala, R.
Pubblicazione: (2024)

StaTS: Spectral Trajectory Schedule Learning for Adaptive Time Series Forecasting with Frequency Guided Denoiser
di: Zhang, Jintao, et al.
Pubblicazione: (2026)

Biased Stochastic First-Order Methods for Conditional Stochastic Optimization and Applications in Meta Learning
di: Hu, Yifan, et al.
Pubblicazione: (2020)

Fast Decision Boundary based Out-of-Distribution Detector
di: Liu, Litian, et al.
Pubblicazione: (2023)

FUSE: First-Order and Second-Order Unified SynthEsis in Stochastic Optimization
di: Jiang, Zhanhong, et al.
Pubblicazione: (2025)

Accelerated First-Order Optimization under Nonlinear Constraints
di: Muehlebach, Michael, et al.
Pubblicazione: (2023)

First-Order Sparse Convex Optimization: Better Rates with Sparse Updates
di: Garber, Dan
Pubblicazione: (2025)

COOPO: Cyclic Offline-Online Policy Optimization Algorithm
di: Liu, Qisai, et al.
Pubblicazione: (2026)

On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximation
di: Kwon, Jeongyeol, et al.
Pubblicazione: (2023)

OptEx: Expediting First-Order Optimization with Approximately Parallelized Iterations
di: Shu, Yao, et al.
Pubblicazione: (2024)

Spectrally-Guided Diffusion Noise Schedules
di: Esteves, Carlos, et al.
Pubblicazione: (2026)

B2Net: Camouflaged Object Detection via Boundary Aware and Boundary Fusion
di: Cai, Junmin, et al.
Pubblicazione: (2024)

Dimer-Enhanced Optimization: A First-Order Approach to Escaping Saddle Points in Neural Network Training
di: Hu, Yue, et al.
Pubblicazione: (2025)

ElasticZO: A Memory-Efficient On-Device Learning with Combined Zeroth- and First-Order Optimization
di: Sugiura, Keisuke, et al.
Pubblicazione: (2025)

A Single-Loop First-Order Algorithm for Linearly Constrained Bilevel Optimization
di: Shen, Wei, et al.
Pubblicazione: (2025)