Cover Image

Neural Network-Based Score Estimation in Diffusion Models: Optimization and Generalization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Han, Yinbin, Razaviyayn, Meisam, Xu, Renyuan
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Stochastic Control for Fine-tuning Diffusion Models: Optimality, Regularity, and Convergence
by: Han, Yinbin, et al.
Published: (2024)

Policy Gradient Converges to the Globally Optimal Policy for Nearly Linear-Quadratic Regulators
by: Han, Yinbin, et al.
Published: (2023)

Output Perturbation for Differentially Private Convex Optimization: Faster and More General
by: Lowy, Andrew, et al.
Published: (2021)

Private Stochastic Optimization With Large Worst-Case Lipschitz Parameter
by: Lowy, Andrew, et al.
Published: (2022)

Private Federated Learning Without a Trusted Server: Optimal Algorithms for Convex Losses
by: Lowy, Andrew, et al.
Published: (2021)

Adaptively Private Next-Token Prediction of Large Language Models
by: Flemings, James, et al.
Published: (2024)

A Stochastic Optimization Framework for Private and Fair Learning From Decentralized Data
by: Gupta, Devansh, et al.
Published: (2024)

f-FERM: A Scalable Framework for Robust Fair Empirical Risk Minimization
by: Baharlouei, Sina, et al.
Published: (2023)

Differentially Private Next-Token Prediction of Large Language Models
by: Flemings, James, et al.
Published: (2024)

DOPPLER: Differentially Private Optimizers with Low-pass Filter for Privacy Noise Reduction
by: Zhang, Xinwei, et al.
Published: (2024)

On the Inherent Privacy of Zeroth Order Projected Gradient Descent
by: Gupta, Devansh, et al.
Published: (2025)

It's All Connected: A Journey Through Test-Time Memorization, Attentional Bias, Retention, and Online Optimization
by: Behrouz, Ali, et al.
Published: (2025)

Optimal Differentially Private Model Training with Public Data
by: Lowy, Andrew, et al.
Published: (2023)

Less is More: Convergence Benefits of Fewer Data Weight Updates over Longer Horizon
by: Das, Rudrajit, et al.
Published: (2026)

Sampling and Loss Weights in Multi-Domain Training
by: Salmani, Mahdi, et al.
Published: (2025)

Nested Learning: The Illusion of Deep Learning Architectures
by: Behrouz, Ali, et al.
Published: (2025)

Synthetic Text Generation for Training Large Language Models via Gradient Matching
by: Nguyen, Dang, et al.
Published: (2025)

Tradeoffs between convergence rate and noise amplification for momentum-based accelerated optimization algorithms
by: Mohammadi, Hesameddin, et al.
Published: (2022)

Differentially Private In-context Learning via Sampling Few-shot Mixed with Zero-shot Outputs
by: Flemings, James, et al.
Published: (2025)

PiKE: Adaptive Data Mixing for Large-Scale Multi-Task Learning Under Low Gradient Conflicts
by: Li, Zeman, et al.
Published: (2025)

DiSK: Differentially Private Optimizer with Simplified Kalman Filter for Noise Reduction
by: Zhang, Xinwei, et al.
Published: (2024)

Early Stopping for Large Reasoning Models via Confidence Dynamics
by: Hosseini, Parsa, et al.
Published: (2026)

Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Models
by: Sharrock, Louis, et al.
Published: (2022)

Addax: Utilizing Zeroth-Order Gradients to Improve Memory Efficiency and Performance of SGD for Fine-Tuning Language Models
by: Li, Zeman, et al.
Published: (2024)

Diffusion Factor Models: Generating High-Dimensional Returns with Factor Structure
by: Chen, Minshuo, et al.
Published: (2025)

Memory Caching: RNNs with Growing Memory
by: Behrouz, Ali, et al.
Published: (2026)

Risk-sensitive Markov Decision Process and Learning under General Utility Functions
by: Wu, Zhengqi, et al.
Published: (2023)

Training a General Spiking Neural Network with Improved Efficiency and Minimum Latency
by: Yao, Yunpeng, et al.
Published: (2024)

Analyzing Neural Network-Based Generative Diffusion Models through Convex Optimization
by: Zhang, Fangzhao, et al.
Published: (2024)

Diffusion Secant Alignment for Score-Based Density Ratio Estimation
by: Chen, Wei, et al.
Published: (2025)

DP-FedAdamW: An Efficient Optimizer for Differentially Private Federated Large Models
by: Liu, Jin, et al.
Published: (2026)

Nearest Neighbour Score Estimators for Diffusion Generative Models
by: Niedoba, Matthew, et al.
Published: (2024)

Adaptive Partitioning and Learning for Stochastic Control of Diffusion Processes
by: Jin, Hanqing, et al.
Published: (2025)

Smoothing the Score Function for Generalization in Diffusion Models: An Optimization-based Explanation Framework
by: Zhou, Xinyu, et al.
Published: (2026)

TNT: Improving Chunkwise Training for Test-Time Memorization
by: Li, Zeman, et al.
Published: (2025)

Sampling Transferable Graph Neural Networks with Limited Graph Information
by: Wang, Haoyu, et al.
Published: (2024)

Diffusion-Based Neural Network Weights Generation
by: Soro, Bedionita, et al.
Published: (2024)

Approximation and Generalization Abilities of Score-based Neural Network Generative Models for Sub-Gaussian Distributions
by: Fu, Guoji, et al.
Published: (2025)

Memory-Efficient Differentially Private Training with Gradient Random Projection
by: Mulrooney, Alex, et al.
Published: (2025)

MCMC-Correction of Score-Based Diffusion Models for Model Composition
by: Sjöberg, Anders, et al.
Published: (2023)