GAS: Improving Discretization of Diffusion ODEs via Generalized Adversarial Solver

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Oganov, Aleksandr, Bykov, Ilya, Neudachina, Eva, Aliev, Mishan, Tolmachev, Alexander, Sidorov, Alexander, Zuev, Aleksandr, Okhotin, Andrey, Rakitin, Denis, Alanov, Aibek
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912978159271936
author Oganov, Aleksandr
Bykov, Ilya
Neudachina, Eva
Aliev, Mishan
Tolmachev, Alexander
Sidorov, Alexander
Zuev, Aleksandr
Okhotin, Andrey
Rakitin, Denis
Alanov, Aibek
author_facet Oganov, Aleksandr
Bykov, Ilya
Neudachina, Eva
Aliev, Mishan
Tolmachev, Alexander
Sidorov, Alexander
Zuev, Aleksandr
Okhotin, Andrey
Rakitin, Denis
Alanov, Aibek
contents While diffusion models achieve state-of-the-art generation quality, they still suffer from computationally expensive sampling. Recent works address this issue with gradient-based optimization methods that distill a few-step ODE diffusion solver from the full sampling process, reducing the number of function evaluations from dozens to just a few. However, these approaches often rely on intricate training techniques and do not explicitly focus on preserving fine-grained details. In this paper, we introduce the Generalized Solver: a simple parameterization of the ODE sampler that does not require additional training tricks and improves quality over existing approaches. We further combine the original distillation loss with adversarial training, which mitigates artifacts and enhances detail fidelity. We call the resulting method the Generalized Adversarial Solver and demonstrate its superior performance compared to existing solver training methods under similar resource constraints. Code is available at https://github.com/3145tttt/GAS.
format Preprint
id arxiv_https___arxiv_org_abs_2510_17699
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle GAS: Improving Discretization of Diffusion ODEs via Generalized Adversarial Solver
Oganov, Aleksandr
Bykov, Ilya
Neudachina, Eva
Aliev, Mishan
Tolmachev, Alexander
Sidorov, Alexander
Zuev, Aleksandr
Okhotin, Andrey
Rakitin, Denis
Alanov, Aibek
Computer Vision and Pattern Recognition
Machine Learning
While diffusion models achieve state-of-the-art generation quality, they still suffer from computationally expensive sampling. Recent works address this issue with gradient-based optimization methods that distill a few-step ODE diffusion solver from the full sampling process, reducing the number of function evaluations from dozens to just a few. However, these approaches often rely on intricate training techniques and do not explicitly focus on preserving fine-grained details. In this paper, we introduce the Generalized Solver: a simple parameterization of the ODE sampler that does not require additional training tricks and improves quality over existing approaches. We further combine the original distillation loss with adversarial training, which mitigates artifacts and enhances detail fidelity. We call the resulting method the Generalized Adversarial Solver and demonstrate its superior performance compared to existing solver training methods under similar resource constraints. Code is available at https://github.com/3145tttt/GAS.
title GAS: Improving Discretization of Diffusion ODEs via Generalized Adversarial Solver
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2510.17699