EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Tan, Xiaofeng, Weng, Wanjiang, Lei, Haodong, Wang, Hongsong
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914314386931712
author Tan, Xiaofeng
Weng, Wanjiang
Lei, Haodong
Wang, Hongsong
author_facet Tan, Xiaofeng
Weng, Wanjiang
Lei, Haodong
Wang, Hongsong
contents In recent years, motion generative models have undergone significant advancement, yet pose challenges in aligning with downstream objectives. Recent studies have shown that using differentiable rewards to directly align the preference of diffusion models yields promising results. However, these methods suffer from (1) inefficient and coarse-grained optimization with (2) high memory consumption. In this work, we first theoretically and empirically identify the key reason of these limitations: the recursive dependence between different steps in the denoising trajectory. Inspired by this insight, we propose EasyTune, which fine-tunes diffusion at each denoising step rather than over the entire trajectory. This decouples the recursive dependence, allowing us to perform (1) a dense and fine-grained, and (2) memory-efficient optimization. Furthermore, the scarcity of preference motion pairs restricts the availability of motion reward model training. To this end, we further introduce a Self-refinement Preference Learning (SPL) mechanism that dynamically identifies preference pairs and conducts preference learning. Extensive experiments demonstrate that EasyTune outperforms DRaFT-50 by 8.2% in alignment (MM-Dist) improvement while requiring only 31.16% of its additional memory overhead and achieving a 7.3x training speedup. The project page is available at this link {https://xiaofeng-tan.github.io/projects/EasyTune/index.html}.
format Preprint
id arxiv_https___arxiv_org_abs_2602_07967
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generation
Tan, Xiaofeng
Weng, Wanjiang
Lei, Haodong
Wang, Hongsong
Computer Vision and Pattern Recognition
In recent years, motion generative models have undergone significant advancement, yet pose challenges in aligning with downstream objectives. Recent studies have shown that using differentiable rewards to directly align the preference of diffusion models yields promising results. However, these methods suffer from (1) inefficient and coarse-grained optimization with (2) high memory consumption. In this work, we first theoretically and empirically identify the key reason of these limitations: the recursive dependence between different steps in the denoising trajectory. Inspired by this insight, we propose EasyTune, which fine-tunes diffusion at each denoising step rather than over the entire trajectory. This decouples the recursive dependence, allowing us to perform (1) a dense and fine-grained, and (2) memory-efficient optimization. Furthermore, the scarcity of preference motion pairs restricts the availability of motion reward model training. To this end, we further introduce a Self-refinement Preference Learning (SPL) mechanism that dynamically identifies preference pairs and conducts preference learning. Extensive experiments demonstrate that EasyTune outperforms DRaFT-50 by 8.2% in alignment (MM-Dist) improvement while requiring only 31.16% of its additional memory overhead and achieving a 7.3x training speedup. The project page is available at this link {https://xiaofeng-tan.github.io/projects/EasyTune/index.html}.
title EasyTune: Efficient Step-Aware Fine-Tuning for Diffusion-Based Motion Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.07967