EasyVFX: Frequency-Driven Decoupling for Resource-Efficient VFX Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ma, Yue, Ye, Xu, Wang, Qinghe, Wang, Yucheng, Liu, Hongyu, Zhang, Yinhan, Wang, Xinyu, Che, Yuanpeng, Mo, Shanhui, Liang, Paul, Zhan, Fangneng, Chen, Qifeng
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918516176715776
author Ma, Yue
Ye, Xu
Wang, Qinghe
Wang, Yucheng
Liu, Hongyu
Zhang, Yinhan
Wang, Xinyu
Che, Yuanpeng
Mo, Shanhui
Liang, Paul
Zhan, Fangneng
Chen, Qifeng
author_facet Ma, Yue
Ye, Xu
Wang, Qinghe
Wang, Yucheng
Liu, Hongyu
Zhang, Yinhan
Wang, Xinyu
Che, Yuanpeng
Mo, Shanhui
Liang, Paul
Zhan, Fangneng
Chen, Qifeng
contents Generating high-fidelity visual effects (VFX) typically demands massive datasets and prohibitive computational power due to the intricate coupling of spatial textures and temporal dynamics. In this paper, we introduce EasyVFX, a resource-efficient framework that achieves realistic VFX synthesis under stringent constraints. Our core philosophy lies in frequency-domain decomposition: we observe that the complexity of VFX can be significantly mitigated by decoupling high-frequency components, which represent intricate spatial appearances, from low-frequency components that encapsulate global motion dynamics. This spectral disentanglement transforms a high-dimensional learning problem into manageable sub-tasks, thereby lowering the optimization barrier and reducing data dependency. Building upon this insight, we propose a two-stage training paradigm. First, we design a Frequency-aware Mixture-of-Experts (Freq-MoE) architecture. By utilizing a soft routing mechanism, our model assigns specialized experts to distinct spectral bands, enabling them to cultivate robust priors for appearance and motion dynamics. This specialization allows the model to acquire foundational VFX knowledge with fewer GPU resources. Second, we introduce a Test-Time Training strategy powered by a novel Frequency-constraint Loss. This allows the pre-trained model to swiftly adapt to specific, unseen effects through localized optimizations, requiring only about 100 steps on a single GPU. Experimental results demonstrate that EasyVFX produces structurally consistent and visually stunning effects, proving that frequency-aware learning is a key catalyst for democratizing professional-grade VFX.
format Preprint
id arxiv_https___arxiv_org_abs_2605_22051
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle EasyVFX: Frequency-Driven Decoupling for Resource-Efficient VFX Generation
Ma, Yue
Ye, Xu
Wang, Qinghe
Wang, Yucheng
Liu, Hongyu
Zhang, Yinhan
Wang, Xinyu
Che, Yuanpeng
Mo, Shanhui
Liang, Paul
Zhan, Fangneng
Chen, Qifeng
Computer Vision and Pattern Recognition
Generating high-fidelity visual effects (VFX) typically demands massive datasets and prohibitive computational power due to the intricate coupling of spatial textures and temporal dynamics. In this paper, we introduce EasyVFX, a resource-efficient framework that achieves realistic VFX synthesis under stringent constraints. Our core philosophy lies in frequency-domain decomposition: we observe that the complexity of VFX can be significantly mitigated by decoupling high-frequency components, which represent intricate spatial appearances, from low-frequency components that encapsulate global motion dynamics. This spectral disentanglement transforms a high-dimensional learning problem into manageable sub-tasks, thereby lowering the optimization barrier and reducing data dependency. Building upon this insight, we propose a two-stage training paradigm. First, we design a Frequency-aware Mixture-of-Experts (Freq-MoE) architecture. By utilizing a soft routing mechanism, our model assigns specialized experts to distinct spectral bands, enabling them to cultivate robust priors for appearance and motion dynamics. This specialization allows the model to acquire foundational VFX knowledge with fewer GPU resources. Second, we introduce a Test-Time Training strategy powered by a novel Frequency-constraint Loss. This allows the pre-trained model to swiftly adapt to specific, unseen effects through localized optimizations, requiring only about 100 steps on a single GPU. Experimental results demonstrate that EasyVFX produces structurally consistent and visually stunning effects, proving that frequency-aware learning is a key catalyst for democratizing professional-grade VFX.
title EasyVFX: Frequency-Driven Decoupling for Resource-Efficient VFX Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2605.22051