AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Kye, Dahyeon, Roh, Changhyun, Ko, Sukhun, Eom, Chanho, Oh, Jihyong
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917362636161024
author Kye, Dahyeon
Roh, Changhyun
Ko, Sukhun
Eom, Chanho
Oh, Jihyong
author_facet Kye, Dahyeon
Roh, Changhyun
Ko, Sukhun
Eom, Chanho
Oh, Jihyong
contents Video Frame Interpolation (VFI) is a core low-level vision task that synthesizes intermediate frames between existing ones while ensuring spatial and temporal coherence. Over the past decades, VFI methodologies have evolved from classical motion compensation-based approach to a wide spectrum of deep learning-based approaches, including kernel-, flow-, hybrid-, phase-, GAN-, Transformer-, Mamba-, and most recently, diffusion-based models. We introduce AceVFI, a comprehensive and up-to-date review of the VFI field, covering over 250 representative papers. We systematically categorize VFI methods based on their core design principles and architectural characteristics. Further, we classify them into two major learning paradigms: Center-Time Frame Interpolation (CTFI) and Arbitrary-Time Frame Interpolation (ATFI). We analyze key challenges in VFI, including large motion, occlusion, lighting variation, and non-linear motion. In addition, we review standard datasets, loss functions, evaluation metrics. We also explore VFI applications in other domains and highlight future research directions. This survey aims to serve as a valuable reference for researchers and practitioners seeking a thorough understanding of the modern VFI landscape.
format Preprint
id arxiv_https___arxiv_org_abs_2506_01061
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation
Kye, Dahyeon
Roh, Changhyun
Ko, Sukhun
Eom, Chanho
Oh, Jihyong
Computer Vision and Pattern Recognition
Video Frame Interpolation (VFI) is a core low-level vision task that synthesizes intermediate frames between existing ones while ensuring spatial and temporal coherence. Over the past decades, VFI methodologies have evolved from classical motion compensation-based approach to a wide spectrum of deep learning-based approaches, including kernel-, flow-, hybrid-, phase-, GAN-, Transformer-, Mamba-, and most recently, diffusion-based models. We introduce AceVFI, a comprehensive and up-to-date review of the VFI field, covering over 250 representative papers. We systematically categorize VFI methods based on their core design principles and architectural characteristics. Further, we classify them into two major learning paradigms: Center-Time Frame Interpolation (CTFI) and Arbitrary-Time Frame Interpolation (ATFI). We analyze key challenges in VFI, including large motion, occlusion, lighting variation, and non-linear motion. In addition, we review standard datasets, loss functions, evaluation metrics. We also explore VFI applications in other domains and highlight future research directions. This survey aims to serve as a valuable reference for researchers and practitioners seeking a thorough understanding of the modern VFI landscape.
title AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.01061