Learning Event-guided Exposure-agnostic Video Frame Interpolation via Adaptive Feature Blending

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jung, Junsik, Cho, Yoonki, Kim, Woo Jae, Wang, Lin, Yoon, Sune-eui
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909870110801920
author Jung, Junsik
Cho, Yoonki
Kim, Woo Jae
Wang, Lin
Yoon, Sune-eui
author_facet Jung, Junsik
Cho, Yoonki
Kim, Woo Jae
Wang, Lin
Yoon, Sune-eui
contents Exposure-agnostic video frame interpolation (VFI) is a challenging task that aims to recover sharp, high-frame-rate videos from blurry, low-frame-rate inputs captured under unknown and dynamic exposure conditions. Event cameras are sensors with high temporal resolution, making them especially advantageous for this task. However, existing event-guided methods struggle to produce satisfactory results on severely low-frame-rate blurry videos due to the lack of temporal constraints. In this paper, we introduce a novel event-guided framework for exposure-agnostic VFI, addressing this limitation through two key components: a Target-adaptive Event Sampling (TES) and a Target-adaptive Importance Mapping (TIM). Specifically, TES samples events around the target timestamp and the unknown exposure time to better align them with the corresponding blurry frames. TIM then generates an importance map that considers the temporal proximity and spatial relevance of consecutive features to the target. Guided by this map, our framework adaptively blends consecutive features, allowing temporally aligned features to serve as the primary cues while spatially relevant ones offer complementary support. Extensive experiments on both synthetic and real-world datasets demonstrate the effectiveness of our approach in exposure-agnostic VFI scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2510_22565
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Learning Event-guided Exposure-agnostic Video Frame Interpolation via Adaptive Feature Blending
Jung, Junsik
Cho, Yoonki
Kim, Woo Jae
Wang, Lin
Yoon, Sune-eui
Image and Video Processing
Computer Vision and Pattern Recognition
Multimedia
Exposure-agnostic video frame interpolation (VFI) is a challenging task that aims to recover sharp, high-frame-rate videos from blurry, low-frame-rate inputs captured under unknown and dynamic exposure conditions. Event cameras are sensors with high temporal resolution, making them especially advantageous for this task. However, existing event-guided methods struggle to produce satisfactory results on severely low-frame-rate blurry videos due to the lack of temporal constraints. In this paper, we introduce a novel event-guided framework for exposure-agnostic VFI, addressing this limitation through two key components: a Target-adaptive Event Sampling (TES) and a Target-adaptive Importance Mapping (TIM). Specifically, TES samples events around the target timestamp and the unknown exposure time to better align them with the corresponding blurry frames. TIM then generates an importance map that considers the temporal proximity and spatial relevance of consecutive features to the target. Guided by this map, our framework adaptively blends consecutive features, allowing temporally aligned features to serve as the primary cues while spatially relevant ones offer complementary support. Extensive experiments on both synthetic and real-world datasets demonstrate the effectiveness of our approach in exposure-agnostic VFI scenarios.
title Learning Event-guided Exposure-agnostic Video Frame Interpolation via Adaptive Feature Blending
topic Image and Video Processing
Computer Vision and Pattern Recognition
Multimedia
url https://arxiv.org/abs/2510.22565