DeLiVR: Differential Spatiotemporal Lie Bias for Efficient Video Deraining

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sun, Shuning, Lu, Jialang, Chen, Xiang, Wang, Jichao, Lu, Dianjie, Zhang, Guijuan, Gao, Guangwei, Zheng, Zhuoran
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915799034232832
author Sun, Shuning
Lu, Jialang
Chen, Xiang
Wang, Jichao
Lu, Dianjie
Zhang, Guijuan
Gao, Guangwei
Zheng, Zhuoran
author_facet Sun, Shuning
Lu, Jialang
Chen, Xiang
Wang, Jichao
Lu, Dianjie
Zhang, Guijuan
Gao, Guangwei
Zheng, Zhuoran
contents Videos captured in the wild often suffer from rain streaks, blur, and noise. In addition, even slight changes in camera pose can amplify cross-frame mismatches and temporal artifacts. Existing methods rely on optical flow or heuristic alignment, which are computationally expensive and less robust. To address these challenges, Lie groups provide a principled way to represent continuous geometric transformations, making them well-suited for enforcing spatial and temporal consistency in video modeling. Building on this insight, we propose DeLiVR, an efficient video deraining method that injects spatiotemporal Lie-group differential biases directly into attention scores of the network. Specifically, the method introduces two complementary components. First, a rotation-bounded Lie relative bias predicts the in-plane angle of each frame using a compact prediction module, where normalized coordinates are rotated and compared with base coordinates to achieve geometry-consistent alignment before feature aggregation. Second, a differential group displacement computes angular differences between adjacent frames to estimate a velocity. This bias computation combines temporal decay and attention masks to focus on inter-frame relationships while precisely matching the direction of rain streaks. Extensive experimental results demonstrate the effectiveness of our method on publicly available benchmarks. The code is publicly available at https://github.com/Shuning0312/ICLR-DeLiVR.
format Preprint
id arxiv_https___arxiv_org_abs_2509_21719
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DeLiVR: Differential Spatiotemporal Lie Bias for Efficient Video Deraining
Sun, Shuning
Lu, Jialang
Chen, Xiang
Wang, Jichao
Lu, Dianjie
Zhang, Guijuan
Gao, Guangwei
Zheng, Zhuoran
Computer Vision and Pattern Recognition
Videos captured in the wild often suffer from rain streaks, blur, and noise. In addition, even slight changes in camera pose can amplify cross-frame mismatches and temporal artifacts. Existing methods rely on optical flow or heuristic alignment, which are computationally expensive and less robust. To address these challenges, Lie groups provide a principled way to represent continuous geometric transformations, making them well-suited for enforcing spatial and temporal consistency in video modeling. Building on this insight, we propose DeLiVR, an efficient video deraining method that injects spatiotemporal Lie-group differential biases directly into attention scores of the network. Specifically, the method introduces two complementary components. First, a rotation-bounded Lie relative bias predicts the in-plane angle of each frame using a compact prediction module, where normalized coordinates are rotated and compared with base coordinates to achieve geometry-consistent alignment before feature aggregation. Second, a differential group displacement computes angular differences between adjacent frames to estimate a velocity. This bias computation combines temporal decay and attention masks to focus on inter-frame relationships while precisely matching the direction of rain streaks. Extensive experimental results demonstrate the effectiveness of our method on publicly available benchmarks. The code is publicly available at https://github.com/Shuning0312/ICLR-DeLiVR.
title DeLiVR: Differential Spatiotemporal Lie Bias for Efficient Video Deraining
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.21719