CANeRV: Content Adaptive Neural Representation for Video Compression

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Tang, Lv, Zhu, Jun, Zhang, Xinfeng, Zhang, Li, Ma, Siwei, Huang, Qingming
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917921210499072
author Tang, Lv
Zhu, Jun
Zhang, Xinfeng
Zhang, Li
Ma, Siwei
Huang, Qingming
author_facet Tang, Lv
Zhu, Jun
Zhang, Xinfeng
Zhang, Li
Ma, Siwei
Huang, Qingming
contents Recent advances in video compression introduce implicit neural representation (INR) based methods, which effectively capture global dependencies and characteristics of entire video sequences. Unlike traditional and deep learning based approaches, INR-based methods optimize network parameters from a global perspective, resulting in superior compression potential. However, most current INR methods utilize a fixed and uniform network architecture across all frames, limiting their adaptability to dynamic variations within and between video sequences. This often leads to suboptimal compression outcomes as these methods struggle to capture the distinct nuances and transitions in video content. To overcome these challenges, we propose Content Adaptive Neural Representation for Video Compression (CANeRV), an innovative INR-based video compression network that adaptively conducts structure optimisation based on the specific content of each video sequence. To better capture dynamic information across video sequences, we propose a dynamic sequence-level adjustment (DSA). Furthermore, to enhance the capture of dynamics between frames within a sequence, we implement a dynamic frame-level adjustment (DFA). {Finally, to effectively capture spatial structural information within video frames, thereby enhancing the detail restoration capabilities of CANeRV, we devise a structure level hierarchical structural adaptation (HSA).} Experimental results demonstrate that CANeRV can outperform both H.266/VVC and state-of-the-art INR-based video compression techniques across diverse video datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2502_06181
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CANeRV: Content Adaptive Neural Representation for Video Compression
Tang, Lv
Zhu, Jun
Zhang, Xinfeng
Zhang, Li
Ma, Siwei
Huang, Qingming
Computer Vision and Pattern Recognition
Recent advances in video compression introduce implicit neural representation (INR) based methods, which effectively capture global dependencies and characteristics of entire video sequences. Unlike traditional and deep learning based approaches, INR-based methods optimize network parameters from a global perspective, resulting in superior compression potential. However, most current INR methods utilize a fixed and uniform network architecture across all frames, limiting their adaptability to dynamic variations within and between video sequences. This often leads to suboptimal compression outcomes as these methods struggle to capture the distinct nuances and transitions in video content. To overcome these challenges, we propose Content Adaptive Neural Representation for Video Compression (CANeRV), an innovative INR-based video compression network that adaptively conducts structure optimisation based on the specific content of each video sequence. To better capture dynamic information across video sequences, we propose a dynamic sequence-level adjustment (DSA). Furthermore, to enhance the capture of dynamics between frames within a sequence, we implement a dynamic frame-level adjustment (DFA). {Finally, to effectively capture spatial structural information within video frames, thereby enhancing the detail restoration capabilities of CANeRV, we devise a structure level hierarchical structural adaptation (HSA).} Experimental results demonstrate that CANeRV can outperform both H.266/VVC and state-of-the-art INR-based video compression techniques across diverse video datasets.
title CANeRV: Content Adaptive Neural Representation for Video Compression
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.06181