Conditional Residual Coding with Explicit-Implicit Temporal Buffering for Learned Video Compression
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915423809699840 |
|---|---|
| author | Chen, Yi-Hsin Ho, Kuan-Wei Benjak, Martin Ostermann, Jörn Peng, Wen-Hsiao |
| author_facet | Chen, Yi-Hsin Ho, Kuan-Wei Benjak, Martin Ostermann, Jörn Peng, Wen-Hsiao |
| contents | This work proposes a hybrid, explicit-implicit temporal buffering scheme for conditional residual video coding. Recent conditional coding methods propagate implicit temporal information for inter-frame coding, demonstrating superior coding performance to those relying exclusively on previously decoded frames (i.e. the explicit temporal information). However, these methods require substantial memory to store a large number of implicit features. This work presents a hybrid buffering strategy. For inter-frame coding, it buffers one previously decoded frame as the explicit temporal reference and a small number of learned features as implicit temporal reference. Our hybrid buffering scheme for conditional residual coding outperforms the single use of explicit or implicit information. Moreover, it allows the total buffer size to be reduced to the equivalent of two video frames with a negligible performance drop on 2K video sequences. The ablation experiment further sheds light on how these two types of temporal references impact the coding performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_01818 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Conditional Residual Coding with Explicit-Implicit Temporal Buffering for Learned Video Compression Chen, Yi-Hsin Ho, Kuan-Wei Benjak, Martin Ostermann, Jörn Peng, Wen-Hsiao Image and Video Processing This work proposes a hybrid, explicit-implicit temporal buffering scheme for conditional residual video coding. Recent conditional coding methods propagate implicit temporal information for inter-frame coding, demonstrating superior coding performance to those relying exclusively on previously decoded frames (i.e. the explicit temporal information). However, these methods require substantial memory to store a large number of implicit features. This work presents a hybrid buffering strategy. For inter-frame coding, it buffers one previously decoded frame as the explicit temporal reference and a small number of learned features as implicit temporal reference. Our hybrid buffering scheme for conditional residual coding outperforms the single use of explicit or implicit information. Moreover, it allows the total buffer size to be reduced to the equivalent of two video frames with a negligible performance drop on 2K video sequences. The ablation experiment further sheds light on how these two types of temporal references impact the coding performance. |
| title | Conditional Residual Coding with Explicit-Implicit Temporal Buffering for Learned Video Compression |
| topic | Image and Video Processing |
| url | https://arxiv.org/abs/2508.01818 |