NeRV360: Neural Representation for 360-Degree Videos with a Viewport Decoder

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Arai, Daichi, Unno, Kyohei, Sugito, Yasuko, Kusakabe, Yuichi
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917275252031488
author Arai, Daichi
Unno, Kyohei
Sugito, Yasuko
Kusakabe, Yuichi
author_facet Arai, Daichi
Unno, Kyohei
Sugito, Yasuko
Kusakabe, Yuichi
contents Implicit neural representations for videos (NeRV) have shown strong potential for video compression. However, applying NeRV to high-resolution 360-degree videos causes high memory usage and slow decoding, making real-time applications impractical. We propose NeRV360, an end-to-end framework that decodes only the user-selected viewport instead of reconstructing the entire panoramic frame. Unlike conventional pipelines, NeRV360 integrates viewport extraction into decoding and introduces a spatial-temporal affine transform module for conditional decoding based on viewpoint and time. Experiments on 6K-resolution videos show that NeRV360 achieves a 7-fold reduction in memory consumption and a 2.5-fold increase in decoding speed compared to HNeRV, a representative prior work, while delivering better image quality in terms of objective metrics.
format Preprint
id arxiv_https___arxiv_org_abs_2512_20871
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle NeRV360: Neural Representation for 360-Degree Videos with a Viewport Decoder
Arai, Daichi
Unno, Kyohei
Sugito, Yasuko
Kusakabe, Yuichi
Computer Vision and Pattern Recognition
Multimedia
Image and Video Processing
Implicit neural representations for videos (NeRV) have shown strong potential for video compression. However, applying NeRV to high-resolution 360-degree videos causes high memory usage and slow decoding, making real-time applications impractical. We propose NeRV360, an end-to-end framework that decodes only the user-selected viewport instead of reconstructing the entire panoramic frame. Unlike conventional pipelines, NeRV360 integrates viewport extraction into decoding and introduces a spatial-temporal affine transform module for conditional decoding based on viewpoint and time. Experiments on 6K-resolution videos show that NeRV360 achieves a 7-fold reduction in memory consumption and a 2.5-fold increase in decoding speed compared to HNeRV, a representative prior work, while delivering better image quality in terms of objective metrics.
title NeRV360: Neural Representation for 360-Degree Videos with a Viewport Decoder
topic Computer Vision and Pattern Recognition
Multimedia
Image and Video Processing
url https://arxiv.org/abs/2512.20871