CPSL: Representing Volumetric Video via Content-Promoted Scene Layers

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hu, Kaiyuan, Jin, Yili, Liu, Junhua, Duan, Xize, Kang, Hong, Liu, Xue
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917090352431104
author Hu, Kaiyuan
Jin, Yili
Liu, Junhua
Duan, Xize
Kang, Hong
Liu, Xue
author_facet Hu, Kaiyuan
Jin, Yili
Liu, Junhua
Duan, Xize
Kang, Hong
Liu, Xue
contents Volumetric video enables immersive and interactive visual experiences by supporting free viewpoint exploration and realistic motion parallax. However, existing volumetric representations from explicit point clouds to implicit neural fields, remain costly in capture, computation, and rendering, which limits their scalability for on-demand video and reduces their feasibility for real-time communication. To bridge this gap, we propose Content-Promoted Scene Layers (CPSL), a compact 2.5D video representation that brings the perceptual benefits of volumetric video to conventional 2D content. Guided by per-frame depth and content saliency, CPSL decomposes each frame into a small set of geometry-consistent layers equipped with soft alpha bands and an edge-depth cache that jointly preserve occlusion ordering and boundary continuity. These lightweight, 2D-encodable assets enable parallax-corrected novel-view synthesis via depth-weighted warping and front-to-back alpha compositing, bypassing expensive 3D reconstruction. Temporally, CPSL maintains inter-frame coherence using motion-guided propagation and per-layer encoding, supporting real-time playback with standard video codecs. Across multiple benchmarks, CPSL achieves superior perceptual quality and boundary fidelity compared with layer-based and neural-field baselines while reducing storage and rendering cost by several folds. Our approach offer a practical path from 2D video to scalable 2.5D immersive media.
format Preprint
id arxiv_https___arxiv_org_abs_2511_14927
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CPSL: Representing Volumetric Video via Content-Promoted Scene Layers
Hu, Kaiyuan
Jin, Yili
Liu, Junhua
Duan, Xize
Kang, Hong
Liu, Xue
Computer Vision and Pattern Recognition
Multimedia
Volumetric video enables immersive and interactive visual experiences by supporting free viewpoint exploration and realistic motion parallax. However, existing volumetric representations from explicit point clouds to implicit neural fields, remain costly in capture, computation, and rendering, which limits their scalability for on-demand video and reduces their feasibility for real-time communication. To bridge this gap, we propose Content-Promoted Scene Layers (CPSL), a compact 2.5D video representation that brings the perceptual benefits of volumetric video to conventional 2D content. Guided by per-frame depth and content saliency, CPSL decomposes each frame into a small set of geometry-consistent layers equipped with soft alpha bands and an edge-depth cache that jointly preserve occlusion ordering and boundary continuity. These lightweight, 2D-encodable assets enable parallax-corrected novel-view synthesis via depth-weighted warping and front-to-back alpha compositing, bypassing expensive 3D reconstruction. Temporally, CPSL maintains inter-frame coherence using motion-guided propagation and per-layer encoding, supporting real-time playback with standard video codecs. Across multiple benchmarks, CPSL achieves superior perceptual quality and boundary fidelity compared with layer-based and neural-field baselines while reducing storage and rendering cost by several folds. Our approach offer a practical path from 2D video to scalable 2.5D immersive media.
title CPSL: Representing Volumetric Video via Content-Promoted Scene Layers
topic Computer Vision and Pattern Recognition
Multimedia
url https://arxiv.org/abs/2511.14927