Video Quality Enhancement Using Deep Learning-Based Prediction Models for Quantized DCT Coefficients in MPEG I-frames

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Busson, Antonio J G, Mendes, Paulo R C, Moraes, Daniel de S, da Veiga, Álvaro M, Guedes, Álan L V, Colcher, Sérgio
Format: Preprint
Published: 2020
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908587726471168
author Busson, Antonio J G
Mendes, Paulo R C
Moraes, Daniel de S
da Veiga, Álvaro M
Guedes, Álan L V
Colcher, Sérgio
author_facet Busson, Antonio J G
Mendes, Paulo R C
Moraes, Daniel de S
da Veiga, Álvaro M
Guedes, Álan L V
Colcher, Sérgio
contents Recent works have successfully applied some types of Convolutional Neural Networks (CNNs) to reduce the noticeable distortion resulting from the lossy JPEG/MPEG compression technique. Most of them are built upon the processing made on the spatial domain. In this work, we propose a MPEG video decoder that is purely based on the frequency-to-frequency domain: it reads the quantized DCT coefficients received from a low-quality I-frames bitstream and, using a deep learning-based model, predicts the missing coefficients in order to recompose the same frames with enhanced quality. In experiments with a video dataset, our best model was able to improve from frames with quantized DCT coefficients corresponding to a Quality Factor (QF) of 10 to enhanced quality frames with QF slightly near to 20.
format Preprint
id arxiv_https___arxiv_org_abs_2010_05760
institution arXiv
publishDate 2020
record_format arxiv
spellingShingle Video Quality Enhancement Using Deep Learning-Based Prediction Models for Quantized DCT Coefficients in MPEG I-frames
Busson, Antonio J G
Mendes, Paulo R C
Moraes, Daniel de S
da Veiga, Álvaro M
Guedes, Álan L V
Colcher, Sérgio
Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
Multimedia
Recent works have successfully applied some types of Convolutional Neural Networks (CNNs) to reduce the noticeable distortion resulting from the lossy JPEG/MPEG compression technique. Most of them are built upon the processing made on the spatial domain. In this work, we propose a MPEG video decoder that is purely based on the frequency-to-frequency domain: it reads the quantized DCT coefficients received from a low-quality I-frames bitstream and, using a deep learning-based model, predicts the missing coefficients in order to recompose the same frames with enhanced quality. In experiments with a video dataset, our best model was able to improve from frames with quantized DCT coefficients corresponding to a Quality Factor (QF) of 10 to enhanced quality frames with QF slightly near to 20.
title Video Quality Enhancement Using Deep Learning-Based Prediction Models for Quantized DCT Coefficients in MPEG I-frames
topic Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
Multimedia
url https://arxiv.org/abs/2010.05760