Three-stage binarization of color document images based on discrete wavelet transform and generative adversarial networks

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ju, Rui-Yang, Lin, Yu-Shian, Jin, Yanlin, Chen, Chih-Chia, Chien, Chun-Tse, Chiang, Jen-Shiun
Natura: Preprint
Pubblicazione: 2022
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915776159547392
author Ju, Rui-Yang
Lin, Yu-Shian
Jin, Yanlin
Chen, Chih-Chia
Chien, Chun-Tse
Chiang, Jen-Shiun
author_facet Ju, Rui-Yang
Lin, Yu-Shian
Jin, Yanlin
Chen, Chih-Chia
Chien, Chun-Tse
Chiang, Jen-Shiun
contents The efficient extraction of text information from the background in degraded color document images is an important challenge in the preservation of ancient manuscripts. The imperfect preservation of ancient manuscripts has led to different types of degradation over time, such as page yellowing, staining, and ink bleeding, seriously affecting the results of document image binarization. This work proposes an effective three-stage network method to image enhancement and binarization of degraded documents using generative adversarial networks (GANs). Specifically, in Stage-1, we first split the input images into multiple patches, and then split these patches into four single-channel patch images (gray, red, green, and blue). Then, three single-channel patch images (red, green, and blue) are processed by the discrete wavelet transform (DWT) with normalization. In Stage-2, we use four independent generators to separately train GAN models based on the four channels on the processed patch images to extract color foreground information. Finally, in Stage-3, we train two independent GAN models on the outputs of Stage-2 and the resized original input images (512x512) as the local and global predictions to obtain the final outputs. The experimental results show that the Avg-Score metrics of the proposed method are 77.64, 77.95, 79.05, 76.38, 75.34, and 77.00 on the (H)-DIBCO 2011, 2013, 2014, 2016, 2017, and 2018 datasets, which are at the state-of-the-art level. The implementation code for this work is available at https://github.com/abcpp12383/ThreeStageBinarization.
format Preprint
id arxiv_https___arxiv_org_abs_2211_16098
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Three-stage binarization of color document images based on discrete wavelet transform and generative adversarial networks
Ju, Rui-Yang
Lin, Yu-Shian
Jin, Yanlin
Chen, Chih-Chia
Chien, Chun-Tse
Chiang, Jen-Shiun
Computer Vision and Pattern Recognition
The efficient extraction of text information from the background in degraded color document images is an important challenge in the preservation of ancient manuscripts. The imperfect preservation of ancient manuscripts has led to different types of degradation over time, such as page yellowing, staining, and ink bleeding, seriously affecting the results of document image binarization. This work proposes an effective three-stage network method to image enhancement and binarization of degraded documents using generative adversarial networks (GANs). Specifically, in Stage-1, we first split the input images into multiple patches, and then split these patches into four single-channel patch images (gray, red, green, and blue). Then, three single-channel patch images (red, green, and blue) are processed by the discrete wavelet transform (DWT) with normalization. In Stage-2, we use four independent generators to separately train GAN models based on the four channels on the processed patch images to extract color foreground information. Finally, in Stage-3, we train two independent GAN models on the outputs of Stage-2 and the resized original input images (512x512) as the local and global predictions to obtain the final outputs. The experimental results show that the Avg-Score metrics of the proposed method are 77.64, 77.95, 79.05, 76.38, 75.34, and 77.00 on the (H)-DIBCO 2011, 2013, 2014, 2016, 2017, and 2018 datasets, which are at the state-of-the-art level. The implementation code for this work is available at https://github.com/abcpp12383/ThreeStageBinarization.
title Three-stage binarization of color document images based on discrete wavelet transform and generative adversarial networks
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2211.16098