Text Change Detection in Multilingual Documents Using Image Comparison

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Park, Doyoung, Yarram, Naresh Reddy, Kim, Sunjin, Kim, Minkyu, Cho, Seongho, Lee, Taehee
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909417456271360
author Park, Doyoung
Yarram, Naresh Reddy
Kim, Sunjin
Kim, Minkyu
Cho, Seongho
Lee, Taehee
author_facet Park, Doyoung
Yarram, Naresh Reddy
Kim, Sunjin
Kim, Minkyu
Cho, Seongho
Lee, Taehee
contents Document comparison typically relies on optical character recognition (OCR) as its core technology. However, OCR requires the selection of appropriate language models for each document and the performance of multilingual or hybrid models remains limited. To overcome these challenges, we propose text change detection (TCD) using an image comparison model tailored for multilingual documents. Unlike OCR-based approaches, our method employs word-level text image-to-image comparison to detect changes. Our model generates bidirectional change segmentation maps between the source and target documents. To enhance performance without requiring explicit text alignment or scaling preprocessing, we employ correlations among multi-scale attention features. We also construct a benchmark dataset comprising actual printed and scanned word pairs in various languages to evaluate our model. We validate our approach using our benchmark dataset and public benchmarks Distorted Document Images and the LRDE Document Binarization Dataset. We compare our model against state-of-the-art semantic segmentation and change detection models, as well as to conventional OCR-based models.
format Preprint
id arxiv_https___arxiv_org_abs_2412_04137
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Text Change Detection in Multilingual Documents Using Image Comparison
Park, Doyoung
Yarram, Naresh Reddy
Kim, Sunjin
Kim, Minkyu
Cho, Seongho
Lee, Taehee
Computer Vision and Pattern Recognition
Artificial Intelligence
Computation and Language
Machine Learning
Document comparison typically relies on optical character recognition (OCR) as its core technology. However, OCR requires the selection of appropriate language models for each document and the performance of multilingual or hybrid models remains limited. To overcome these challenges, we propose text change detection (TCD) using an image comparison model tailored for multilingual documents. Unlike OCR-based approaches, our method employs word-level text image-to-image comparison to detect changes. Our model generates bidirectional change segmentation maps between the source and target documents. To enhance performance without requiring explicit text alignment or scaling preprocessing, we employ correlations among multi-scale attention features. We also construct a benchmark dataset comprising actual printed and scanned word pairs in various languages to evaluate our model. We validate our approach using our benchmark dataset and public benchmarks Distorted Document Images and the LRDE Document Binarization Dataset. We compare our model against state-of-the-art semantic segmentation and change detection models, as well as to conventional OCR-based models.
title Text Change Detection in Multilingual Documents Using Image Comparison
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Computation and Language
Machine Learning
url https://arxiv.org/abs/2412.04137