Saved in:
Bibliographic Details
Main Author: Wigington, Curtis
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2411.00576
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916464547594240
author Wigington, Curtis
author_facet Wigington, Curtis
contents Document capture applications on smartphones have emerged as popular tools for digitizing documents. For many individuals, capturing documents with their smartphones is more convenient than using dedicated photocopiers or scanners, even if the quality of digitization is lower. However, using a smartphone for digitization can become excessively time-consuming and tedious when a user needs to digitize a document with multiple pages. In this work, we propose a novel approach to automatically scan multi-page documents from a video stream as the user turns through the pages of the document. Unlike previous methods that required constrained settings such as mounting the phone on a tripod, our technique is designed to allow the user to hold the phone in their hand. Our technique is trained to be robust to the motion and instability inherent in handheld scanning. Our primary contributions in this work include: (1) an efficient, on-device deep learning model that is accurate and robust for handheld scanning, (2) a novel data collection and annotation technique for video document scanning, and (3) state-of-the-art results on the PUCIT page turn dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2411_00576
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Handheld Video Document Scanning: A Robust On-Device Model for Multi-Page Document Scanning
Wigington, Curtis
Computer Vision and Pattern Recognition
Document capture applications on smartphones have emerged as popular tools for digitizing documents. For many individuals, capturing documents with their smartphones is more convenient than using dedicated photocopiers or scanners, even if the quality of digitization is lower. However, using a smartphone for digitization can become excessively time-consuming and tedious when a user needs to digitize a document with multiple pages. In this work, we propose a novel approach to automatically scan multi-page documents from a video stream as the user turns through the pages of the document. Unlike previous methods that required constrained settings such as mounting the phone on a tripod, our technique is designed to allow the user to hold the phone in their hand. Our technique is trained to be robust to the motion and instability inherent in handheld scanning. Our primary contributions in this work include: (1) an efficient, on-device deep learning model that is accurate and robust for handheld scanning, (2) a novel data collection and annotation technique for video document scanning, and (3) state-of-the-art results on the PUCIT page turn dataset.
title Handheld Video Document Scanning: A Robust On-Device Model for Multi-Page Document Scanning
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2411.00576