MathWriting: A Dataset For Handwritten Mathematical Expression Recognition

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Gervais, Philippe, Fadeeva, Anastasiia, Maksai, Andrii
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909556458651648
author Gervais, Philippe
Fadeeva, Anastasiia
Maksai, Andrii
author_facet Gervais, Philippe
Fadeeva, Anastasiia
Maksai, Andrii
contents Recognition of handwritten mathematical expressions allows to transfer scientific notes into their digital form. It facilitates the sharing, searching, and preservation of scientific information. We introduce MathWriting, the largest online handwritten mathematical expression dataset to date. It consists of 230k human-written samples and an additional 400k synthetic ones}. This dataset can also be used in its rendered form for offline HME recognition. One MathWriting sample consists of a formula written on a touch screen and a corresponding LaTeX expression. We also provide a normalized version of LaTeX expression to simplify the recognition task and enhance the result quality. We provide baseline performance of standard models like OCR and CTC Transformer as well as Vision-Language Models like PaLI on the dataset. The dataset together with an example colab is accessible on Github.
format Preprint
id arxiv_https___arxiv_org_abs_2404_10690
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle MathWriting: A Dataset For Handwritten Mathematical Expression Recognition
Gervais, Philippe
Fadeeva, Anastasiia
Maksai, Andrii
Computer Vision and Pattern Recognition
Human-Computer Interaction
Machine Learning
Recognition of handwritten mathematical expressions allows to transfer scientific notes into their digital form. It facilitates the sharing, searching, and preservation of scientific information. We introduce MathWriting, the largest online handwritten mathematical expression dataset to date. It consists of 230k human-written samples and an additional 400k synthetic ones}. This dataset can also be used in its rendered form for offline HME recognition. One MathWriting sample consists of a formula written on a touch screen and a corresponding LaTeX expression. We also provide a normalized version of LaTeX expression to simplify the recognition task and enhance the result quality. We provide baseline performance of standard models like OCR and CTC Transformer as well as Vision-Language Models like PaLI on the dataset. The dataset together with an example colab is accessible on Github.
title MathWriting: A Dataset For Handwritten Mathematical Expression Recognition
topic Computer Vision and Pattern Recognition
Human-Computer Interaction
Machine Learning
url https://arxiv.org/abs/2404.10690