ProtoSnap: Prototype Alignment for Cuneiform Signs

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Mikulinsky, Rachel, Alper, Morris, Gordin, Shai, Jiménez, Enrique, Cohen, Yoram, Averbuch-Elor, Hadar
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912214621880320
author Mikulinsky, Rachel
Alper, Morris
Gordin, Shai
Jiménez, Enrique
Cohen, Yoram
Averbuch-Elor, Hadar
author_facet Mikulinsky, Rachel
Alper, Morris
Gordin, Shai
Jiménez, Enrique
Cohen, Yoram
Averbuch-Elor, Hadar
contents The cuneiform writing system served as the medium for transmitting knowledge in the ancient Near East for a period of over three thousand years. Cuneiform signs have a complex internal structure which is the subject of expert paleographic analysis, as variations in sign shapes bear witness to historical developments and transmission of writing and culture over time. However, prior automated techniques mostly treat sign types as categorical and do not explicitly model their highly varied internal configurations. In this work, we present an unsupervised approach for recovering the fine-grained internal configuration of cuneiform signs by leveraging powerful generative models and the appearance and structure of prototype font images as priors. Our approach, ProtoSnap, enforces structural consistency on matches found with deep image features to estimate the diverse configurations of cuneiform characters, snapping a skeleton-based template to photographed cuneiform signs. We provide a new benchmark of expert annotations and evaluate our method on this task. Our evaluation shows that our approach succeeds in aligning prototype skeletons to a wide variety of cuneiform signs. Moreover, we show that conditioning on structures produced by our method allows for generating synthetic data with correct structural configurations, significantly boosting the performance of cuneiform sign recognition beyond existing techniques, in particular over rare signs. Our code, data, and trained models are available at the project page: https://tau-vailab.github.io/ProtoSnap/
format Preprint
id arxiv_https___arxiv_org_abs_2502_00129
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ProtoSnap: Prototype Alignment for Cuneiform Signs
Mikulinsky, Rachel
Alper, Morris
Gordin, Shai
Jiménez, Enrique
Cohen, Yoram
Averbuch-Elor, Hadar
Computer Vision and Pattern Recognition
Machine Learning
The cuneiform writing system served as the medium for transmitting knowledge in the ancient Near East for a period of over three thousand years. Cuneiform signs have a complex internal structure which is the subject of expert paleographic analysis, as variations in sign shapes bear witness to historical developments and transmission of writing and culture over time. However, prior automated techniques mostly treat sign types as categorical and do not explicitly model their highly varied internal configurations. In this work, we present an unsupervised approach for recovering the fine-grained internal configuration of cuneiform signs by leveraging powerful generative models and the appearance and structure of prototype font images as priors. Our approach, ProtoSnap, enforces structural consistency on matches found with deep image features to estimate the diverse configurations of cuneiform characters, snapping a skeleton-based template to photographed cuneiform signs. We provide a new benchmark of expert annotations and evaluate our method on this task. Our evaluation shows that our approach succeeds in aligning prototype skeletons to a wide variety of cuneiform signs. Moreover, we show that conditioning on structures produced by our method allows for generating synthetic data with correct structural configurations, significantly boosting the performance of cuneiform sign recognition beyond existing techniques, in particular over rare signs. Our code, data, and trained models are available at the project page: https://tau-vailab.github.io/ProtoSnap/
title ProtoSnap: Prototype Alignment for Cuneiform Signs
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2502.00129