Zero-Shot Synthetic-to-Real Handwritten Text Recognition via Task Analogies

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Garrido-Munoz, Carlos, Panariello, Aniello, Cascianelli, Silvia, Porrello, Angelo, Calderara, Simone, Calvo-Zaragoza, Jorge, Cucchiara, Rita
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917400027332608
author Garrido-Munoz, Carlos
Panariello, Aniello
Cascianelli, Silvia
Porrello, Angelo
Calderara, Simone
Calvo-Zaragoza, Jorge
Cucchiara, Rita
author_facet Garrido-Munoz, Carlos
Panariello, Aniello
Cascianelli, Silvia
Porrello, Angelo
Calderara, Simone
Calvo-Zaragoza, Jorge
Cucchiara, Rita
contents Handwritten Text Recognition (HTR) models trained on synthetic handwriting often struggle to generalize to real text, and existing adaptation methods still require real samples from the target domain. In this work, we tackle the fully zero-shot synthetic-to-real generalization setting, where no real data from the target language is available. Our approach learns how model parameters change when moving from synthetic to real handwriting in one or more source languages and transfers this learned correction to new target languages. When using multiple sources, we rely on linguistic similarity to weigh their contrubition when combining them. Experiments across five languages and six architectures show consistent improvements over synthetic-only baselines and reveal that the transferred corrections benefit even languages unrelated to the sources.
format Preprint
id arxiv_https___arxiv_org_abs_2604_09713
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Zero-Shot Synthetic-to-Real Handwritten Text Recognition via Task Analogies
Garrido-Munoz, Carlos
Panariello, Aniello
Cascianelli, Silvia
Porrello, Angelo
Calderara, Simone
Calvo-Zaragoza, Jorge
Cucchiara, Rita
Computer Vision and Pattern Recognition
Handwritten Text Recognition (HTR) models trained on synthetic handwriting often struggle to generalize to real text, and existing adaptation methods still require real samples from the target domain. In this work, we tackle the fully zero-shot synthetic-to-real generalization setting, where no real data from the target language is available. Our approach learns how model parameters change when moving from synthetic to real handwriting in one or more source languages and transfers this learned correction to new target languages. When using multiple sources, we rely on linguistic similarity to weigh their contrubition when combining them. Experiments across five languages and six architectures show consistent improvements over synthetic-only baselines and reveal that the transferred corrections benefit even languages unrelated to the sources.
title Zero-Shot Synthetic-to-Real Handwritten Text Recognition via Task Analogies
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.09713