Saved in:
Bibliographic Details
Main Authors: Chen, Fangke, Dong, Tianhao, Chen, Sirry, Zhang, Guobin, Zhang, Yishu, Chen, Yining
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.11248
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908770579251200
author Chen, Fangke
Dong, Tianhao
Chen, Sirry
Zhang, Guobin
Zhang, Yishu
Chen, Yining
author_facet Chen, Fangke
Dong, Tianhao
Chen, Sirry
Zhang, Guobin
Zhang, Yishu
Chen, Yining
contents Handwritten word retrieval is vital for digital archives but remains challenging due to large handwriting variability and cross-lingual semantic gaps. While large vision-language models offer potential solutions, their prohibitive computational costs hinder practical edge deployment. To address this, we propose a lightweight asymmetric dual-encoder framework that learns unified, style-invariant visual embeddings. By jointly optimizing instance-level alignment and class-level semantic consistency, our approach anchors visual embeddings to language-agnostic semantic prototypes, enforcing invariance across scripts and writing styles. Experiments show that our method outperforms 28 baselines and achieves state-of-the-art accuracy on within-language retrieval benchmarks. We further conduct explicit cross-lingual retrieval, where the query language differs from the target language, to validate the effectiveness of the learned cross-lingual representations. Achieving strong performance with only a fraction of the parameters required by existing models, our framework enables accurate and resource-efficient cross-script handwriting retrieval.
format Preprint
id arxiv_https___arxiv_org_abs_2601_11248
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Language-Agnostic Visual Embeddings for Cross-Script Handwriting Retrieval
Chen, Fangke
Dong, Tianhao
Chen, Sirry
Zhang, Guobin
Zhang, Yishu
Chen, Yining
Computer Vision and Pattern Recognition
Handwritten word retrieval is vital for digital archives but remains challenging due to large handwriting variability and cross-lingual semantic gaps. While large vision-language models offer potential solutions, their prohibitive computational costs hinder practical edge deployment. To address this, we propose a lightweight asymmetric dual-encoder framework that learns unified, style-invariant visual embeddings. By jointly optimizing instance-level alignment and class-level semantic consistency, our approach anchors visual embeddings to language-agnostic semantic prototypes, enforcing invariance across scripts and writing styles. Experiments show that our method outperforms 28 baselines and achieves state-of-the-art accuracy on within-language retrieval benchmarks. We further conduct explicit cross-lingual retrieval, where the query language differs from the target language, to validate the effectiveness of the learned cross-lingual representations. Achieving strong performance with only a fraction of the parameters required by existing models, our framework enables accurate and resource-efficient cross-script handwriting retrieval.
title Language-Agnostic Visual Embeddings for Cross-Script Handwriting Retrieval
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2601.11248