Saved in:
Bibliographic Details
Main Authors: Chen, Fangke, Dong, Tianhao, Chen, Sirry, Zhang, Guobin, Zhang, Yishu, Chen, Yining
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.11248
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Handwritten word retrieval is vital for digital archives but remains challenging due to large handwriting variability and cross-lingual semantic gaps. While large vision-language models offer potential solutions, their prohibitive computational costs hinder practical edge deployment. To address this, we propose a lightweight asymmetric dual-encoder framework that learns unified, style-invariant visual embeddings. By jointly optimizing instance-level alignment and class-level semantic consistency, our approach anchors visual embeddings to language-agnostic semantic prototypes, enforcing invariance across scripts and writing styles. Experiments show that our method outperforms 28 baselines and achieves state-of-the-art accuracy on within-language retrieval benchmarks. We further conduct explicit cross-lingual retrieval, where the query language differs from the target language, to validate the effectiveness of the learned cross-lingual representations. Achieving strong performance with only a fraction of the parameters required by existing models, our framework enables accurate and resource-efficient cross-script handwriting retrieval.