Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2505.07032 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916783721545728 |
|---|---|
| author | Zhao, Fei Zhang, Runlin Zhang, Chengcui Saxena, Nitesh |
| author_facet | Zhao, Fei Zhang, Runlin Zhang, Chengcui Saxena, Nitesh |
| contents | We present MarkMatch, a retrieval system for detecting whether two paper ballot marks were filled by the same hand. Unlike the previous SOTA method BubbleSig, which used binary classification on isolated mark pairs, MarkMatch ranks stylistic similarity between a query mark and a mark in the database using contrastive learning. Our model is trained with a dense batch similarity matrix and a dual loss objective. Each sample is contrasted against many negatives within each batch, enabling the model to learn subtle handwriting difference and improve generalization under handwriting variation and visual noise, while diagonal supervision reinforces high confidence on true matches. The model achieves an F1 score of 0.943, surpassing BubbleSig's best performance. MarkMatch also integrates Segment Anything Model for flexible mark extraction via box- or point-based prompts. The system offers election auditors a practical tool for visual, non-biometric investigation of suspicious ballots. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_07032 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | MarkMatch: Same-Hand Stuffing Detection Zhao, Fei Zhang, Runlin Zhang, Chengcui Saxena, Nitesh Computer Vision and Pattern Recognition We present MarkMatch, a retrieval system for detecting whether two paper ballot marks were filled by the same hand. Unlike the previous SOTA method BubbleSig, which used binary classification on isolated mark pairs, MarkMatch ranks stylistic similarity between a query mark and a mark in the database using contrastive learning. Our model is trained with a dense batch similarity matrix and a dual loss objective. Each sample is contrasted against many negatives within each batch, enabling the model to learn subtle handwriting difference and improve generalization under handwriting variation and visual noise, while diagonal supervision reinforces high confidence on true matches. The model achieves an F1 score of 0.943, surpassing BubbleSig's best performance. MarkMatch also integrates Segment Anything Model for flexible mark extraction via box- or point-based prompts. The system offers election auditors a practical tool for visual, non-biometric investigation of suspicious ballots. |
| title | MarkMatch: Same-Hand Stuffing Detection |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2505.07032 |