Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2601.04614 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914407820296192 |
|---|---|
| author | Chen, Wenzhi Hu, Bo Li, Leida He, Lihuo Lu, Wen Gao, Xinbo |
| author_facet | Chen, Wenzhi Hu, Bo Li, Leida He, Lihuo Lu, Wen Gao, Xinbo |
| contents | With the rapid development of text-to-image generation technology, accurately assessing the alignment between generated images and text prompts has become a critical challenge. Existing methods rely on Euclidean space metrics, neglecting the structured nature of semantic alignment, while lacking adaptive capabilities for different samples. To address these limitations, we propose HyperAlign, an adaptive text-to-image alignment assessment framework based on hyperbolic entailment geometry. First, we extract Euclidean features using CLIP and map them to hyperbolic space. Second, we design a dynamic-supervision entailment modeling mechanism that transforms discrete entailment logic into continuous geometric structure supervision. Finally, we propose an adaptive modulation regressor that utilizes hyperbolic geometric features to generate sample-level modulation parameters, adaptively calibrating Euclidean cosine similarity to predict the final score. HyperAlign achieves highly competitive performance on both single database evaluation and cross-database generalization tasks, fully validating the effectiveness of hyperbolic geometric modeling for image-text alignment assessment. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_04614 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | HyperAlign: Hyperbolic Entailment Cones for Adaptive Text-to-Image Alignment Assessment Chen, Wenzhi Hu, Bo Li, Leida He, Lihuo Lu, Wen Gao, Xinbo Computer Vision and Pattern Recognition With the rapid development of text-to-image generation technology, accurately assessing the alignment between generated images and text prompts has become a critical challenge. Existing methods rely on Euclidean space metrics, neglecting the structured nature of semantic alignment, while lacking adaptive capabilities for different samples. To address these limitations, we propose HyperAlign, an adaptive text-to-image alignment assessment framework based on hyperbolic entailment geometry. First, we extract Euclidean features using CLIP and map them to hyperbolic space. Second, we design a dynamic-supervision entailment modeling mechanism that transforms discrete entailment logic into continuous geometric structure supervision. Finally, we propose an adaptive modulation regressor that utilizes hyperbolic geometric features to generate sample-level modulation parameters, adaptively calibrating Euclidean cosine similarity to predict the final score. HyperAlign achieves highly competitive performance on both single database evaluation and cross-database generalization tasks, fully validating the effectiveness of hyperbolic geometric modeling for image-text alignment assessment. |
| title | HyperAlign: Hyperbolic Entailment Cones for Adaptive Text-to-Image Alignment Assessment |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2601.04614 |