Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | https://arxiv.org/abs/2601.11885 |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866908772854661120 |
|---|---|
| author | Li, Zhifei Qin, Ziyue Luo, Xiangyu Hou, Xiaoju Zhao, Yue Zhang, Miao Huang, Zhifang Xiao, Kui Yang, Bing |
| author_facet | Li, Zhifei Qin, Ziyue Luo, Xiangyu Hou, Xiaoju Zhao, Yue Zhang, Miao Huang, Zhifang Xiao, Kui Yang, Bing |
| contents | Multi-modal entity alignment aims to identify equivalent entities between two multi-modal Knowledge graphs by integrating multi-modal data, such as images and text, to enrich the semantic representations of entities. However, existing methods may overlook the structural contextual information within each modality, making them vulnerable to interference from shallow features. To address these challenges, we propose MyGram, a modality-aware graph transformer with global distribution for multi-modal entity alignment. Specifically, we develop a modality diffusion learning module to capture deep structural contextual information within modalities and enable fine-grained multi-modal fusion. In addition, we introduce a Gram Loss that acts as a regularization constraint by minimizing the volume of a 4-dimensional parallelotope formed by multi-modal features, thereby achieving global distribution consistency across modalities. We conduct experiments on five public datasets. Results show that MyGram outperforms baseline models, achieving a maximum improvement of 4.8% in Hits@1 on FBDB15K, 9.9% on FBYG15K, and 4.3% on DBP15K. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_11885 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | MyGram: Modality-aware Graph Transformer with Global Distribution for Multi-modal Entity Alignment Li, Zhifei Qin, Ziyue Luo, Xiangyu Hou, Xiaoju Zhao, Yue Zhang, Miao Huang, Zhifang Xiao, Kui Yang, Bing Artificial Intelligence Multi-modal entity alignment aims to identify equivalent entities between two multi-modal Knowledge graphs by integrating multi-modal data, such as images and text, to enrich the semantic representations of entities. However, existing methods may overlook the structural contextual information within each modality, making them vulnerable to interference from shallow features. To address these challenges, we propose MyGram, a modality-aware graph transformer with global distribution for multi-modal entity alignment. Specifically, we develop a modality diffusion learning module to capture deep structural contextual information within modalities and enable fine-grained multi-modal fusion. In addition, we introduce a Gram Loss that acts as a regularization constraint by minimizing the volume of a 4-dimensional parallelotope formed by multi-modal features, thereby achieving global distribution consistency across modalities. We conduct experiments on five public datasets. Results show that MyGram outperforms baseline models, achieving a maximum improvement of 4.8% in Hits@1 on FBDB15K, 9.9% on FBYG15K, and 4.3% on DBP15K. |
| title | MyGram: Modality-aware Graph Transformer with Global Distribution for Multi-modal Entity Alignment |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2601.11885 |