Saved in:
Bibliographic Details
Main Authors: Zhang, Chenghao, Long, Qingqing, Wang, Ludi, Cui, Wenjuan, Yu, Jianjun, Du, Yi
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.19171
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918459267350528
author Zhang, Chenghao
Long, Qingqing
Wang, Ludi
Cui, Wenjuan
Yu, Jianjun
Du, Yi
author_facet Zhang, Chenghao
Long, Qingqing
Wang, Ludi
Cui, Wenjuan
Yu, Jianjun
Du, Yi
contents Heterogeneous graphs have attracted increasing attention for modeling multi-typed entities and relations in complex real-world systems. Multi-label node classification on heterogeneous graphs is challenging due to structural heterogeneity and the need to learn shared representations across multiple labels. Existing methods typically adopt either flexible attention mechanisms or meta-path constrained anchoring, but in heterogeneous multi-label prediction they often suffer from semantic dilution or coverage constraint. Both issues are further amplified under multi-label supervision. We present a theoretical analysis showing that as heterogeneous neighborhoods expand, the attention mass allocated to task-critical (primary) neighborhoods diminishes, and that meta-path constrained aggregation exhibits a dilemma: too few meta-paths intensify coverage constraint, while too many re-introduce dilution. To resolve this coverage-anchoring conflict, we propose FOCAL: Fusion Of Coverage and Anchoring Learning, with two components: coverage-oriented attention (COA) for flexible, unconstrained heterogeneous context aggregation, and anchoring-oriented attention (AOA) that restricts aggregation to meta-path-induced primary semantics. Our theoretical analysis and experimental results further indicates that FOCAL has a better performance than other state-of-the-art methods.
format Preprint
id arxiv_https___arxiv_org_abs_2604_19171
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle FOCAL-Attention for Heterogeneous Multi-Label Prediction
Zhang, Chenghao
Long, Qingqing
Wang, Ludi
Cui, Wenjuan
Yu, Jianjun
Du, Yi
Machine Learning
Heterogeneous graphs have attracted increasing attention for modeling multi-typed entities and relations in complex real-world systems. Multi-label node classification on heterogeneous graphs is challenging due to structural heterogeneity and the need to learn shared representations across multiple labels. Existing methods typically adopt either flexible attention mechanisms or meta-path constrained anchoring, but in heterogeneous multi-label prediction they often suffer from semantic dilution or coverage constraint. Both issues are further amplified under multi-label supervision. We present a theoretical analysis showing that as heterogeneous neighborhoods expand, the attention mass allocated to task-critical (primary) neighborhoods diminishes, and that meta-path constrained aggregation exhibits a dilemma: too few meta-paths intensify coverage constraint, while too many re-introduce dilution. To resolve this coverage-anchoring conflict, we propose FOCAL: Fusion Of Coverage and Anchoring Learning, with two components: coverage-oriented attention (COA) for flexible, unconstrained heterogeneous context aggregation, and anchoring-oriented attention (AOA) that restricts aggregation to meta-path-induced primary semantics. Our theoretical analysis and experimental results further indicates that FOCAL has a better performance than other state-of-the-art methods.
title FOCAL-Attention for Heterogeneous Multi-Label Prediction
topic Machine Learning
url https://arxiv.org/abs/2604.19171