Reliable Representation Learning for Incomplete Multi-View Missing Multi-Label Classification

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Liu, Chengliang, Wen, Jie, Xu, Yong, Zhang, Bob, Nie, Liqiang, Zhang, Min
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911032461492224
author Liu, Chengliang
Wen, Jie
Xu, Yong
Zhang, Bob
Nie, Liqiang
Zhang, Min
author_facet Liu, Chengliang
Wen, Jie
Xu, Yong
Zhang, Bob
Nie, Liqiang
Zhang, Min
contents As a cross-topic of multi-view learning and multi-label classification, multi-view multi-label classification has gradually gained traction in recent years. The application of multi-view contrastive learning has further facilitated this process, however, the existing multi-view contrastive learning methods crudely separate the so-called negative pair, which largely results in the separation of samples belonging to the same category or similar ones. Besides, plenty of multi-view multi-label learning methods ignore the possible absence of views and labels. To address these issues, in this paper, we propose an incomplete multi-view missing multi-label classification network named RANK. In this network, a label-driven multi-view contrastive learning strategy is proposed to leverage supervised information to preserve the intra-view structure and perform the cross-view consistency alignment. Furthermore, we break through the view-level weights inherent in existing methods and propose a quality-aware sub-network to dynamically assign quality scores to each view of each sample. The label correlation information is fully utilized in the final multi-label cross-entropy classification loss, effectively improving the discriminative power. Last but not least, our model is not only able to handle complete multi-view multi-label data, but also works on datasets with missing instances and labels. Extensive experiments confirm that our RANK outperforms existing state-of-the-art methods.
format Preprint
id arxiv_https___arxiv_org_abs_2303_17117
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Reliable Representation Learning for Incomplete Multi-View Missing Multi-Label Classification
Liu, Chengliang
Wen, Jie
Xu, Yong
Zhang, Bob
Nie, Liqiang
Zhang, Min
Computer Vision and Pattern Recognition
As a cross-topic of multi-view learning and multi-label classification, multi-view multi-label classification has gradually gained traction in recent years. The application of multi-view contrastive learning has further facilitated this process, however, the existing multi-view contrastive learning methods crudely separate the so-called negative pair, which largely results in the separation of samples belonging to the same category or similar ones. Besides, plenty of multi-view multi-label learning methods ignore the possible absence of views and labels. To address these issues, in this paper, we propose an incomplete multi-view missing multi-label classification network named RANK. In this network, a label-driven multi-view contrastive learning strategy is proposed to leverage supervised information to preserve the intra-view structure and perform the cross-view consistency alignment. Furthermore, we break through the view-level weights inherent in existing methods and propose a quality-aware sub-network to dynamically assign quality scores to each view of each sample. The label correlation information is fully utilized in the final multi-label cross-entropy classification loss, effectively improving the discriminative power. Last but not least, our model is not only able to handle complete multi-view multi-label data, but also works on datasets with missing instances and labels. Extensive experiments confirm that our RANK outperforms existing state-of-the-art methods.
title Reliable Representation Learning for Incomplete Multi-View Missing Multi-Label Classification
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2303.17117