A Semantic-Enhanced Heterogeneous Graph Learning Method for Flexible Objects Recognition

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yang, Kunshan, Luo, Wenwei, Hu, Yuguo, Yan, Jiafu, Jing, Mengmeng, Zuo, Lin
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916664685101056
author Yang, Kunshan
Luo, Wenwei
Hu, Yuguo
Yan, Jiafu
Jing, Mengmeng
Zuo, Lin
author_facet Yang, Kunshan
Luo, Wenwei
Hu, Yuguo
Yan, Jiafu
Jing, Mengmeng
Zuo, Lin
contents Flexible objects recognition remains a significant challenge due to its inherently diverse shapes and sizes, translucent attributes, and subtle inter-class differences. Graph-based models, such as graph convolution networks and graph vision models, are promising in flexible objects recognition due to their ability of capturing variable relations within the flexible objects. These methods, however, often focus on global visual relationships or fail to align semantic and visual information. To alleviate these limitations, we propose a semantic-enhanced heterogeneous graph learning method. First, an adaptive scanning module is employed to extract discriminative semantic context, facilitating the matching of flexible objects with varying shapes and sizes while aligning semantic and visual nodes to enhance cross-modal feature correlation. Second, a heterogeneous graph generation module aggregates global visual and local semantic node features, improving the recognition of flexible objects. Additionally, We introduce the FSCW, a large-scale flexible dataset curated from existing sources. We validate our method through extensive experiments on flexible datasets (FDA and FSCW), and challenge benchmarks (CIFAR-100 and ImageNet-Hard), demonstrating competitive performance.
format Preprint
id arxiv_https___arxiv_org_abs_2503_22079
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Semantic-Enhanced Heterogeneous Graph Learning Method for Flexible Objects Recognition
Yang, Kunshan
Luo, Wenwei
Hu, Yuguo
Yan, Jiafu
Jing, Mengmeng
Zuo, Lin
Computer Vision and Pattern Recognition
Flexible objects recognition remains a significant challenge due to its inherently diverse shapes and sizes, translucent attributes, and subtle inter-class differences. Graph-based models, such as graph convolution networks and graph vision models, are promising in flexible objects recognition due to their ability of capturing variable relations within the flexible objects. These methods, however, often focus on global visual relationships or fail to align semantic and visual information. To alleviate these limitations, we propose a semantic-enhanced heterogeneous graph learning method. First, an adaptive scanning module is employed to extract discriminative semantic context, facilitating the matching of flexible objects with varying shapes and sizes while aligning semantic and visual nodes to enhance cross-modal feature correlation. Second, a heterogeneous graph generation module aggregates global visual and local semantic node features, improving the recognition of flexible objects. Additionally, We introduce the FSCW, a large-scale flexible dataset curated from existing sources. We validate our method through extensive experiments on flexible datasets (FDA and FSCW), and challenge benchmarks (CIFAR-100 and ImageNet-Hard), demonstrating competitive performance.
title A Semantic-Enhanced Heterogeneous Graph Learning Method for Flexible Objects Recognition
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.22079