Automated Loss function Search for Class-imbalanced Node Classification

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Guo, Xinyu, Wu, Kai, Zhang, Xiaoyu, Liu, Jing
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916257486340096
author Guo, Xinyu
Wu, Kai
Zhang, Xiaoyu
Liu, Jing
author_facet Guo, Xinyu
Wu, Kai
Zhang, Xiaoyu
Liu, Jing
contents Class-imbalanced node classification tasks are prevalent in real-world scenarios. Due to the uneven distribution of nodes across different classes, learning high-quality node representations remains a challenging endeavor. The engineering of loss functions has shown promising potential in addressing this issue. It involves the meticulous design of loss functions, utilizing information about the quantities of nodes in different categories and the network's topology to learn unbiased node representations. However, the design of these loss functions heavily relies on human expert knowledge and exhibits limited adaptability to specific target tasks. In this paper, we introduce a high-performance, flexible, and generalizable automated loss function search framework to tackle this challenge. Across 15 combinations of graph neural networks and datasets, our framework achieves a significant improvement in performance compared to state-of-the-art methods. Additionally, we observe that homophily in graph-structured data significantly contributes to the transferability of the proposed framework.
format Preprint
id arxiv_https___arxiv_org_abs_2405_14133
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Automated Loss function Search for Class-imbalanced Node Classification
Guo, Xinyu
Wu, Kai
Zhang, Xiaoyu
Liu, Jing
Machine Learning
Artificial Intelligence
Symbolic Computation
Class-imbalanced node classification tasks are prevalent in real-world scenarios. Due to the uneven distribution of nodes across different classes, learning high-quality node representations remains a challenging endeavor. The engineering of loss functions has shown promising potential in addressing this issue. It involves the meticulous design of loss functions, utilizing information about the quantities of nodes in different categories and the network's topology to learn unbiased node representations. However, the design of these loss functions heavily relies on human expert knowledge and exhibits limited adaptability to specific target tasks. In this paper, we introduce a high-performance, flexible, and generalizable automated loss function search framework to tackle this challenge. Across 15 combinations of graph neural networks and datasets, our framework achieves a significant improvement in performance compared to state-of-the-art methods. Additionally, we observe that homophily in graph-structured data significantly contributes to the transferability of the proposed framework.
title Automated Loss function Search for Class-imbalanced Node Classification
topic Machine Learning
Artificial Intelligence
Symbolic Computation
url https://arxiv.org/abs/2405.14133