Saved in:
Bibliographic Details
Main Authors: Ye, Yuting, Ho, Christine, Jiang, Ci-Ren, Lee, Wayne Tai, Huang, Haiyan
Format: Preprint
Published: 2022
Subjects:
Online Access:https://arxiv.org/abs/2205.07833
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912681323134976
author Ye, Yuting
Ho, Christine
Jiang, Ci-Ren
Lee, Wayne Tai
Huang, Haiyan
author_facet Ye, Yuting
Ho, Christine
Jiang, Ci-Ren
Lee, Wayne Tai
Huang, Haiyan
contents Hierarchical multi-label classification (HMC) has gained considerable attention in recent decades. A seminal line of HMC research addresses the problem in two stages: first, training individual classifiers for each class, then integrating these classifiers to provide a unified set of classification results across classes while respecting the given hierarchy. In this article, we focus on the less attended second-stage question while adhering to the given class hierarchy. This involves addressing a key challenge: how to manage the hierarchical constraint and account for statistical differences in the first-stage classifier scores across different classes to make classification decisions that are optimal under a justifiable criterion. To address this challenge, we introduce a new objective function, called CATCH, to ensure reasonable classification performance. To optimize this function, we propose a decision strategy built on a novel metric, the multidimensional Local Precision Rate (mLPR), which reflects the membership chance of an object in a class given all classifier scores and the class hierarchy. Particularly, we demonstrate that, under certain conditions, transforming the classifier scores into mLPRs and comparing mLPR values for all objects against all classes can, in theory, ensure the class hierarchy and maximize CATCH. In practice, we propose an algorithm HierRank to rank estimated mLPRs under the hierarchical constraint, leading to a ranking that maximizes an empirical version of CATCH. Our approach was evaluated on a synthetic dataset and two real datasets, exhibiting superior performance compared to several state-of-the-art methods in terms of improved decision accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2205_07833
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Ranking hierarchical multi-label classification results with mLPRs
Ye, Yuting
Ho, Christine
Jiang, Ci-Ren
Lee, Wayne Tai
Huang, Haiyan
Machine Learning
Hierarchical multi-label classification (HMC) has gained considerable attention in recent decades. A seminal line of HMC research addresses the problem in two stages: first, training individual classifiers for each class, then integrating these classifiers to provide a unified set of classification results across classes while respecting the given hierarchy. In this article, we focus on the less attended second-stage question while adhering to the given class hierarchy. This involves addressing a key challenge: how to manage the hierarchical constraint and account for statistical differences in the first-stage classifier scores across different classes to make classification decisions that are optimal under a justifiable criterion. To address this challenge, we introduce a new objective function, called CATCH, to ensure reasonable classification performance. To optimize this function, we propose a decision strategy built on a novel metric, the multidimensional Local Precision Rate (mLPR), which reflects the membership chance of an object in a class given all classifier scores and the class hierarchy. Particularly, we demonstrate that, under certain conditions, transforming the classifier scores into mLPRs and comparing mLPR values for all objects against all classes can, in theory, ensure the class hierarchy and maximize CATCH. In practice, we propose an algorithm HierRank to rank estimated mLPRs under the hierarchical constraint, leading to a ranking that maximizes an empirical version of CATCH. Our approach was evaluated on a synthetic dataset and two real datasets, exhibiting superior performance compared to several state-of-the-art methods in terms of improved decision accuracy.
title Ranking hierarchical multi-label classification results with mLPRs
topic Machine Learning
url https://arxiv.org/abs/2205.07833