Saved in:
Bibliographic Details
Main Authors: Plaud, Roman, Perez-Lebel, Alexandre, Labeau, Matthieu, Saillenfest, Antoine, Bonald, Thomas
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2506.01552
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916772766023680
author Plaud, Roman
Perez-Lebel, Alexandre
Labeau, Matthieu
Saillenfest, Antoine
Bonald, Thomas
author_facet Plaud, Roman
Perez-Lebel, Alexandre
Labeau, Matthieu
Saillenfest, Antoine
Bonald, Thomas
contents Hierarchical classification offers an approach to incorporate the concept of mistake severity by leveraging a structured, labeled hierarchy. However, decoding in such settings frequently relies on heuristic decision rules, which may not align with task-specific evaluation metrics. In this work, we propose a framework for the optimal decoding of an output probability distribution with respect to a target metric. We derive optimal decision rules for increasingly complex prediction settings, providing universal algorithms when candidates are limited to the set of nodes. In the most general case of predicting a subset of nodes, we focus on rules dedicated to the hierarchical $hF_β$ scores, tailored to hierarchical settings. To demonstrate the practical utility of our approach, we conduct extensive empirical evaluations, showcasing the superiority of our proposed optimal strategies, particularly in underdetermined scenarios. These results highlight the potential of our methods to enhance the performance and reliability of hierarchical classifiers in real-world applications. The code is available at https://github.com/RomanPlaud/hierarchical_decision_rules
format Preprint
id arxiv_https___arxiv_org_abs_2506_01552
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle To Each Metric Its Decoding: Post-Hoc Optimal Decision Rules of Probabilistic Hierarchical Classifiers
Plaud, Roman
Perez-Lebel, Alexandre
Labeau, Matthieu
Saillenfest, Antoine
Bonald, Thomas
Machine Learning
Hierarchical classification offers an approach to incorporate the concept of mistake severity by leveraging a structured, labeled hierarchy. However, decoding in such settings frequently relies on heuristic decision rules, which may not align with task-specific evaluation metrics. In this work, we propose a framework for the optimal decoding of an output probability distribution with respect to a target metric. We derive optimal decision rules for increasingly complex prediction settings, providing universal algorithms when candidates are limited to the set of nodes. In the most general case of predicting a subset of nodes, we focus on rules dedicated to the hierarchical $hF_β$ scores, tailored to hierarchical settings. To demonstrate the practical utility of our approach, we conduct extensive empirical evaluations, showcasing the superiority of our proposed optimal strategies, particularly in underdetermined scenarios. These results highlight the potential of our methods to enhance the performance and reliability of hierarchical classifiers in real-world applications. The code is available at https://github.com/RomanPlaud/hierarchical_decision_rules
title To Each Metric Its Decoding: Post-Hoc Optimal Decision Rules of Probabilistic Hierarchical Classifiers
topic Machine Learning
url https://arxiv.org/abs/2506.01552