Amortized Variational Inference for Partial-Label Learning: A Probabilistic Approach to Label Disambiguation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fuchs, Tobias, Klein, Nadja
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911361777270784
author Fuchs, Tobias
Klein, Nadja
author_facet Fuchs, Tobias
Klein, Nadja
contents Real-world data is frequently noisy and ambiguous. In crowdsourcing, for example, human annotators may assign conflicting class labels to the same instances. Partial-label learning (PLL) addresses this challenge by training classifiers when each instance is associated with a set of candidate labels, only one of which is correct. While early PLL methods approximate the true label posterior, they are often computationally intensive. Recent deep learning approaches improve scalability but rely on surrogate losses and heuristic label refinement. We introduce a novel probabilistic framework that directly approximates the posterior distribution over true labels using amortized variational inference. Our method employs neural networks to predict variational parameters from input data, enabling efficient inference. This approach combines the expressiveness of deep learning with the rigor of probabilistic modeling, while remaining architecture-agnostic. Theoretical analysis and extensive experiments on synthetic and real-world datasets demonstrate that our method achieves state-of-the-art performance in both accuracy and efficiency.
format Preprint
id arxiv_https___arxiv_org_abs_2510_21300
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Amortized Variational Inference for Partial-Label Learning: A Probabilistic Approach to Label Disambiguation
Fuchs, Tobias
Klein, Nadja
Machine Learning
Real-world data is frequently noisy and ambiguous. In crowdsourcing, for example, human annotators may assign conflicting class labels to the same instances. Partial-label learning (PLL) addresses this challenge by training classifiers when each instance is associated with a set of candidate labels, only one of which is correct. While early PLL methods approximate the true label posterior, they are often computationally intensive. Recent deep learning approaches improve scalability but rely on surrogate losses and heuristic label refinement. We introduce a novel probabilistic framework that directly approximates the posterior distribution over true labels using amortized variational inference. Our method employs neural networks to predict variational parameters from input data, enabling efficient inference. This approach combines the expressiveness of deep learning with the rigor of probabilistic modeling, while remaining architecture-agnostic. Theoretical analysis and extensive experiments on synthetic and real-world datasets demonstrate that our method achieves state-of-the-art performance in both accuracy and efficiency.
title Amortized Variational Inference for Partial-Label Learning: A Probabilistic Approach to Label Disambiguation
topic Machine Learning
url https://arxiv.org/abs/2510.21300