GLEAN: Active Generalized Category Discovery with Diverse LLM Feedback

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zou, Henry Peng, Singh, Siffi, Nian, Yi, He, Jianfeng, Cai, Jason, Mansour, Saab, Su, Hang
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866918483271352320
author Zou, Henry Peng
Singh, Siffi
Nian, Yi
He, Jianfeng
Cai, Jason
Mansour, Saab
Su, Hang
author_facet Zou, Henry Peng
Singh, Siffi
Nian, Yi
He, Jianfeng
Cai, Jason
Mansour, Saab
Su, Hang
contents Generalized Category Discovery (GCD) is a practical and challenging open-world task that aims to recognize both known and novel categories in unlabeled data using limited labeled data from known categories. Due to the lack of supervision, previous GCD methods face significant challenges, such as difficulty in rectifying errors for confusing instances, and inability to effectively uncover and leverage the semantic meanings of discovered clusters. Therefore, additional annotations are usually required for real-world applicability. However, human annotation is extremely costly and inefficient. To address these issues, we propose GLEAN, a unified framework for generalized category discovery that actively learns from diverse and collaborative LLM feedback. Our approach leverages three different types of LLM feedback to: (1) improve instance-level contrastive features, (2) generate category descriptions, and (3) align uncertain instances with LLM-selected category descriptions. Extensive experiments demonstrate the superior performance of GLEAN over state-of-the-art models across diverse datasets, metrics, and supervision settings. Our code is available at https://github.com/amazon-science/Glean.
format Preprint
id arxiv_https___arxiv_org_abs_2502_18414
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle GLEAN: Active Generalized Category Discovery with Diverse LLM Feedback
Zou, Henry Peng
Singh, Siffi
Nian, Yi
He, Jianfeng
Cai, Jason
Mansour, Saab
Su, Hang
Computation and Language
Machine Learning
Generalized Category Discovery (GCD) is a practical and challenging open-world task that aims to recognize both known and novel categories in unlabeled data using limited labeled data from known categories. Due to the lack of supervision, previous GCD methods face significant challenges, such as difficulty in rectifying errors for confusing instances, and inability to effectively uncover and leverage the semantic meanings of discovered clusters. Therefore, additional annotations are usually required for real-world applicability. However, human annotation is extremely costly and inefficient. To address these issues, we propose GLEAN, a unified framework for generalized category discovery that actively learns from diverse and collaborative LLM feedback. Our approach leverages three different types of LLM feedback to: (1) improve instance-level contrastive features, (2) generate category descriptions, and (3) align uncertain instances with LLM-selected category descriptions. Extensive experiments demonstrate the superior performance of GLEAN over state-of-the-art models across diverse datasets, metrics, and supervision settings. Our code is available at https://github.com/amazon-science/Glean.
title GLEAN: Active Generalized Category Discovery with Diverse LLM Feedback
topic Computation and Language
Machine Learning
url https://arxiv.org/abs/2502.18414