Toward Better Generalization in Few-Shot Learning through the Meta-Component Combination

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteur principal: Zeng, Qiuhao
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912710127517696
author Zeng, Qiuhao
author_facet Zeng, Qiuhao
contents In few-shot learning, classifiers are expected to generalize to unseen classes given only a small number of instances of each new class. One of the popular solutions to few-shot learning is metric-based meta-learning. However, it highly depends on the deep metric learned on seen classes, which may overfit to seen classes and fail to generalize well on unseen classes. To improve the generalization, we explore the substructures of classifiers and propose a novel meta-learning algorithm to learn each classifier as a combination of meta-components. Meta-components are learned across meta-learning episodes on seen classes and disentangled by imposing an orthogonal regularizer to promote its diversity and capture various shared substructures among different classifiers. Extensive experiments on few-shot benchmark tasks show superior performances of the proposed method.
format Preprint
id arxiv_https___arxiv_org_abs_2511_11632
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Toward Better Generalization in Few-Shot Learning through the Meta-Component Combination
Zeng, Qiuhao
Machine Learning
Artificial Intelligence
In few-shot learning, classifiers are expected to generalize to unseen classes given only a small number of instances of each new class. One of the popular solutions to few-shot learning is metric-based meta-learning. However, it highly depends on the deep metric learned on seen classes, which may overfit to seen classes and fail to generalize well on unseen classes. To improve the generalization, we explore the substructures of classifiers and propose a novel meta-learning algorithm to learn each classifier as a combination of meta-components. Meta-components are learned across meta-learning episodes on seen classes and disentangled by imposing an orthogonal regularizer to promote its diversity and capture various shared substructures among different classifiers. Extensive experiments on few-shot benchmark tasks show superior performances of the proposed method.
title Toward Better Generalization in Few-Shot Learning through the Meta-Component Combination
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2511.11632