Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2405.01507 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913343940329472 |
|---|---|
| author | Ke, Tianjun Cao, Haoqun Zhou, Feng |
| author_facet | Ke, Tianjun Cao, Haoqun Zhou, Feng |
| contents | Bayesian few-shot classification has been a focal point in the field of few-shot learning. This paper seamlessly integrates mirror descent-based variational inference into Gaussian process-based few-shot classification, addressing the challenge of non-conjugate inference. By leveraging non-Euclidean geometry, mirror descent achieves accelerated convergence by providing the steepest descent direction along the corresponding manifold. It also exhibits the parameterization invariance property concerning the variational distribution. Experimental results demonstrate competitive classification accuracy, improved uncertainty quantification, and faster convergence compared to baseline models. Additionally, we investigate the impact of hyperparameters and components. Code is publicly available at https://github.com/keanson/MD-BSFC. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_01507 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Accelerating Convergence in Bayesian Few-Shot Classification Ke, Tianjun Cao, Haoqun Zhou, Feng Machine Learning Bayesian few-shot classification has been a focal point in the field of few-shot learning. This paper seamlessly integrates mirror descent-based variational inference into Gaussian process-based few-shot classification, addressing the challenge of non-conjugate inference. By leveraging non-Euclidean geometry, mirror descent achieves accelerated convergence by providing the steepest descent direction along the corresponding manifold. It also exhibits the parameterization invariance property concerning the variational distribution. Experimental results demonstrate competitive classification accuracy, improved uncertainty quantification, and faster convergence compared to baseline models. Additionally, we investigate the impact of hyperparameters and components. Code is publicly available at https://github.com/keanson/MD-BSFC. |
| title | Accelerating Convergence in Bayesian Few-Shot Classification |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2405.01507 |