Saved in:
Bibliographic Details
Main Authors: Kareinen, Joona, Eerola, Tuomas, Kraft, Kaisa, Lensu, Lasse, Suikkanen, Sanna, Kälviäinen, Heikki
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2503.11341
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918014101749760
author Kareinen, Joona
Eerola, Tuomas
Kraft, Kaisa
Lensu, Lasse
Suikkanen, Sanna
Kälviäinen, Heikki
author_facet Kareinen, Joona
Eerola, Tuomas
Kraft, Kaisa
Lensu, Lasse
Suikkanen, Sanna
Kälviäinen, Heikki
contents Plankton recognition is an important computer vision problem due to plankton's essential role in ocean food webs and carbon capture, highlighting the need for species-level monitoring. However, this task is challenging due to its fine-grained nature and dataset shifts caused by different imaging instruments and varying species distributions. As new plankton image datasets are collected at an increasing pace, there is a need for general plankton recognition models that require minimal expert effort for data labeling. In this work, we study large-scale self-supervised pretraining for fine-grained plankton recognition. We first employ masked autoencoding and a large volume of diverse plankton image data to pretrain a general-purpose plankton image encoder. Then we utilize fine-tuning to obtain accurate plankton recognition models for new datasets with a very limited number of labeled training images. Our experiments show that self-supervised pretraining with diverse plankton data clearly increases plankton recognition accuracy compared to standard ImageNet pretraining when the amount of training data is limited. Moreover, the accuracy can be further improved when unlabeled target data is available and utilized during the pretraining.
format Preprint
id arxiv_https___arxiv_org_abs_2503_11341
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Self-Supervised Pretraining for Fine-Grained Plankton Recognition
Kareinen, Joona
Eerola, Tuomas
Kraft, Kaisa
Lensu, Lasse
Suikkanen, Sanna
Kälviäinen, Heikki
Computer Vision and Pattern Recognition
Plankton recognition is an important computer vision problem due to plankton's essential role in ocean food webs and carbon capture, highlighting the need for species-level monitoring. However, this task is challenging due to its fine-grained nature and dataset shifts caused by different imaging instruments and varying species distributions. As new plankton image datasets are collected at an increasing pace, there is a need for general plankton recognition models that require minimal expert effort for data labeling. In this work, we study large-scale self-supervised pretraining for fine-grained plankton recognition. We first employ masked autoencoding and a large volume of diverse plankton image data to pretrain a general-purpose plankton image encoder. Then we utilize fine-tuning to obtain accurate plankton recognition models for new datasets with a very limited number of labeled training images. Our experiments show that self-supervised pretraining with diverse plankton data clearly increases plankton recognition accuracy compared to standard ImageNet pretraining when the amount of training data is limited. Moreover, the accuracy can be further improved when unlabeled target data is available and utilized during the pretraining.
title Self-Supervised Pretraining for Fine-Grained Plankton Recognition
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.11341