The Coralscapes Dataset: Semantic Scene Understanding in Coral Reefs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sauder, Jonathan, Domazetoski, Viktor, Banc-Prandi, Guilhem, Perna, Gabriela, Meibom, Anders, Tuia, Devis
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908627536707584
author Sauder, Jonathan
Domazetoski, Viktor
Banc-Prandi, Guilhem
Perna, Gabriela
Meibom, Anders
Tuia, Devis
author_facet Sauder, Jonathan
Domazetoski, Viktor
Banc-Prandi, Guilhem
Perna, Gabriela
Meibom, Anders
Tuia, Devis
contents Coral reefs are declining worldwide due to climate change and local stressors. To inform effective conservation or restoration, monitoring at the highest possible spatial and temporal resolution is necessary. Conventional coral reef surveying methods are limited in scalability due to their reliance on expert labor time, motivating the use of computer vision tools to automate the identification and abundance estimation of live corals from images. However, the design and evaluation of such tools has been impeded by the lack of large high quality datasets. We release the Coralscapes dataset, the first general-purpose dense semantic segmentation dataset for coral reefs, covering 2075 images, 39 benthic classes, and 174k segmentation masks annotated by experts. Coralscapes has a similar scope and the same structure as the widely used Cityscapes dataset for urban scene segmentation, allowing benchmarking of semantic segmentation models in a new challenging domain which requires expert knowledge to annotate. We benchmark a wide range of semantic segmentation models, and find that transfer learning from Coralscapes to existing smaller datasets consistently leads to state-of-the-art performance. Coralscapes will catalyze research on efficient, scalable, and standardized coral reef surveying methods based on computer vision, and holds the potential to streamline the development of underwater ecological robotics.
format Preprint
id arxiv_https___arxiv_org_abs_2503_20000
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle The Coralscapes Dataset: Semantic Scene Understanding in Coral Reefs
Sauder, Jonathan
Domazetoski, Viktor
Banc-Prandi, Guilhem
Perna, Gabriela
Meibom, Anders
Tuia, Devis
Computer Vision and Pattern Recognition
Machine Learning
Coral reefs are declining worldwide due to climate change and local stressors. To inform effective conservation or restoration, monitoring at the highest possible spatial and temporal resolution is necessary. Conventional coral reef surveying methods are limited in scalability due to their reliance on expert labor time, motivating the use of computer vision tools to automate the identification and abundance estimation of live corals from images. However, the design and evaluation of such tools has been impeded by the lack of large high quality datasets. We release the Coralscapes dataset, the first general-purpose dense semantic segmentation dataset for coral reefs, covering 2075 images, 39 benthic classes, and 174k segmentation masks annotated by experts. Coralscapes has a similar scope and the same structure as the widely used Cityscapes dataset for urban scene segmentation, allowing benchmarking of semantic segmentation models in a new challenging domain which requires expert knowledge to annotate. We benchmark a wide range of semantic segmentation models, and find that transfer learning from Coralscapes to existing smaller datasets consistently leads to state-of-the-art performance. Coralscapes will catalyze research on efficient, scalable, and standardized coral reef surveying methods based on computer vision, and holds the potential to streamline the development of underwater ecological robotics.
title The Coralscapes Dataset: Semantic Scene Understanding in Coral Reefs
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2503.20000