_version_ 1868266211752542208
author Williams, Ben
Balvanera, Santiago M
Sethi, Sarab S
Lamont, Timothy A C
Jompa, Jamaluddin
Prasetya, Mochyudho
Richardson, Laura
Chapuis, Lucille
Weschke, Emma
Hoey, Andrew
Beldade, Ricardo
Mills, Suzanne C
Haguenauer, Anne
Zuberer, Frederic
Simpson, Stephen D
Curnick, David
Jones, Kate E
author_facet Williams, Ben
Balvanera, Santiago M
Sethi, Sarab S
Lamont, Timothy A C
Jompa, Jamaluddin
Prasetya, Mochyudho
Richardson, Laura
Chapuis, Lucille
Weschke, Emma
Hoey, Andrew
Beldade, Ricardo
Mills, Suzanne C
Haguenauer, Anne
Zuberer, Frederic
Simpson, Stephen D
Curnick, David
Jones, Kate E
Williams, Ben
Balvanera, Santiago M
Sethi, Sarab S
Lamont, Timothy A C
Jompa, Jamaluddin
Prasetya, Mochyudho
Richardson, Laura
Chapuis, Lucille
Weschke, Emma
Hoey, Andrew
Beldade, Ricardo
Mills, Suzanne C
Haguenauer, Anne
Zuberer, Frederic
Simpson, Stephen D
Curnick, David
Jones, Kate E
collection PubMed - marine biology
contents Unlocking the soundscape of coral reefs with artificial intelligence: pretrained networks and unsupervised learning win out. Williams, Ben Balvanera, Santiago M Sethi, Sarab S Lamont, Timothy A C Jompa, Jamaluddin Prasetya, Mochyudho Richardson, Laura Chapuis, Lucille Weschke, Emma Hoey, Andrew Beldade, Ricardo Mills, Suzanne C Haguenauer, Anne Zuberer, Frederic Simpson, Stephen D Curnick, David Jones, Kate E Coral Reefs Animals Acoustics Unsupervised Machine Learning Artificial Intelligence Ecosystem Algorithms Neural Networks, Computer Computational Biology Fishes Machine Learning Environmental Monitoring Passive acoustic monitoring can offer insights into the state of coral reef ecosystems at low-costs and over extended temporal periods. Comparison of whole soundscape properties can rapidly deliver broad insights from acoustic data, in contrast to detailed but time-consuming analysis of individual bioacoustic events. However, a lack of effective automated analysis for whole soundscape data has impeded progress in this field. Here, we show that machine learning (ML) can be used to unlock greater insights from reef soundscapes. We showcase this on a diverse set of tasks using three biogeographically independent datasets, each containing fish community (high or low), coral cover (high or low) or depth zone (shallow or mesophotic) classes. We show supervised learning can be used to train models that can identify ecological classes and individual sites from whole soundscapes. However, we report unsupervised clustering achieves this whilst providing a more detailed understanding of ecological and site groupings within soundscape data. We also compare three different approaches for extracting feature embeddings from soundscape recordings for input into ML algorithms: acoustic indices commonly used by soundscape ecologists, a pretrained convolutional neural network (P-CNN) trained on 5.2 million hrs of YouTube audio, and CNN's which were trained on each individual task (T-CNN). Although the T-CNN performs marginally better across tasks, we reveal that the P-CNN offers a powerful tool for generating insights from marine soundscape data as it requires orders of magnitude less computational resources whilst achieving near comparable performance to the T-CNN, with significant performance improvements over the acoustic indices. Our findings have implications for soundscape ecology in any habitat.
format Artículo científico
id pubmed_40294093
institution PubMed
language en
publishDate 2025
publisher PLoS computational biology
record_format pubmed
spellingShingle Unlocking the soundscape of coral reefs with artificial intelligence: pretrained networks and unsupervised learning win out.
Williams, Ben
Balvanera, Santiago M
Sethi, Sarab S
Lamont, Timothy A C
Jompa, Jamaluddin
Prasetya, Mochyudho
Richardson, Laura
Chapuis, Lucille
Weschke, Emma
Hoey, Andrew
Beldade, Ricardo
Mills, Suzanne C
Haguenauer, Anne
Zuberer, Frederic
Simpson, Stephen D
Curnick, David
Jones, Kate E
Coral Reefs
Animals
Acoustics
Unsupervised Machine Learning
Artificial Intelligence
Ecosystem
Algorithms
Neural Networks, Computer
Computational Biology
Fishes
Machine Learning
Environmental Monitoring
Unlocking the soundscape of coral reefs with artificial intelligence: pretrained networks and unsupervised learning win out. Williams, Ben Balvanera, Santiago M Sethi, Sarab S Lamont, Timothy A C Jompa, Jamaluddin Prasetya, Mochyudho Richardson, Laura Chapuis, Lucille Weschke, Emma Hoey, Andrew Beldade, Ricardo Mills, Suzanne C Haguenauer, Anne Zuberer, Frederic Simpson, Stephen D Curnick, David Jones, Kate E Coral Reefs Animals Acoustics Unsupervised Machine Learning Artificial Intelligence Ecosystem Algorithms Neural Networks, Computer Computational Biology Fishes Machine Learning Environmental Monitoring Passive acoustic monitoring can offer insights into the state of coral reef ecosystems at low-costs and over extended temporal periods. Comparison of whole soundscape properties can rapidly deliver broad insights from acoustic data, in contrast to detailed but time-consuming analysis of individual bioacoustic events. However, a lack of effective automated analysis for whole soundscape data has impeded progress in this field. Here, we show that machine learning (ML) can be used to unlock greater insights from reef soundscapes. We showcase this on a diverse set of tasks using three biogeographically independent datasets, each containing fish community (high or low), coral cover (high or low) or depth zone (shallow or mesophotic) classes. We show supervised learning can be used to train models that can identify ecological classes and individual sites from whole soundscapes. However, we report unsupervised clustering achieves this whilst providing a more detailed understanding of ecological and site groupings within soundscape data. We also compare three different approaches for extracting feature embeddings from soundscape recordings for input into ML algorithms: acoustic indices commonly used by soundscape ecologists, a pretrained convolutional neural network (P-CNN) trained on 5.2 million hrs of YouTube audio, and CNN's which were trained on each individual task (T-CNN). Although the T-CNN performs marginally better across tasks, we reveal that the P-CNN offers a powerful tool for generating insights from marine soundscape data as it requires orders of magnitude less computational resources whilst achieving near comparable performance to the T-CNN, with significant performance improvements over the acoustic indices. Our findings have implications for soundscape ecology in any habitat.
title Unlocking the soundscape of coral reefs with artificial intelligence: pretrained networks and unsupervised learning win out.
topic Coral Reefs
Animals
Acoustics
Unsupervised Machine Learning
Artificial Intelligence
Ecosystem
Algorithms
Neural Networks, Computer
Computational Biology
Fishes
Machine Learning
Environmental Monitoring
url https://pubmed.ncbi.nlm.nih.gov/40294093/