Improving Audio Event Recognition with Consistency Regularization

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Sadhu, Shanmuka, Wang, Weiran
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916947582517248
author Sadhu, Shanmuka
Wang, Weiran
author_facet Sadhu, Shanmuka
Wang, Weiran
contents Consistency regularization (CR), which enforces agreement between model predictions on augmented views, has found recent benefits in automatic speech recognition [1]. In this paper, we propose the use of consistency regularization for audio event recognition, and demonstrate its effectiveness on AudioSet. With extensive ablation studies for both small ($\sim$20k) and large ($\sim$1.8M) supervised training sets, we show that CR brings consistent improvement over supervised baselines which already heavily utilize data augmentation, and CR using stronger augmentation and multiple augmentations leads to additional gain for the small training set. Furthermore, we extend the use of CR into the semi-supervised setup with 20K labeled samples and 1.8M unlabeled samples, and obtain performance improvement over our best model trained on the small set.
format Preprint
id arxiv_https___arxiv_org_abs_2509_10391
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Improving Audio Event Recognition with Consistency Regularization
Sadhu, Shanmuka
Wang, Weiran
Sound
Artificial Intelligence
Consistency regularization (CR), which enforces agreement between model predictions on augmented views, has found recent benefits in automatic speech recognition [1]. In this paper, we propose the use of consistency regularization for audio event recognition, and demonstrate its effectiveness on AudioSet. With extensive ablation studies for both small ($\sim$20k) and large ($\sim$1.8M) supervised training sets, we show that CR brings consistent improvement over supervised baselines which already heavily utilize data augmentation, and CR using stronger augmentation and multiple augmentations leads to additional gain for the small training set. Furthermore, we extend the use of CR into the semi-supervised setup with 20K labeled samples and 1.8M unlabeled samples, and obtain performance improvement over our best model trained on the small set.
title Improving Audio Event Recognition with Consistency Regularization
topic Sound
Artificial Intelligence
url https://arxiv.org/abs/2509.10391