Saved in:
Bibliographic Details
Main Authors: Ding, Sivan, Wilkins, Julia, Fuentes, Magdalena, Bello, Juan Pablo
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.02500
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Self-supervised learning (SSL) approaches, such as contrastive and generative methods, have advanced environmental sound representation learning using unlabeled data. However, how these approaches can complement each other within a unified framework remains relatively underexplored. In this work, we propose a multi-view learning framework that integrates contrastive principles into a generative pipeline to capture sound source and device information. Our method encodes compressed audio latents into view-specific and view-common subspaces, guided by two self-supervised objectives: contrastive learning for targeted information flow between subspaces, and reconstruction for overall information preservation. We evaluate our method on an urban sound sensor network dataset for sound source and sensor classification, demonstrating improved downstream performance over traditional SSL techniques. Additionally, we investigate the model's potential to disentangle environmental sound attributes within the structured latent space under varied training configurations.