EnvId: A Metric Learning Approach for Forensic Few-Shot Identification of Unseen Environments

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Moussa, Denise, Hirsch, Germans, Riess, Christian
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912229504319488
author Moussa, Denise
Hirsch, Germans
Riess, Christian
author_facet Moussa, Denise
Hirsch, Germans
Riess, Christian
contents Audio recordings may provide important evidence in criminal investigations. One such case is the forensic association of a recorded audio to its recording location. For example, a voice message may be the only investigative cue to narrow down the candidate sites for a crime. Up to now, several works provide supervised classification tools for closed-set recording environment identification under relatively clean recording conditions. However, in forensic investigations, the candidate locations are case-specific. Thus, supervised learning techniques are not applicable without retraining a classifier on a sufficient amount of training samples for each case and respective candidate set. In addition, a forensic tool has to deal with audio material from uncontrolled sources with variable properties and quality. In this work, we therefore attempt a major step towards practical forensic application scenarios. We propose a representation learning framework called EnvId, short for environment identification. EnvId avoids case-specific retraining by modeling the task as a few-shot classification problem. We demonstrate that EnvId can handle forensically challenging material. It provides good quality predictions even under unseen signal degradations, out-of-distribution reverberation characteristics or recording position mismatches.
format Preprint
id arxiv_https___arxiv_org_abs_2405_02119
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle EnvId: A Metric Learning Approach for Forensic Few-Shot Identification of Unseen Environments
Moussa, Denise
Hirsch, Germans
Riess, Christian
Sound
Machine Learning
Audio and Speech Processing
Audio recordings may provide important evidence in criminal investigations. One such case is the forensic association of a recorded audio to its recording location. For example, a voice message may be the only investigative cue to narrow down the candidate sites for a crime. Up to now, several works provide supervised classification tools for closed-set recording environment identification under relatively clean recording conditions. However, in forensic investigations, the candidate locations are case-specific. Thus, supervised learning techniques are not applicable without retraining a classifier on a sufficient amount of training samples for each case and respective candidate set. In addition, a forensic tool has to deal with audio material from uncontrolled sources with variable properties and quality. In this work, we therefore attempt a major step towards practical forensic application scenarios. We propose a representation learning framework called EnvId, short for environment identification. EnvId avoids case-specific retraining by modeling the task as a few-shot classification problem. We demonstrate that EnvId can handle forensically challenging material. It provides good quality predictions even under unseen signal degradations, out-of-distribution reverberation characteristics or recording position mismatches.
title EnvId: A Metric Learning Approach for Forensic Few-Shot Identification of Unseen Environments
topic Sound
Machine Learning
Audio and Speech Processing
url https://arxiv.org/abs/2405.02119