From Audio Deepfake Detection to AI-Generated Music Detection -- A Pathway and Overview

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Yupei, Milling, Manuel, Specia, Lucia, Schuller, Björn W.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912150590586880
author Li, Yupei
Milling, Manuel
Specia, Lucia
Schuller, Björn W.
author_facet Li, Yupei
Milling, Manuel
Specia, Lucia
Schuller, Björn W.
contents As Artificial Intelligence (AI) technologies continue to evolve, their use in generating realistic, contextually appropriate content has expanded into various domains. Music, an art form and medium for entertainment, deeply rooted into human culture, is seeing an increased involvement of AI into its production. However, despite the effective application of AI music generation (AIGM) tools, the unregulated use of them raises concerns about potential negative impacts on the music industry, copyright and artistic integrity, underscoring the importance of effective AIGM detection. This paper provides an overview of existing AIGM detection methods. To lay a foundation to the general workings and challenges of AIGM detection, we first review general principles of AIGM, including recent advancements in deepfake audios, as well as multimodal detection techniques. We further propose a potential pathway for leveraging foundation models from audio deepfake detection to AIGM detection. Additionally, we discuss implications of these tools and propose directions for future research to address ongoing challenges in the field.
format Preprint
id arxiv_https___arxiv_org_abs_2412_00571
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle From Audio Deepfake Detection to AI-Generated Music Detection -- A Pathway and Overview
Li, Yupei
Milling, Manuel
Specia, Lucia
Schuller, Björn W.
Sound
Audio and Speech Processing
As Artificial Intelligence (AI) technologies continue to evolve, their use in generating realistic, contextually appropriate content has expanded into various domains. Music, an art form and medium for entertainment, deeply rooted into human culture, is seeing an increased involvement of AI into its production. However, despite the effective application of AI music generation (AIGM) tools, the unregulated use of them raises concerns about potential negative impacts on the music industry, copyright and artistic integrity, underscoring the importance of effective AIGM detection. This paper provides an overview of existing AIGM detection methods. To lay a foundation to the general workings and challenges of AIGM detection, we first review general principles of AIGM, including recent advancements in deepfake audios, as well as multimodal detection techniques. We further propose a potential pathway for leveraging foundation models from audio deepfake detection to AIGM detection. Additionally, we discuss implications of these tools and propose directions for future research to address ongoing challenges in the field.
title From Audio Deepfake Detection to AI-Generated Music Detection -- A Pathway and Overview
topic Sound
Audio and Speech Processing
url https://arxiv.org/abs/2412.00571