Quantum-Trained Convolutional Neural Network for Deepfake Audio Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lin, Chu-Hsuan Abraham, Liu, Chen-Yu, Chen, Samuel Yen-Chi, Chen, Kuan-Cheng
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929538526609408
author Lin, Chu-Hsuan Abraham
Liu, Chen-Yu
Chen, Samuel Yen-Chi
Chen, Kuan-Cheng
author_facet Lin, Chu-Hsuan Abraham
Liu, Chen-Yu
Chen, Samuel Yen-Chi
Chen, Kuan-Cheng
contents The rise of deepfake technologies has posed significant challenges to privacy, security, and information integrity, particularly in audio and multimedia content. This paper introduces a Quantum-Trained Convolutional Neural Network (QT-CNN) framework designed to enhance the detection of deepfake audio, leveraging the computational power of quantum machine learning (QML). The QT-CNN employs a hybrid quantum-classical approach, integrating Quantum Neural Networks (QNNs) with classical neural architectures to optimize training efficiency while reducing the number of trainable parameters. Our method incorporates a novel quantum-to-classical parameter mapping that effectively utilizes quantum states to enhance the expressive power of the model, achieving up to 70% parameter reduction compared to classical models without compromising accuracy. Data pre-processing involved extracting essential audio features, label encoding, feature scaling, and constructing sequential datasets for robust model evaluation. Experimental results demonstrate that the QT-CNN achieves comparable performance to traditional CNNs, maintaining high accuracy during training and testing phases across varying configurations of QNN blocks. The QT framework's ability to reduce computational overhead while maintaining performance underscores its potential for real-world applications in deepfake detection and other resource-constrained scenarios. This work highlights the practical benefits of integrating quantum computing into artificial intelligence, offering a scalable and efficient approach to advancing deepfake detection technologies.
format Preprint
id arxiv_https___arxiv_org_abs_2410_09250
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Quantum-Trained Convolutional Neural Network for Deepfake Audio Detection
Lin, Chu-Hsuan Abraham
Liu, Chen-Yu
Chen, Samuel Yen-Chi
Chen, Kuan-Cheng
Sound
Artificial Intelligence
Audio and Speech Processing
Quantum Physics
The rise of deepfake technologies has posed significant challenges to privacy, security, and information integrity, particularly in audio and multimedia content. This paper introduces a Quantum-Trained Convolutional Neural Network (QT-CNN) framework designed to enhance the detection of deepfake audio, leveraging the computational power of quantum machine learning (QML). The QT-CNN employs a hybrid quantum-classical approach, integrating Quantum Neural Networks (QNNs) with classical neural architectures to optimize training efficiency while reducing the number of trainable parameters. Our method incorporates a novel quantum-to-classical parameter mapping that effectively utilizes quantum states to enhance the expressive power of the model, achieving up to 70% parameter reduction compared to classical models without compromising accuracy. Data pre-processing involved extracting essential audio features, label encoding, feature scaling, and constructing sequential datasets for robust model evaluation. Experimental results demonstrate that the QT-CNN achieves comparable performance to traditional CNNs, maintaining high accuracy during training and testing phases across varying configurations of QNN blocks. The QT framework's ability to reduce computational overhead while maintaining performance underscores its potential for real-world applications in deepfake detection and other resource-constrained scenarios. This work highlights the practical benefits of integrating quantum computing into artificial intelligence, offering a scalable and efficient approach to advancing deepfake detection technologies.
title Quantum-Trained Convolutional Neural Network for Deepfake Audio Detection
topic Sound
Artificial Intelligence
Audio and Speech Processing
Quantum Physics
url https://arxiv.org/abs/2410.09250