Transfer Learning-Based Deep Residual Learning for Speech Recognition in Clean and Noisy Environments

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Djeffal, Noussaiba, Addou, Djamel, Kheddar, Hamza, Selouani, Sid Ahmed
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915271311097856
author Djeffal, Noussaiba
Addou, Djamel
Kheddar, Hamza
Selouani, Sid Ahmed
author_facet Djeffal, Noussaiba
Addou, Djamel
Kheddar, Hamza
Selouani, Sid Ahmed
contents Addressing the detrimental impact of non-stationary environmental noise on automatic speech recognition (ASR) has been a persistent and significant research focus. Despite advancements, this challenge continues to be a major concern. Recently, data-driven supervised approaches, such as deep neural networks, have emerged as promising alternatives to traditional unsupervised methods. With extensive training, these approaches have the potential to overcome the challenges posed by diverse real-life acoustic environments. In this light, this paper introduces a novel neural framework that incorporates a robust frontend into ASR systems in both clean and noisy environments. Utilizing the Aurora-2 speech database, the authors evaluate the effectiveness of an acoustic feature set for Mel-frequency, employing the approach of transfer learning based on Residual neural network (ResNet). The experimental results demonstrate a significant improvement in recognition accuracy compared to convolutional neural networks (CNN) and long short-term memory (LSTM) networks. They achieved accuracies of 98.94% in clean and 91.21% in noisy mode.
format Preprint
id arxiv_https___arxiv_org_abs_2505_01632
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Transfer Learning-Based Deep Residual Learning for Speech Recognition in Clean and Noisy Environments
Djeffal, Noussaiba
Addou, Djamel
Kheddar, Hamza
Selouani, Sid Ahmed
Audio and Speech Processing
Artificial Intelligence
Sound
Addressing the detrimental impact of non-stationary environmental noise on automatic speech recognition (ASR) has been a persistent and significant research focus. Despite advancements, this challenge continues to be a major concern. Recently, data-driven supervised approaches, such as deep neural networks, have emerged as promising alternatives to traditional unsupervised methods. With extensive training, these approaches have the potential to overcome the challenges posed by diverse real-life acoustic environments. In this light, this paper introduces a novel neural framework that incorporates a robust frontend into ASR systems in both clean and noisy environments. Utilizing the Aurora-2 speech database, the authors evaluate the effectiveness of an acoustic feature set for Mel-frequency, employing the approach of transfer learning based on Residual neural network (ResNet). The experimental results demonstrate a significant improvement in recognition accuracy compared to convolutional neural networks (CNN) and long short-term memory (LSTM) networks. They achieved accuracies of 98.94% in clean and 91.21% in noisy mode.
title Transfer Learning-Based Deep Residual Learning for Speech Recognition in Clean and Noisy Environments
topic Audio and Speech Processing
Artificial Intelligence
Sound
url https://arxiv.org/abs/2505.01632