Saved in:
Bibliographic Details
Main Authors: Jia, Jianguo, Liang, Wen, Liang, Youzhi
Format: Preprint
Published: 2023
Subjects:
Online Access:https://arxiv.org/abs/2312.05589
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908009001648128
author Jia, Jianguo
Liang, Wen
Liang, Youzhi
author_facet Jia, Jianguo
Liang, Wen
Liang, Youzhi
contents This review presents a comprehensive exploration of hybrid and ensemble deep learning models within Natural Language Processing (NLP), shedding light on their transformative potential across diverse tasks such as Sentiment Analysis, Named Entity Recognition, Machine Translation, Question Answering, Text Classification, Generation, Speech Recognition, Summarization, and Language Modeling. The paper systematically introduces each task, delineates key architectures from Recurrent Neural Networks (RNNs) to Transformer-based models like BERT, and evaluates their performance, challenges, and computational demands. The adaptability of ensemble techniques is emphasized, highlighting their capacity to enhance various NLP applications. Challenges in implementation, including computational overhead, overfitting, and model interpretation complexities, are addressed alongside the trade-off between interpretability and performance. Serving as a concise yet invaluable guide, this review synthesizes insights into tasks, architectures, and challenges, offering a holistic perspective for researchers and practitioners aiming to advance language-driven applications through ensemble deep learning in NLP.
format Preprint
id arxiv_https___arxiv_org_abs_2312_05589
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle A Review of Hybrid and Ensemble in Deep Learning for Natural Language Processing
Jia, Jianguo
Liang, Wen
Liang, Youzhi
Artificial Intelligence
This review presents a comprehensive exploration of hybrid and ensemble deep learning models within Natural Language Processing (NLP), shedding light on their transformative potential across diverse tasks such as Sentiment Analysis, Named Entity Recognition, Machine Translation, Question Answering, Text Classification, Generation, Speech Recognition, Summarization, and Language Modeling. The paper systematically introduces each task, delineates key architectures from Recurrent Neural Networks (RNNs) to Transformer-based models like BERT, and evaluates their performance, challenges, and computational demands. The adaptability of ensemble techniques is emphasized, highlighting their capacity to enhance various NLP applications. Challenges in implementation, including computational overhead, overfitting, and model interpretation complexities, are addressed alongside the trade-off between interpretability and performance. Serving as a concise yet invaluable guide, this review synthesizes insights into tasks, architectures, and challenges, offering a holistic perspective for researchers and practitioners aiming to advance language-driven applications through ensemble deep learning in NLP.
title A Review of Hybrid and Ensemble in Deep Learning for Natural Language Processing
topic Artificial Intelligence
url https://arxiv.org/abs/2312.05589