A Comparative Analysis of Classical Machine Learning and Deep Learning Approaches for Sentiment Classification on IMDb Movie Reviews

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Safitri, Erma Daniar, Ichisasmita, Lia Hana, Agustin, Citra, Muthoharoh, Luluk, Satria, Ardika, Manullang, Martin Clinton Tosima
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910201625444352
author Safitri, Erma Daniar
Ichisasmita, Lia Hana
Agustin, Citra
Muthoharoh, Luluk
Satria, Ardika
Manullang, Martin Clinton Tosima
author_facet Safitri, Erma Daniar
Ichisasmita, Lia Hana
Agustin, Citra
Muthoharoh, Luluk
Satria, Ardika
Manullang, Martin Clinton Tosima
contents This paper presents a comparative study of classical machine learning and deep learning methods for sentiment classification on the IMDb movie reviews dataset. The machine learning pipeline uses TF-IDF features and PyCaret AutoML to evaluate Logistic Regression, Naïve Bayes, and Support Vector Machine, while the deep learning pipeline implements BiLSTM and BiLSTM with an attention mechanism. Experimental results show that classical machine learning, especially SVM, achieves the best performance with an accuracy of 0.8530, outperforming the deep learning models in this study. The BiLSTM with Attention model improves over the standard BiLSTM and reaches an accuracy of 0.706, indicating better contextual modeling. The paper concludes that although deep learning can capture sequential dependencies, classical machine learning remains a strong baseline when combined with effective feature engineering such as TF-IDF, particularly under limited data and computational resources.
format Preprint
id arxiv_https___arxiv_org_abs_2605_07811
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Comparative Analysis of Classical Machine Learning and Deep Learning Approaches for Sentiment Classification on IMDb Movie Reviews
Safitri, Erma Daniar
Ichisasmita, Lia Hana
Agustin, Citra
Muthoharoh, Luluk
Satria, Ardika
Manullang, Martin Clinton Tosima
Computation and Language
This paper presents a comparative study of classical machine learning and deep learning methods for sentiment classification on the IMDb movie reviews dataset. The machine learning pipeline uses TF-IDF features and PyCaret AutoML to evaluate Logistic Regression, Naïve Bayes, and Support Vector Machine, while the deep learning pipeline implements BiLSTM and BiLSTM with an attention mechanism. Experimental results show that classical machine learning, especially SVM, achieves the best performance with an accuracy of 0.8530, outperforming the deep learning models in this study. The BiLSTM with Attention model improves over the standard BiLSTM and reaches an accuracy of 0.706, indicating better contextual modeling. The paper concludes that although deep learning can capture sequential dependencies, classical machine learning remains a strong baseline when combined with effective feature engineering such as TF-IDF, particularly under limited data and computational resources.
title A Comparative Analysis of Classical Machine Learning and Deep Learning Approaches for Sentiment Classification on IMDb Movie Reviews
topic Computation and Language
url https://arxiv.org/abs/2605.07811