Advancing Sentiment Analysis: A Novel LSTM Framework with Multi-head Attention
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909533765369856 |
|---|---|
| author | Yi, Jingyuan Yu, Peiyang Huang, Tianyi Xu, Xiaochuan |
| author_facet | Yi, Jingyuan Yu, Peiyang Huang, Tianyi Xu, Xiaochuan |
| contents | This work proposes an LSTM-based sentiment classification model with multi-head attention mechanism and TF-IDF optimization. Through the integration of TF-IDF feature extraction and multi-head attention, the model significantly improves text sentiment analysis performance. Experimental results on public data sets demonstrate that the new method achieves substantial improvements in the most critical metrics like accuracy, recall, and F1-score compared to baseline models. Specifically, the model achieves an accuracy of 80.28% on the test set, which is improved by about 12% in comparison with standard LSTM models. Ablation experiments also support the necessity and necessity of all modules, in which the impact of multi-head attention is greatest to performance improvement. This research provides a proper approach to sentiment analysis, which can be utilized in public opinion monitoring, product recommendation, etc. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_08079 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Advancing Sentiment Analysis: A Novel LSTM Framework with Multi-head Attention Yi, Jingyuan Yu, Peiyang Huang, Tianyi Xu, Xiaochuan Computation and Language This work proposes an LSTM-based sentiment classification model with multi-head attention mechanism and TF-IDF optimization. Through the integration of TF-IDF feature extraction and multi-head attention, the model significantly improves text sentiment analysis performance. Experimental results on public data sets demonstrate that the new method achieves substantial improvements in the most critical metrics like accuracy, recall, and F1-score compared to baseline models. Specifically, the model achieves an accuracy of 80.28% on the test set, which is improved by about 12% in comparison with standard LSTM models. Ablation experiments also support the necessity and necessity of all modules, in which the impact of multi-head attention is greatest to performance improvement. This research provides a proper approach to sentiment analysis, which can be utilized in public opinion monitoring, product recommendation, etc. |
| title | Advancing Sentiment Analysis: A Novel LSTM Framework with Multi-head Attention |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2503.08079 |