Predicting stock prices with ChatGPT-annotated Reddit sentiment

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kmak, Mateusz, Chmurzyński, Kamil, Matejuk, Kamil, Kotzbach, Paweł, Kocoń, Jan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916872137474048
author Kmak, Mateusz
Chmurzyński, Kamil
Matejuk, Kamil
Kotzbach, Paweł
Kocoń, Jan
author_facet Kmak, Mateusz
Chmurzyński, Kamil
Matejuk, Kamil
Kotzbach, Paweł
Kocoń, Jan
contents The surge of retail investor activity on social media, exemplified by the 2021 GameStop short squeeze, raised questions about the influence of online sentiment on stock prices. This paper explores whether sentiment derived from social media discussions can meaningfully predict stock market movements. We focus on Reddit's r/wallstreetbets and analyze sentiment related to two companies: GameStop (GME) and AMC Entertainment (AMC). To assess sentiment's role, we employ two existing text-based sentiment analysis methods and introduce a third, a ChatGPT-annotated and fine-tuned RoBERTa-based model designed to better interpret the informal language and emojis prevalent in social media discussions. We use correlation and causality metrics to determine these models' predictive power. Surprisingly, our findings suggest that social media sentiment has only a weak correlation with stock prices. At the same time, simpler metrics, such as the volume of comments and Google search trends, exhibit stronger predictive signals. These results highlight the complexity of retail investor behavior and suggest that traditional sentiment analysis may not fully capture the nuances of market-moving online discussions.
format Preprint
id arxiv_https___arxiv_org_abs_2507_22922
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Predicting stock prices with ChatGPT-annotated Reddit sentiment
Kmak, Mateusz
Chmurzyński, Kamil
Matejuk, Kamil
Kotzbach, Paweł
Kocoń, Jan
Computation and Language
Artificial Intelligence
Social and Information Networks
The surge of retail investor activity on social media, exemplified by the 2021 GameStop short squeeze, raised questions about the influence of online sentiment on stock prices. This paper explores whether sentiment derived from social media discussions can meaningfully predict stock market movements. We focus on Reddit's r/wallstreetbets and analyze sentiment related to two companies: GameStop (GME) and AMC Entertainment (AMC). To assess sentiment's role, we employ two existing text-based sentiment analysis methods and introduce a third, a ChatGPT-annotated and fine-tuned RoBERTa-based model designed to better interpret the informal language and emojis prevalent in social media discussions. We use correlation and causality metrics to determine these models' predictive power. Surprisingly, our findings suggest that social media sentiment has only a weak correlation with stock prices. At the same time, simpler metrics, such as the volume of comments and Google search trends, exhibit stronger predictive signals. These results highlight the complexity of retail investor behavior and suggest that traditional sentiment analysis may not fully capture the nuances of market-moving online discussions.
title Predicting stock prices with ChatGPT-annotated Reddit sentiment
topic Computation and Language
Artificial Intelligence
Social and Information Networks
url https://arxiv.org/abs/2507.22922