FinRLlama: A Solution to LLM-Engineered Signals Challenge at FinRL Contest 2024

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: Grover, Arnav
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915136047939584
author Grover, Arnav
author_facet Grover, Arnav
contents In response to Task II of the FinRL Challenge at ACM ICAIF 2024, this study proposes a novel prompt framework for fine-tuning large language models (LLM) with Reinforcement Learning from Market Feedback (RLMF). Our framework incorporates market-specific features and short-term price dynamics to generate more precise trading signals. Traditional LLMs, while competent in sentiment analysis, lack contextual alignment for financial market applications. To bridge this gap, we fine-tune the LLaMA-3.2-3B-Instruct model using a custom RLMF prompt design that integrates historical market data and reward-based feedback. Our evaluation shows that this RLMF-tuned framework outperforms baseline methods in signal consistency and achieving tighter trading outcomes; awarded as winner of Task II. You can find the code for this project on GitHub.
format Preprint
id arxiv_https___arxiv_org_abs_2502_01992
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle FinRLlama: A Solution to LLM-Engineered Signals Challenge at FinRL Contest 2024
Grover, Arnav
Trading and Market Microstructure
Machine Learning
In response to Task II of the FinRL Challenge at ACM ICAIF 2024, this study proposes a novel prompt framework for fine-tuning large language models (LLM) with Reinforcement Learning from Market Feedback (RLMF). Our framework incorporates market-specific features and short-term price dynamics to generate more precise trading signals. Traditional LLMs, while competent in sentiment analysis, lack contextual alignment for financial market applications. To bridge this gap, we fine-tune the LLaMA-3.2-3B-Instruct model using a custom RLMF prompt design that integrates historical market data and reward-based feedback. Our evaluation shows that this RLMF-tuned framework outperforms baseline methods in signal consistency and achieving tighter trading outcomes; awarded as winner of Task II. You can find the code for this project on GitHub.
title FinRLlama: A Solution to LLM-Engineered Signals Challenge at FinRL Contest 2024
topic Trading and Market Microstructure
Machine Learning
url https://arxiv.org/abs/2502.01992