Salvato in:
| Autori principali: | , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2505.20320 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910969600409600 |
|---|---|
| author | Cheetirala, Satya Narayana Raut, Ganesh Patel, Dhavalkumar Sanatana, Fabio Freeman, Robert Levin, Matthew A Nadkarni, Girish N. Dawkins, Omar Miller, Reba Steinhagen, Randolph M. Klang, Eyal Timsina, Prem |
| author_facet | Cheetirala, Satya Narayana Raut, Ganesh Patel, Dhavalkumar Sanatana, Fabio Freeman, Robert Levin, Matthew A Nadkarni, Girish N. Dawkins, Omar Miller, Reba Steinhagen, Randolph M. Klang, Eyal Timsina, Prem |
| contents | Long text classification is challenging for Large Language Models (LLMs) due to token limits and high computational costs. This study explores whether a Retrieval Augmented Generation (RAG) approach using only the most relevant text segments can match the performance of processing entire clinical notes with large context LLMs. We begin by splitting clinical documents into smaller chunks, converting them into vector embeddings, and storing these in a FAISS index. We then retrieve the top 4,000 words most pertinent to the classification query and feed these consolidated segments into an LLM. We evaluated three LLMs (GPT4o, LLaMA, and Mistral) on a surgical complication identification task. Metrics such as AUC ROC, precision, recall, and F1 showed no statistically significant differences between the RAG based approach and whole-text processing (p > 0.05p > 0.05). These findings indicate that RAG can significantly reduce token usage without sacrificing classification accuracy, providing a scalable and cost effective solution for analyzing lengthy clinical documents. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_20320 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Less Context, Same Performance: A RAG Framework for Resource-Efficient LLM-Based Clinical NLP Cheetirala, Satya Narayana Raut, Ganesh Patel, Dhavalkumar Sanatana, Fabio Freeman, Robert Levin, Matthew A Nadkarni, Girish N. Dawkins, Omar Miller, Reba Steinhagen, Randolph M. Klang, Eyal Timsina, Prem Computation and Language Artificial Intelligence Long text classification is challenging for Large Language Models (LLMs) due to token limits and high computational costs. This study explores whether a Retrieval Augmented Generation (RAG) approach using only the most relevant text segments can match the performance of processing entire clinical notes with large context LLMs. We begin by splitting clinical documents into smaller chunks, converting them into vector embeddings, and storing these in a FAISS index. We then retrieve the top 4,000 words most pertinent to the classification query and feed these consolidated segments into an LLM. We evaluated three LLMs (GPT4o, LLaMA, and Mistral) on a surgical complication identification task. Metrics such as AUC ROC, precision, recall, and F1 showed no statistically significant differences between the RAG based approach and whole-text processing (p > 0.05p > 0.05). These findings indicate that RAG can significantly reduce token usage without sacrificing classification accuracy, providing a scalable and cost effective solution for analyzing lengthy clinical documents. |
| title | Less Context, Same Performance: A RAG Framework for Resource-Efficient LLM-Based Clinical NLP |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2505.20320 |