Cancer Type, Stage and Prognosis Assessment from Pathology Reports using LLMs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Saluja, Rachit, Rosenthal, Jacob, Artzi, Yoav, Pisapia, David J., Liechty, Benjamin L., Sabuncu, Mert R.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912255959891968
author Saluja, Rachit
Rosenthal, Jacob
Artzi, Yoav
Pisapia, David J.
Liechty, Benjamin L.
Sabuncu, Mert R.
author_facet Saluja, Rachit
Rosenthal, Jacob
Artzi, Yoav
Pisapia, David J.
Liechty, Benjamin L.
Sabuncu, Mert R.
contents Large Language Models (LLMs) have shown significant promise across various natural language processing tasks. However, their application in the field of pathology, particularly for extracting meaningful insights from unstructured medical texts such as pathology reports, remains underexplored and not well quantified. In this project, we leverage state-of-the-art language models, including the GPT family, Mistral models, and the open-source Llama models, to evaluate their performance in comprehensively analyzing pathology reports. Specifically, we assess their performance in cancer type identification, AJCC stage determination, and prognosis assessment, encompassing both information extraction and higher-order reasoning tasks. Based on a detailed analysis of their performance metrics in a zero-shot setting, we developed two instruction-tuned models: Path-llama3.1-8B and Path-GPT-4o-mini-FT. These models demonstrated superior performance in zero-shot cancer type identification, staging, and prognosis assessment compared to the other models evaluated.
format Preprint
id arxiv_https___arxiv_org_abs_2503_01194
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Cancer Type, Stage and Prognosis Assessment from Pathology Reports using LLMs
Saluja, Rachit
Rosenthal, Jacob
Artzi, Yoav
Pisapia, David J.
Liechty, Benjamin L.
Sabuncu, Mert R.
Computation and Language
Information Retrieval
Large Language Models (LLMs) have shown significant promise across various natural language processing tasks. However, their application in the field of pathology, particularly for extracting meaningful insights from unstructured medical texts such as pathology reports, remains underexplored and not well quantified. In this project, we leverage state-of-the-art language models, including the GPT family, Mistral models, and the open-source Llama models, to evaluate their performance in comprehensively analyzing pathology reports. Specifically, we assess their performance in cancer type identification, AJCC stage determination, and prognosis assessment, encompassing both information extraction and higher-order reasoning tasks. Based on a detailed analysis of their performance metrics in a zero-shot setting, we developed two instruction-tuned models: Path-llama3.1-8B and Path-GPT-4o-mini-FT. These models demonstrated superior performance in zero-shot cancer type identification, staging, and prognosis assessment compared to the other models evaluated.
title Cancer Type, Stage and Prognosis Assessment from Pathology Reports using LLMs
topic Computation and Language
Information Retrieval
url https://arxiv.org/abs/2503.01194