Automatic Mapping of Anatomical Landmarks from Free-Text Using Large Language Models: Insights from Llama-2

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Abdi, Mohamad, Valadez, Gerardo Hermosillo, Yerebakan, Halid Ziya
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913549951959040
author Abdi, Mohamad
Valadez, Gerardo Hermosillo
Yerebakan, Halid Ziya
author_facet Abdi, Mohamad
Valadez, Gerardo Hermosillo
Yerebakan, Halid Ziya
contents Anatomical landmarks are vital in medical imaging for navigation and anomaly detection. Modern large language models (LLMs), like Llama-2, offer promise for automating the mapping of these landmarks in free-text radiology reports to corresponding positions in image data. Recent studies propose LLMs may develop coherent representations of generative processes. Motivated by these insights, we investigated whether LLMs accurately represent the spatial positions of anatomical landmarks. Through experiments with Llama-2 models, we found that they can linearly represent anatomical landmarks in space with considerable robustness to different prompts. These results underscore the potential of LLMs to enhance the efficiency and accuracy of medical imaging workflows.
format Preprint
id arxiv_https___arxiv_org_abs_2410_12686
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Automatic Mapping of Anatomical Landmarks from Free-Text Using Large Language Models: Insights from Llama-2
Abdi, Mohamad
Valadez, Gerardo Hermosillo
Yerebakan, Halid Ziya
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Anatomical landmarks are vital in medical imaging for navigation and anomaly detection. Modern large language models (LLMs), like Llama-2, offer promise for automating the mapping of these landmarks in free-text radiology reports to corresponding positions in image data. Recent studies propose LLMs may develop coherent representations of generative processes. Motivated by these insights, we investigated whether LLMs accurately represent the spatial positions of anatomical landmarks. Through experiments with Llama-2 models, we found that they can linearly represent anatomical landmarks in space with considerable robustness to different prompts. These results underscore the potential of LLMs to enhance the efficiency and accuracy of medical imaging workflows.
title Automatic Mapping of Anatomical Landmarks from Free-Text Using Large Language Models: Insights from Llama-2
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2410.12686