Cover Image

Enhancing Human-Computer Interaction in Chest X-ray Analysis using Vision and Language Model with Eye Gaze Patterns

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kim, Yunsoo, Wu, Jinge, Abdulle, Yusuf, Gao, Yue, Wu, Honghan
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MedExQA: Medical Question Answering Benchmark with Multiple Explanations
by: Kim, Yunsoo, et al.
Published: (2024)

BioHopR: A Benchmark for Multi-Hop, Multi-Answer Reasoning in Biomedical Domain
by: Kim, Yunsoo, et al.
Published: (2025)

Look & Mark: Leveraging Radiologist Eye Fixations and Bounding boxes in Multimodal Large Language Models for Chest X-ray Report Generation
by: Kim, Yunsoo, et al.
Published: (2025)

RadEyeVideo: Enhancing general-domain Large Vision Language Model for chest X-ray analysis with video representations of eye gaze
by: Kim, Yunsoo, et al.
Published: (2025)

SLaVA-CXR: Small Language and Vision Assistant for Chest X-ray Report Automation
by: Wu, Jinge, et al.
Published: (2024)

Hallucination Benchmark in Medical Visual Question Answering
by: Wu, Jinge, et al.
Published: (2024)

Chain-of-Though (CoT) prompting strategies for medical error detection and correction
by: Wu, Zhaolong, et al.
Published: (2024)

RadBARTsum: Domain Specific Adaption of Denoising Sequence-to-Sequence Models for Abstractive Radiology Report Summarization
by: Wu, Jinge, et al.
Published: (2024)

Error Correction in Radiology Reports: A Knowledge Distillation-Based Multi-Stage Framework
by: Wu, Jinge, et al.
Published: (2024)

Exploring Multimodal Large Language Models for Radiology Report Error-checking
by: Wu, Jinge, et al.
Published: (2023)

HARE: an entity and relation centric evaluation framework for histopathology reports
by: Kim, Yunsoo, et al.
Published: (2025)

IHC-LLMiner: Automated extraction of tumour immunohistochemical profiles from PubMed abstracts using large language models
by: Kim, Yunsoo, et al.
Published: (2025)

A Vision-Language Foundation Model to Enhance Efficiency of Chest X-ray Interpretation
by: Chen, Zhihong, et al.
Published: (2024)

Pretraining Vision-Language Model for Difference Visual Question Answering in Longitudinal Chest X-rays
by: Cho, Yeongjae, et al.
Published: (2024)

CheX-GPT: Harnessing Large Language Models for Enhanced Chest X-ray Report Labeling
by: Gu, Jawook, et al.
Published: (2024)

Enhancing Chest X-ray Classification through Knowledge Injection in Cross-Modality Learning
by: Yan, Yang, et al.
Published: (2025)

A Hybrid Framework with Large Language Models for Rare Disease Phenotyping
by: Wu, Jinge, et al.
Published: (2024)

Rethinking Visual Attribution for Chest X-ray Reasoning in Large Vision Language Models
by: Xiong, Guangzhi, et al.
Published: (2026)

GlyphPattern: An Abstract Pattern Recognition Benchmark for Vision-Language Models
by: Wu, Zixuan, et al.
Published: (2024)

ChEX: Interactive Localization and Region Description in Chest X-rays
by: Müller, Philip, et al.
Published: (2024)

ViX-Ray: A Vietnamese Chest X-Ray Dataset for Vision-Language Models
by: Nguyen, Duy Vu Minh, et al.
Published: (2026)

RadZero: Similarity-Based Cross-Attention for Explainable Vision-Language Alignment in Chest X-ray with Zero-Shot Multi-Task Capability
by: Park, Jonggwon, et al.
Published: (2025)

Seeing Like Radiologists: Context- and Gaze-Guided Vision-Language Pretraining for Chest X-rays
by: Liu, Kang, et al.
Published: (2026)

Utility of Multimodal Large Language Models in Analyzing Chest X-ray with Incomplete Contextual Information
by: Kim, Choonghan, et al.
Published: (2024)

Sentiment analysis of preservice teachers' reflections using a large language model
by: Park, Yunsoo, et al.
Published: (2024)

Seeing Eye to AI: Human Alignment via Gaze-Based Response Rewards for Large Language Models
by: Lopez-Cardona, Angela, et al.
Published: (2024)

VICCA: Visual Interpretation and Comprehension of Chest X-ray Anomalies in Generated Report Without Human Feedback
by: Picha, Sayeh Gholipour, et al.
Published: (2025)

Lunguage: A Benchmark for Structured and Sequential Chest X-ray Interpretation
by: Moon, Jong Hak, et al.
Published: (2025)

LiteGPT: Large Vision-Language Model for Joint Chest X-ray Localization and Classification Task
by: Le-Duc, Khai, et al.
Published: (2024)

Eyes on the Image: Gaze Supervised Multimodal Learning for Chest X-ray Diagnosis and Report Generation
by: Riju, Tanjim Islam, et al.
Published: (2025)

PadChest-GR: A Bilingual Chest X-ray Dataset for Grounded Radiology Report Generation
by: Castro, Daniel C., et al.
Published: (2024)

M4CXR: Exploring Multi-task Potentials of Multi-modal Large Language Models for Chest X-ray Interpretation
by: Park, Jonggwon, et al.
Published: (2024)

ChartGaze: Enhancing Chart Understanding in LVLMs with Eye-Tracking Guided Attention Refinement
by: Salamatian, Ali, et al.
Published: (2025)

Infusing clinical knowledge into tokenisers for language models
by: Hasan, Abul, et al.
Published: (2024)

Vision-Language Models Mistake Head Orientation for Gaze Direction: Nonverbal Conversation Cues
by: Zhang, Zory, et al.
Published: (2025)

Agreeing to Interact in Human-Robot Interaction using Large Language Models and Vision Language Models
by: Sasabuchi, Kazuhiro, et al.
Published: (2025)

RadAgents: Multimodal Agentic Reasoning for Chest X-ray Interpretation with Radiologist-like Workflows
by: Zhang, Kai, et al.
Published: (2025)

GEM: Context-Aware Gaze EstiMation with Visual Search Behavior Matching for Chest Radiograph
by: Liu, Shaonan, et al.
Published: (2024)

CL-HOI: Cross-Level Human-Object Interaction Distillation from Vision Large Language Models
by: Gao, Jianjun, et al.
Published: (2024)

SocialGaze: Improving the Integration of Human Social Norms in Large Language Models
by: Vijjini, Anvesh Rao, et al.
Published: (2024)