Cover Image

UniPACT: A Multimodal Framework for Prognostic Question Answering on Raw ECG and Structured EHR

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tang, Jialu, Xia, Tong, Lu, Yuan, Saeed, Aaqib
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Electrocardiogram-Language Model for Few-Shot Question Answering with Meta Learning
by: Tang, Jialu, et al.
Published: (2024)

Electrocardiogram Report Generation and Question Answering via Retrieval-Augmented Self-Supervised Modeling
by: Tang, Jialu, et al.
Published: (2024)

Interpretable Multimodal Zero-Shot ECG Diagnosis via Structured Clinical Knowledge Alignment
by: Tang, Jialu, et al.
Published: (2025)

Q-Heart: ECG Question Answering via Knowledge-Informed Multimodal LLMs
by: Pham, Hung Manh, et al.
Published: (2025)

Learning ECG Image Representations via Dual Physiological-Aware Alignments
by: Pham, Hung Manh, et al.
Published: (2026)

CaReAQA: A Cardiac and Respiratory Audio Question Answering Model for Open-Ended Diagnostic Reasoning
by: Wang, Tsai-Ning, et al.
Published: (2025)

Unified Acoustic Representations for Screening Neurological and Respiratory Pathologies from Voice
by: Piao, Ran, et al.
Published: (2025)

Boosting Masked ECG-Text Auto-Encoders as Discriminative Learners
by: Pham, Hung Manh, et al.
Published: (2024)

RespLLM: Unifying Audio and Text with Multimodal LLMs for Generalized Respiratory Health Prediction
by: Zhang, Yuwei, et al.
Published: (2024)

PedSleepMAE: Generative Model for Multimodal Pediatric Sleep Signals
by: Pandey, Saurav R., et al.
Published: (2024)

MediFact at MEDIQA-M3G 2024: Medical Question Answering in Dermatology with Multimodal Learning
by: Saeed, Nadia
Published: (2024)

Neural at ArchEHR-QA 2025: Agentic Prompt Optimization for Evidence-Grounded Clinical Question Answering
by: Bogireddy, Sai Prasanna Teja Reddy, et al.
Published: (2025)

HealthNLP_Retrievers at ArchEHR-QA 2026: Cascaded LLM Pipeline for Grounded Clinical Question Answering
by: Hosen, Md Biplob, et al.
Published: (2026)

DANIEL: A Distributed and Scalable Approach for Global Representation Learning with EHR Applications
by: Wang, Zebin, et al.
Published: (2025)

Structured RAG for Answering Aggregative Questions
by: Koshorek, Omri, et al.
Published: (2025)

UniPhyNet: A Unified Network For Multimodal Physiological Raw Signal Classification
by: Qiu, Renxiang, et al.
Published: (2025)

Predictive Multimodal Modeling of Diagnoses and Treatments in EHR
by: Huang, Cindy Shih-Ting, et al.
Published: (2025)

A Curriculum Learning Approach to Reinforcement Learning: Leveraging RAG for Multimodal Question Answering
by: Zhang, Chenliang, et al.
Published: (2025)

UniCoMTE: A Universal Counterfactual Framework for Explaining Time-Series Classifiers on ECG Data
by: Li, Justin, et al.
Published: (2025)

Collaboratively Learning Federated Models from Noisy Decentralized Data
by: Li, Haoyuan, et al.
Published: (2024)

Federated Learning with a Single Shared Image
by: Soni, Sunny, et al.
Published: (2024)

Vib2ECG: A Paired Chest-Lead SCG-ECG Dataset and Benchmark for ECG Reconstruction
by: Lu, Guorui, et al.
Published: (2026)

UniDiff: A Unified Diffusion Framework for Multimodal Time Series Forecasting
by: Zhang, Da, et al.
Published: (2025)

RA-QA: A Benchmarking System for Respiratory Audio Question Answering Under Real-World Heterogeneity
by: Bertolino, Gaia A., et al.
Published: (2026)

ClimaQA: An Automated Evaluation Framework for Climate Question Answering Models
by: Manivannan, Veeramakali Vignesh, et al.
Published: (2024)

RawECGNet: Deep Learning Generalization for Atrial Fibrillation Detection from the Raw ECG
by: Ben-Moshe, Noam, et al.
Published: (2023)

Communication-Efficient Federated Learning through Adaptive Weight Clustering and Server-Side Distillation
by: Tsouvalas, Vasileios, et al.
Published: (2024)

Improving Hospital Risk Prediction with Knowledge-Augmented Multimodal EHR Modeling
by: Datta, Rituparna, et al.
Published: (2025)

Integrating Genomics into Multimodal EHR Foundation Models
by: Amar, Jonathan, et al.
Published: (2025)

ExECG: An Explainable AI Framework for ECG models
by: Jang, Jong-Hwan, et al.
Published: (2026)

Tokenization Tradeoffs in Structured EHR Foundation Models
by: Guo, Lin Lawrence, et al.
Published: (2026)

Multimodal Fusion of EHR in Structures and Semantics: Integrating Clinical Records and Notes with Hypergraph and LLM
by: Cui, Hejie, et al.
Published: (2024)

Learning under Label Noise through Few-Shot Human-in-the-Loop Refinement
by: Saeed, Aaqib, et al.
Published: (2024)

RSAdapter: Adapting Multimodal Models for Remote Sensing Visual Question Answering
by: Wang, Yuduo, et al.
Published: (2023)

A Dataset for Spatiotemporal-Sensitive POI Question Answering
by: Han, Xiao, et al.
Published: (2025)

StethoLM: Audio Language Model for Cardiopulmonary Analysis Across Clinical Tasks
by: Wang, Yishan, et al.
Published: (2026)

Questioning the Stability of Visual Question Answering
by: Rosenfeld, Amir, et al.
Published: (2025)

Task Formulation Matters When Learning Continually: A Case Study in Visual Question Answering
by: Nikandrou, Mavina, et al.
Published: (2022)

CAAT-EHR: Cross-Attentional Autoregressive Transformer for Multimodal Electronic Health Record Embeddings
by: Olaimat, Mohammad Al, et al.
Published: (2025)

WikiMixQA: A Multimodal Benchmark for Question Answering over Tables and Charts
by: Foroutan, Negar, et al.
Published: (2025)