Cover Image

ModalTune: Fine-Tuning Slide-Level Foundation Models with Multi-Modal Information for Multi-task Learning in Digital Pathology

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ramanathan, Vishwesh, Xu, Tony, Pati, Pushpak, Ahmed, Faruk, Goubran, Maged, Martel, Anne L.
Format:	Preprint
Published:	2025
Subjects:	Image and Video Processing Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PRISM: A Multi-Modal Generative Foundation Model for Slide-Level Histopathology
by: Shaikovski, George, et al.
Published: (2024)

A generalizable 3D framework and model for self-supervised learning in medical imaging
by: Xu, Tony, et al.
Published: (2025)

End-to-end Multi-source Visual Prompt Tuning for Survival Analysis in Whole Slide Images
by: Qiu, Zhongwei, et al.
Published: (2024)

PuzzleTuning: Explicitly Bridge Pathological and Natural Image with Puzzles
by: Zhang, Tianyi, et al.
Published: (2023)

Cross-Modal Fine-Tuning of 3D Convolutional Foundation Models for ADHD Classification with Low-Rank Adaptation
by: Kao, Jyun-Ping, et al.
Published: (2025)

Fourier Prompt Tuning for Modality-Incomplete Scene Segmentation
by: Liu, Ruiping, et al.
Published: (2024)

Virchow: A Million-Slide Digital Pathology Foundation Model
by: Vorontsov, Eugene, et al.
Published: (2023)

Pixels Under Pressure: Exploring Fine-Tuning Paradigms for Foundation Models in High-Resolution Medical Imaging
by: TehraniNasab, Zahra, et al.
Published: (2025)

From Pixel to Slide image: Polarization Modality-based Pathological Diagnosis Using Representation Learning
by: Dong, Jia, et al.
Published: (2024)

Retrieval Augmented Generation with Multi-Modal LLM Framework for Wireless Environments
by: Mohsin, Muhammad Ahmed, et al.
Published: (2025)

Unified Multi-Modal Image Synthesis for Missing Modality Imputation
by: Zhang, Yue, et al.
Published: (2023)

Parameter Efficient Fine Tuning for Multi-scanner PET to PET Reconstruction
by: Kim, Yumin, et al.
Published: (2024)

PAL: Prompting Analytic Learning with Missing Modality for Multi-Modal Class-Incremental Learning
by: Yue, Xianghu, et al.
Published: (2025)

Whole Slide Concepts: A Supervised Foundation Model For Pathological Images
by: Nicke, Till, et al.
Published: (2025)

MM-DINOv2: Adapting Foundation Models for Multi-Modal Medical Image Analysis
by: Scholz, Daniel, et al.
Published: (2025)

M2Diff: Multi-Modality Multi-Task Enhanced Diffusion Model for MRI-Guided Low-Dose PET Enhancement
by: Yar, Ghulam Nabi Ahmad Hassan, et al.
Published: (2026)

VisionFM: a Multi-Modal Multi-Task Vision Foundation Model for Generalist Ophthalmic Artificial Intelligence
by: Qiu, Jianing, et al.
Published: (2023)

Comparing ImageNet Pre-training with Digital Pathology Foundation Models for Whole Slide Image-Based Survival Analysis
by: Papadopoulos, Kleanthis Marios, et al.
Published: (2024)

Enhanced Diagnostic Fidelity in Pathology Whole Slide Image Compression via Deep Learning
by: Fischer, Maximilian, et al.
Published: (2025)

Foundation Model for Whole-Heart Segmentation: Leveraging Student-Teacher Learning in Multi-Modal Medical Imaging
by: Qayyum, Abdul, et al.
Published: (2025)

IN2OUT: Fine-Tuning Video Inpainting Model for Video Outpainting Using Hierarchical Discriminator
by: Youn, Sangwoo, et al.
Published: (2025)

Automating Vessel Segmentation in the Heart and Brain: A Trend to Develop Multi-Modality and Label-Efficient Deep Learning Techniques
by: Elsayed, Nazik, et al.
Published: (2024)

PulmoFusion: Advancing Pulmonary Health with Efficient Multi-Modal Fusion
by: Sharshar, Ahmed, et al.
Published: (2025)

Multimodal Whole Slide Foundation Model for Pathology
by: Ding, Tong, et al.
Published: (2024)

DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistency
by: Yao, Wenfang, et al.
Published: (2024)

Exploring Foundation Models Fine-Tuning for Cytology Classification
by: Dausort, Manon, et al.
Published: (2024)

Semantic-guided Masked Mutual Learning for Multi-modal Brain Tumor Segmentation with Arbitrary Missing Modalities
by: Liang, Guoyan, et al.
Published: (2025)

Universal Vessel Segmentation for Multi-Modality Retinal Images
by: Wen, Bo, et al.
Published: (2025)

MMR-Mamba: Multi-Modal MRI Reconstruction with Mamba and Spatial-Frequency Information Fusion
by: Zou, Jing, et al.
Published: (2024)

PASTA: Pathology-Aware MRI to PET Cross-Modal Translation with Diffusion Models
by: Li, Yitong, et al.
Published: (2024)

M$^3$AD: Multi-task Multi-gate Mixture of Experts for Alzheimer's Disease Diagnosis with Conversion Pattern Modeling
by: Jiang, Yufeng, et al.
Published: (2025)

Dante: An Open Source Model Pre-Training and Fine-Tuning Tool for the Dafne Federated Framework for Medical Image Segmentation
by: Timpano, Giuseppe, et al.
Published: (2026)

Language-based Color ISP Tuning
by: Mayer, Owen, et al.
Published: (2025)

CrossModalityDiffusion: Multi-Modal Novel View Synthesis with Unified Intermediate Representation
by: Berian, Alex, et al.
Published: (2025)

$μ^2$Tokenizer: Differentiable Multi-Scale Multi-Modal Tokenizer for Radiology Report Generation
by: Li, Siyou, et al.
Published: (2025)

MulModSeg: Enhancing Unpaired Multi-Modal Medical Image Segmentation with Modality-Conditioned Text Embedding and Alternating Training
by: Li, Chengyin, et al.
Published: (2024)

Advancements in Medical Image Classification through Fine-Tuning Natural Domain Foundation Models
by: Mansoori, Mobina, et al.
Published: (2025)

FARM: Fine-Tuning Geospatial Foundation Models for Intra-Field Crop Yield Regression
by: Nejadshamsi, Shayan, et al.
Published: (2025)

Search-MIND: Training-Free Multi-Modal Medical Image Registration
by: Wang, Boya, et al.
Published: (2026)

Unsupervised Tumor-Aware Distillation for Multi-Modal Brain Image Translation
by: Huang, Chuan, et al.
Published: (2024)