Cover Image

Measuring Cross-Modal Interactions in Multimodal Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wenderoth, Laura, Hemker, Konstantin, Simidjievski, Nikola, Jamnik, Mateja
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Multimodal Lego: Model Merging and Fine-Tuning Across Topologies and Modalities in Biomedicine
by: Hemker, Konstantin, et al.
Published: (2024)

HEALNet: Multimodal Fusion for Heterogeneous Biomedical Data
by: Hemker, Konstantin, et al.
Published: (2023)

TabStruct: Measuring Structural Fidelity of Tabular Data
by: Jiang, Xiangjian, et al.
Published: (2025)

RO-FIGS: Efficient and Expressive Tree-Based Ensembles for Tabular Data
by: Matjašec, Urška, et al.
Published: (2025)

How Well Does Your Tabular Generator Learn the Structure of Tabular Data?
by: Jiang, Xiangjian, et al.
Published: (2025)

PATHS: A Hierarchical Transformer for Efficient Whole Slide Image Analysis
by: Buzzard, Zak, et al.
Published: (2024)

TabEBM: A Tabular Data Augmentation Method with Distinct Class-Specific Energy-Based Models
by: Margeloiu, Andrei, et al.
Published: (2024)

ProtoGate: Prototype-based Neural Networks with Global-to-local Feature Selection for Tabular Biomedical Data
by: Jiang, Xiangjian, et al.
Published: (2023)

GCondNet: A Novel Method for Improving Neural Networks on Small High-Dimensional Tabular Data
by: Margeloiu, Andrei, et al.
Published: (2022)

Tabular Foundation Model for Generative Modelling
by: Jiang, Xiangjian, et al.
Published: (2026)

TabMDA: Tabular Manifold Data Augmentation for Any Classifier using Transformers with In-context Subsetting
by: Margeloiu, Andrei, et al.
Published: (2024)

Exploring Multi-Modality Dynamics: Insights and Challenges in Multimodal Fusion for Biomedical Tasks
by: Wenderoth, Laura
Published: (2024)

LLM Embeddings for Deep Learning on Tabular Data
by: Koloski, Boshko, et al.
Published: (2025)

Understanding Inter-Concept Relationships in Concept-Based Models
by: Raman, Naveen, et al.
Published: (2024)

Diagnosing Medical Datasets with Training Dynamics
by: Wenderoth, Laura
Published: (2024)

Hierarchical Concept-based Interpretable Models
by: Hill, Oscar, et al.
Published: (2026)

Towards Spatial Transcriptomics-driven Pathology Foundation Models
by: Hemker, Konstantin, et al.
Published: (2026)

Digging Deeper: Learning Multi-Level Concept Hierarchies
by: Hill, Oscar, et al.
Published: (2026)

Do Concept Bottleneck Models Respect Localities?
by: Raman, Naveen, et al.
Published: (2024)

End-to-End Ontology Learning with Large Language Models
by: Lo, Andy, et al.
Published: (2024)

Repurposing Language Models into Embedding Models: Finding the Compute-Optimal Recipe
by: Ziarko, Alicja, et al.
Published: (2024)

Foundations of Interpretable Models
by: Barbiero, Pietro, et al.
Published: (2025)

Learning to Receive Help: Intervention-Aware Concept Embedding Models
by: Zarlenga, Mateo Espinosa, et al.
Published: (2023)

Avoiding Leakage Poisoning: Concept Interventions Under Distribution Shifts
by: Zarlenga, Mateo Espinosa, et al.
Published: (2025)

Efficient Bias Mitigation Without Privileged Information
by: Zarlenga, Mateo Espinosa, et al.
Published: (2024)

Discrete Lagrangian Neural Networks with Automatic Symmetry Discovery
by: Lishkova, Yana, et al.
Published: (2022)

Cross-Modal Prototype based Multimodal Federated Learning under Severely Missing Modality
by: Le, Huy Q., et al.
Published: (2024)

Actionable Interpretability Must Be Defined in Terms of Symmetries
by: Barbiero, Pietro, et al.
Published: (2026)

On Measuring Localization of Shortcuts in Deep Networks
by: Tsoy, Nikita, et al.
Published: (2025)

Cross-Modal Computational Model of Brain-Heart Interactions via HRV and EEG Feature
by: Pradeep, Malavika, et al.
Published: (2026)

MULTISEISMO: A Multimodal Seismic Dataset and Model for Cross-Modal Seismic Understanding
by: Munikoti, Sai, et al.
Published: (2026)

MUCAR: Benchmarking Multilingual Cross-Modal Ambiguity Resolution for Multimodal Large Language Models
by: Wang, Xiaolong, et al.
Published: (2025)

Measuring Cross-Modal Synergy: A Benchmark for VLM Explainability
by: Ky, Joël Roman, et al.
Published: (2026)

Cross-Modal Unlearning via Influential Neuron Path Editing in Multimodal Large Language Models
by: Li, Kunhao, et al.
Published: (2025)

On the Value of Cross-Modal Misalignment in Multimodal Representation Learning
by: Cai, Yichao, et al.
Published: (2025)

CC-Time: Cross-Model and Cross-Modality Time Series Forecasting
by: Chen, Peng, et al.
Published: (2025)

Multimodal Classification via Modal-Aware Interactive Enhancement
by: Jiang, Qing-Yuan, et al.
Published: (2024)

Attention-Based Multimodal Survival Prediction with Cross-Modal Bilinear Fusion
by: Keshvarikhojasteh, Hassan, et al.
Published: (2026)

Multimodal Foundation Model for Cross-Modal Retrieval and Activity Recognition Tasks
by: Matsuishi, Koki, et al.
Published: (2025)

Cross-Modal Alignment via Variational Copula Modelling
by: Wu, Feng, et al.
Published: (2025)