Imagen de Portada

It's Not a Modality Gap: Characterizing and Addressing the Contrastive Gap

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Fahim, Abrar, Murphy, Alex, Fyshe, Alona
Formato:	Preprint
Publicado:	2024
Materias:	Computer Vision and Pattern Recognition Computation and Language Information Retrieval Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Exploring Curriculum Learning for Vision-Language Tasks: A Study on Small-Scale Multimodal Training
por: Saha, Rohan, et al.
Publicado: (2024)

Closing the Modality Gap for Mixed Modality Search
por: Li, Binxu, et al.
Publicado: (2025)

Finding Shared Decodable Concepts and their Negations in the Brain
por: Efird, Cory, et al.
Publicado: (2024)

Multimedia-Aware Question Answering: A Review of Retrieval and Cross-Modal Reasoning Architectures
por: Raja, Rahul, et al.
Publicado: (2025)

Generalized Contrastive Learning for Multi-Modal Retrieval and Ranking
por: Zhu, Tianyu, et al.
Publicado: (2024)

Benchmarking Robustness of Contrastive Learning Models for Medical Image-Report Retrieval
por: Deanda, Demetrio, et al.
Publicado: (2025)

UniversalRAG: Retrieval-Augmented Generation over Corpora of Diverse Modalities and Granularities
por: Yeo, Woongyeong, et al.
Publicado: (2025)

Modality-Aware Integration with Large Language Models for Knowledge-based Visual Question Answering
por: Dong, Junnan, et al.
Publicado: (2024)

Reversed in Time: A Novel Temporal-Emphasized Benchmark for Cross-Modal Video-Text Retrieval
por: Du, Yang, et al.
Publicado: (2024)

FlowVQA: Mapping Multimodal Logic in Visual Question Answering with Flowcharts
por: Singh, Shubhankar, et al.
Publicado: (2024)

DREAM: Improving Video-Text Retrieval Through Relevance-Based Augmentation Using Large Foundation Models
por: Wang, Yimu, et al.
Publicado: (2024)

VLM-KG: Multimodal Radiology Knowledge Graph Generation
por: Abdullah, Abdullah, et al.
Publicado: (2025)

FilterRAG: Zero-Shot Informed Retrieval-Augmented Generation to Mitigate Hallucinations in VQA
por: Sarwar, Nobin
Publicado: (2025)

Using Knowledge Graphs to harvest datasets for efficient CLIP model training
por: Ging, Simon, et al.
Publicado: (2025)

PAPERCLIP: Associating Astronomical Observations and Natural Language with Multi-Modal Models
por: Mishra-Sharma, Siddharth, et al.
Publicado: (2024)

Bridging the Modality Gap: Dimension Information Alignment and Sparse Spatial Constraint for Image-Text Matching
por: Ma, Xiang, et al.
Publicado: (2024)

Object-Aware Query Perturbation for Cross-Modal Image-Text Retrieval
por: Sogi, Naoya, et al.
Publicado: (2024)

Maximal Matching Matters: Preventing Representation Collapse for Robust Cross-Modal Retrieval
por: Alomari, Hani, et al.
Publicado: (2025)

TelcoAI: Advancing 3GPP Technical Specification Search through Agentic Multi-Modal Retrieval-Augmented Generation
por: Ghosh, Rahul, et al.
Publicado: (2025)

Multimodal Inverse Attention Network with Intrinsic Discriminant Feature Exploitation for Fake News Detection
por: Zhang, Tianlin, et al.
Publicado: (2025)

Multi-Vector Index Compression in Any Modality
por: Qin, Hanxiang, et al.
Publicado: (2026)

Efficient and High-Fidelity Omni Modality Retrieval
por: Huynh, Chuong, et al.
Publicado: (2026)

CoopHash: Cooperative Learning of Multipurpose Descriptor and Contrastive Pair Generator via Variational MCMC Teaching for Supervised Image Hashing
por: Doan, Khoa D., et al.
Publicado: (2022)

VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval
por: Zhou, Junjie, et al.
Publicado: (2024)

Correcting Biased Centered Kernel Alignment Measures in Biological and Artificial Neural Networks
por: Murphy, Alex, et al.
Publicado: (2024)

Supervised Fine-Tuning or Contrastive Learning? Towards Better Multimodal LLM Reranking
por: Dai, Ziqi, et al.
Publicado: (2025)

Why Steering Works: Toward a Unified View of Language Model Parameter Dynamics
por: Xu, Ziwen, et al.
Publicado: (2026)

FM2DS: Few-Shot Multimodal Multihop Data Synthesis with Knowledge Distillation for Question Answering
por: Abaskohi, Amirhossein, et al.
Publicado: (2024)

EIVEN: Efficient Implicit Attribute Value Extraction using Multimodal LLM
por: Zou, Henry Peng, et al.
Publicado: (2024)

MM-Embed: Universal Multimodal Retrieval with Multimodal LLMs
por: Lin, Sheng-Chieh, et al.
Publicado: (2024)

ImplicitAVE: An Open-Source Dataset and Multimodal LLMs Benchmark for Implicit Attribute Value Extraction
por: Zou, Henry Peng, et al.
Publicado: (2024)

Knowledge Circuits in Pretrained Transformers
por: Yao, Yunzhi, et al.
Publicado: (2024)

WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models
por: Wang, Peng, et al.
Publicado: (2024)

Retrieval-augmented Prompt Learning for Pre-trained Foundation Models
por: Chen, Xiang, et al.
Publicado: (2025)

Evaluation of Embedding-Based and Generative Methods for LLM-Driven Document Classification: Opportunities and Challenges
por: Lu, Rong, et al.
Publicado: (2026)

FactCHD: Benchmarking Fact-Conflicting Hallucination Detection
por: Chen, Xiang, et al.
Publicado: (2023)

CaKE: Circuit-aware Editing Enables Generalizable Knowledge Learners
por: Yao, Yunzhi, et al.
Publicado: (2025)

Utility-Oriented Visual Evidence Selection for Multimodal Retrieval-Augmented Generation
por: Luo, Weiqing, et al.
Publicado: (2026)

ADAM: A Diverse Archive of Mankind for Evaluating and Enhancing LLMs in Biographical Reasoning
por: Cekinmez, Jasin, et al.
Publicado: (2025)

EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Models
por: Wang, Peng, et al.
Publicado: (2023)