Imagen de Portada

Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Data

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhang, Yuhui, Sui, Elaine, Yeung-Levy, Serena
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence Computation and Language Computer Vision and Pattern Recognition
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Closing the Modality Gap for Mixed Modality Search
por: Li, Binxu, et al.
Publicado: (2025)

Just Shift It: Test-Time Prototype Shifting for Zero-Shot Generalization with Vision-Language Models
por: Sui, Elaine, et al.
Publicado: (2024)

Data or Language Supervision: What Makes CLIP Better than DINO?
por: Liu, Yiming, et al.
Publicado: (2025)

NegVQA: Can Vision Language Models Understand Negation?
por: Zhang, Yuhui, et al.
Publicado: (2025)

Why are Visually-Grounded Language Models Bad at Image Classification?
por: Zhang, Yuhui, et al.
Publicado: (2024)

Temporal Preference Optimization for Long-Form Video Understanding
por: Li, Rui, et al.
Publicado: (2025)

Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation
por: Zhang, Yuhui, et al.
Publicado: (2025)

EgoBabyVLM: Benchmarking Cross-Modal Learning from Naturalistic Egocentric Video Data
por: Lin, Dongyan, et al.
Publicado: (2026)

RadDiff: Describing Differences in Radiology Image Sets with Natural Language
por: Shen, Xiaoxian, et al.
Publicado: (2026)

LLMs Can Evolve Continually on Modality for X-Modal Reasoning
por: Yu, Jiazuo, et al.
Publicado: (2024)

Mitigate the Gap: Investigating Approaches for Improving Cross-Modal Alignment in CLIP
por: Eslami, Sedigheh, et al.
Publicado: (2024)

COSMOS: Cross-Modality Self-Distillation for Vision Language Pre-training
por: Kim, Sanghwan, et al.
Publicado: (2024)

Mixture-of-Mamba: Enhancing Multi-Modal State-Space Models with Modality-Aware Sparsity
por: Liang, Weixin, et al.
Publicado: (2025)

VideoAgent: Long-form Video Understanding with Large Language Model as Agent
por: Wang, Xiaohan, et al.
Publicado: (2024)

Fine-tuning MLLMs Without Forgetting Is Easier Than You Think
por: Li, He, et al.
Publicado: (2026)

Contrasting with Symile: Simple Model-Agnostic Representation Learning for Unlimited Modalities
por: Saporta, Adriel, et al.
Publicado: (2024)

Mimicking or Reasoning: Rethinking Multi-Modal In-Context Learning in Vision-Language Models
por: Huang, Chengyue, et al.
Publicado: (2025)

Cream of the Crop: Harvesting Rich, Scalable and Transferable Multi-Modal Data for Instruction Fine-Tuning
por: Lyu, Mengyao, et al.
Publicado: (2025)

Viewpoint Textual Inversion: Discovering Scene Representations and 3D View Control in 2D Diffusion Models
por: Burgess, James, et al.
Publicado: (2023)

StyleMotif: Multi-Modal Motion Stylization using Style-Content Cross Fusion
por: Guo, Ziyu, et al.
Publicado: (2025)

Multimodal Foundation Model for Cross-Modal Retrieval and Activity Recognition Tasks
por: Matsuishi, Koki, et al.
Publicado: (2025)

Transductive Visual Programming: Evolving Tool Libraries from Experience for Spatial Reasoning
por: Wu, Shengguang, et al.
Publicado: (2025)

Examining Modality Incongruity in Multimodal Federated Learning for Medical Vision and Language-based Disease Detection
por: Saha, Pramit, et al.
Publicado: (2024)

Video Action Differencing
por: Burgess, James, et al.
Publicado: (2025)

MobileCLIP2: Improving Multi-Modal Reinforced Training
por: Faghri, Fartash, et al.
Publicado: (2025)

MM-LIMA: Less Is More for Alignment in Multi-Modal Datasets
por: Wei, Lai, et al.
Publicado: (2023)

Reasoning Dynamics and the Limits of Monitoring Modality Reliance in Vision-Language Models
por: Villegas, Danae Sánchez, et al.
Publicado: (2026)

OneLLM: One Framework to Align All Modalities with Language
por: Han, Jiaming, et al.
Publicado: (2023)

Ask, Pose, Unite: Scaling Data Acquisition for Close Interactions with Vision Language Models
por: Bravo-Sánchez, Laura, et al.
Publicado: (2024)

Modality-Balancing Preference Optimization of Large Multimodal Models by Adversarial Negative Mining
por: Liu, Chenxi, et al.
Publicado: (2025)

How Do Vision-Language Models Process Conflicting Information Across Modalities?
por: Hua, Tianze, et al.
Publicado: (2025)

AmCLR: Unified Augmented Learning for Cross-Modal Representations
por: Jagannath, Ajay, et al.
Publicado: (2024)

Robust Multimodal Learning via Cross-Modal Proxy Tokens
por: Reza, Md Kaykobad, et al.
Publicado: (2025)

mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Models
por: Ye, Jiabo, et al.
Publicado: (2024)

MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learning
por: Nedungadi, Vishal, et al.
Publicado: (2024)

Vision-Language Models Create Cross-Modal Task Representations
por: Luo, Grace, et al.
Publicado: (2024)

Enhancing Visual-Language Modality Alignment in Large Vision Language Models via Self-Improvement
por: Wang, Xiyao, et al.
Publicado: (2024)

UniT: Unified Multimodal Chain-of-Thought Test-time Scaling
por: Chen, Leon Liangyu, et al.
Publicado: (2026)

Reversed in Time: A Novel Temporal-Emphasized Benchmark for Cross-Modal Video-Text Retrieval
por: Du, Yang, et al.
Publicado: (2024)

Uni-DPO: A Unified Paradigm for Dynamic Preference Optimization of LLMs
por: Peng, Shangpin, et al.
Publicado: (2025)