Copertina

Assessing and Learning Alignment of Unimodal Vision and Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Le, Yang, Qian, Agrawal, Aishwarya
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Semantic Alignment of Unimodal Medical Text and Vision Representations
di: Di Folco, Maxime, et al.
Pubblicazione: (2025)

Discovering Failure Modes in Vision-Language Models using RL
di: Jain, Kanishk, et al.
Pubblicazione: (2026)

Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Compositional Understanding
di: Zhang, Le, et al.
Pubblicazione: (2023)

RiT: Vanilla Diffusion Transformers Suffice in Representation Space
di: Zhang, Le, et al.
Pubblicazione: (2026)

How and What to Imagine? Visual Thinking in Unified Multimodal Models for Cross-View Spatial Reasoning
di: Yang, Qian, et al.
Pubblicazione: (2026)

Decompose and Compare Consistency: Measuring VLMs' Answer Reliability via Task-Decomposition Consistency Comparison
di: Yang, Qian, et al.
Pubblicazione: (2024)

Investigating Prompting Techniques for Zero- and Few-Shot Visual Question Answering
di: Awal, Rabiul, et al.
Pubblicazione: (2023)

Harnessing Frozen Unimodal Encoders for Flexible Multimodal Alignment
di: Maniparambil, Mayug, et al.
Pubblicazione: (2024)

CulturalFrames: Assessing Cultural Expectation Alignment in Text-to-Image Models and Evaluation Metrics
di: Nayak, Shravan, et al.
Pubblicazione: (2025)

Learning What Matters: Prioritized Concept Learning via Relative Error-driven Sample Selection
di: Chandhok, Shivam, et al.
Pubblicazione: (2025)

Learning Robust Anymodal Segmentor with Unimodal and Cross-modal Distillation
di: Zheng, Xu, et al.
Pubblicazione: (2024)

VisMin: Visual Minimal-Change Understanding
di: Awal, Rabiul, et al.
Pubblicazione: (2024)

Improving Automatic VQA Evaluation Using Large Language Models
di: Mañas, Oscar, et al.
Pubblicazione: (2023)

Generalizable Prompt Tuning for Vision-Language Models
di: Zhang, Qian
Pubblicazione: (2024)

Benchmarking Vision Language Models for Cultural Understanding
di: Nayak, Shravan, et al.
Pubblicazione: (2024)

AlignIT: Enhancing Prompt Alignment in Customization of Text-to-Image Models
di: Agarwal, Aishwarya, et al.
Pubblicazione: (2024)

APEX: Learning Adaptive Priorities for Multi-Objective Alignment in Vision-Language Generation
di: Chen, Dongliang, et al.
Pubblicazione: (2026)

A Unified Understanding of Adversarial Vulnerability Regarding Unimodal Models and Vision-Language Pre-training Models
di: Zheng, Haonan, et al.
Pubblicazione: (2024)

Communicating about Space: Language-Mediated Spatial Integration Across Partial Views
di: Sikarwar, Ankur, et al.
Pubblicazione: (2026)

Planner-Refiner: Dynamic Space-Time Refinement for Vision-Language Alignment in Videos
di: Tran, Tuyen, et al.
Pubblicazione: (2025)

Learning to Look: Cognitive Attention Alignment with Vision-Language Models
di: Yang, Ryan L., et al.
Pubblicazione: (2025)

Quantifying and Mitigating Unimodal Biases in Multimodal Large Language Models: A Causal Perspective
di: Chen, Meiqi, et al.
Pubblicazione: (2024)

Batch Augmentation with Unimodal Fine-tuning for Multimodal Learning
di: Kabir, H M Dipu, et al.
Pubblicazione: (2025)

Locality Alignment Improves Vision-Language Models
di: Covert, Ian, et al.
Pubblicazione: (2024)

Probabilistic Embeddings for Frozen Vision-Language Models: Uncertainty Quantification with Gaussian Process Latent Variable Models
di: Venkataramanan, Aishwarya, et al.
Pubblicazione: (2025)

Attention Guided Alignment in Efficient Vision-Language Models
di: Mahajan, Shweta, et al.
Pubblicazione: (2025)

Multimodal Representation Learning by Alternating Unimodal Adaptation
di: Zhang, Xiaohui, et al.
Pubblicazione: (2023)

Progressive Multi-granular Alignments for Grounded Reasoning in Large Vision-Language Models
di: Le, Quang-Hung, et al.
Pubblicazione: (2024)

Enhancing Vision-Language Model with Unmasked Token Alignment
di: Liu, Jihao, et al.
Pubblicazione: (2024)

Focus on What Matters: Enhancing Medical Vision-Language Models with Automatic Attention Alignment Tuning
di: Chang, Aofei, et al.
Pubblicazione: (2025)

An Examination of the Robustness of Reference-Free Image Captioning Evaluation Metrics
di: Ahmadi, Saba, et al.
Pubblicazione: (2023)

Application Of Vision-Language Models For Assessing Osteoarthritis Disease Severity
di: Felfeliyan, Banafshe, et al.
Pubblicazione: (2024)

Improving Concept Alignment in Vision-Language Concept Bottleneck Models
di: Selvaraj, Nithish Muthuchamy, et al.
Pubblicazione: (2024)

Test-time Alignment-Enhanced Adapter for Vision-Language Models
di: Tong, Baoshun, et al.
Pubblicazione: (2024)

Modest-Align: Data-Efficient Alignment for Vision-Language Models
di: Liu, Jiaxiang, et al.
Pubblicazione: (2025)

Ultrasound Vision-Language Alignment via Contrastive Learning
di: Lyu, Zhuoyang, et al.
Pubblicazione: (2026)

MarineEval: Assessing the Marine Intelligence of Vision-Language Models
di: Wong, YuK-Kwan, et al.
Pubblicazione: (2025)

Few-Shot Learning from Gigapixel Images via Hierarchical Vision-Language Alignment and Modeling
di: Wong, Bryan, et al.
Pubblicazione: (2025)

Language-Guided Token Compression with Reinforcement Learning in Large Vision-Language Models
di: Cao, Sihan, et al.
Pubblicazione: (2026)

Robo-MUTUAL: Robotic Multimodal Task Specification via Unimodal Learning
di: Li, Jianxiong, et al.
Pubblicazione: (2024)