Imagen de Portada

Revisiting Image Captioning Training Paradigm via Direct CLIP-based Optimization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Moratelli, Nicholas, Caffagni, Davide, Cornia, Marcella, Baraldi, Lorenzo, Cucchiara, Rita
Formato:	Preprint
Publicado:	2024
Materias:	Computer Vision and Pattern Recognition Artificial Intelligence Computation and Language Multimedia
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Mitigating Hallucinations in Multimodal LLMs via Object-aware Preference Optimization
por: Compagnoni, Alberto, et al.
Publicado: (2025)

Personalizing Multimodal Large Language Models for Image Captioning: An Experimental Analysis
por: Bucciarelli, Davide, et al.
Publicado: (2024)

LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning
por: Cocchi, Federico, et al.
Publicado: (2025)

Wiki-LLaVA: Hierarchical Retrieval-Augmented Generation for Multimodal LLMs
por: Caffagni, Davide, et al.
Publicado: (2024)

Positive-Augmented Contrastive Learning for Vision-and-Language Evaluation and Training
por: Sarto, Sara, et al.
Publicado: (2024)

Augmenting Multimodal LLMs with Self-Reflective Tokens for Knowledge-based Visual Question Answering
por: Cocchi, Federico, et al.
Publicado: (2024)

Recurrence-Enhanced Vision-and-Language Transformers for Robust Multimodal Document Retrieval
por: Caffagni, Davide, et al.
Publicado: (2025)

Recurrence Meets Transformers for Universal Multimodal Retrieval
por: Caffagni, Davide, et al.
Publicado: (2025)

The Revolution of Multimodal Large Language Models: A Survey
por: Caffagni, Davide, et al.
Publicado: (2024)

BRIDGE: Bridging Gaps in Image Captioning Evaluation with Stronger Visual Cues
por: Sarto, Sara, et al.
Publicado: (2024)

Towards Retrieval-Augmented Architectures for Image Captioning
por: Sarto, Sara, et al.
Publicado: (2024)

Fluent and Accurate Image Captioning with a Self-Trained Reward Model
por: Moratelli, Nicholas, et al.
Publicado: (2024)

ReAG: Reasoning-Augmented Generation for Knowledge-based Visual Question Answering
por: Compagnoni, Alberto, et al.
Publicado: (2025)

What Changed? Detecting and Evaluating Instruction-Guided Image Edits with Multimodal Large Language Models
por: Baraldi, Lorenzo, et al.
Publicado: (2025)

Safe-CLIP: Removing NSFW Concepts from Vision-and-Language Models
por: Poppi, Samuele, et al.
Publicado: (2023)

RaTA-Tool: Retrieval-based Tool Selection with Multimodal Large Language Models
por: Mattioli, Gabriele, et al.
Publicado: (2026)

Seeing Beyond Words: Self-Supervised Visual Learning for Multimodal Large Language Models
por: Caffagni, Davide, et al.
Publicado: (2025)

Causal Graphical Models for Vision-Language Compositional Understanding
por: Parascandolo, Fiorenzo, et al.
Publicado: (2024)

Learning to Mask and Permute Visual Tokens for Vision Transformer Pre-Training
por: Baraldi, Lorenzo, et al.
Publicado: (2023)

Tiny Inference-Time Scaling with Latent Verifiers
por: Bucciarelli, Davide, et al.
Publicado: (2026)

Contrasting Deepfakes Diffusion via Contrastive Learning and Global-Local Similarities
por: Baraldi, Lorenzo, et al.
Publicado: (2024)

Parents and Children: Distinguishing Multimodal DeepFakes from Natural Images
por: Amoroso, Roberto, et al.
Publicado: (2023)

Fashion-RAG: Multimodal Fashion Image Editing via Retrieval-Augmented Generation
por: Sanguigni, Fulvio, et al.
Publicado: (2025)

CounterVid: Counterfactual Video Generation for Mitigating Action and Temporal Hallucinations in Video-Language Models
por: Poppi, Tobia, et al.
Publicado: (2026)

Image Captioning Evaluation in the Age of Multimodal LLMs: Challenges and Future Perspectives
por: Sarto, Sara, et al.
Publicado: (2025)

Hyperbolic Safety-Aware Vision-Language Models
por: Poppi, Tobia, et al.
Publicado: (2025)

Few Channels Draw The Whole Picture: Revealing Massive Activations in Diffusion Transformers
por: Turri, Evelyn, et al.
Publicado: (2026)

Embodied Agents for Efficient Exploration and Smart Scene Description
por: Bigazzi, Roberto, et al.
Publicado: (2023)

Training-Free Open-Vocabulary Segmentation with Offline Diffusion-Augmented Prototype Generation
por: Barsellotti, Luca, et al.
Publicado: (2024)

Explore and Explain: Self-supervised Navigation and Recounting
por: Bigazzi, Roberto, et al.
Publicado: (2020)

Multi-Class Unlearning for Image Classification via Weight Filtering
por: Poppi, Samuele, et al.
Publicado: (2023)

Personalized Instance-based Navigation Toward User-Specific Objects in Realistic Environments
por: Barsellotti, Luca, et al.
Publicado: (2024)

Look Twice: Training-Free Evidence Highlighting in Multimodal Large Language Models
por: Morini, Marco, et al.
Publicado: (2026)

See or Guess: Counterfactually Regularized Image Captioning
por: Cao, Qian, et al.
Publicado: (2024)

Talking to DINO: Bridging Self-Supervised Vision Backbones with Language for Open-Vocabulary Segmentation
por: Barsellotti, Luca, et al.
Publicado: (2024)

Alfie: Democratising RGBA Image Generation With No $$$
por: Quattrini, Fabio, et al.
Publicado: (2024)

DetailVerifyBench: A Benchmark for Dense Hallucination Localization in Long Image Captions
por: Wang, Xinran, et al.
Publicado: (2026)

VideoCLIP-XL: Advancing Long Description Understanding for Video CLIP Models
por: Wang, Jiapeng, et al.
Publicado: (2024)

Unleashing Text-to-Image Diffusion Prior for Zero-Shot Image Captioning
por: Luo, Jianjie, et al.
Publicado: (2024)

CLIP as RNN: Segment Countless Visual Concepts without Training Endeavor
por: Sun, Shuyang, et al.
Publicado: (2023)