Imagen de Portada

The Revolution of Multimodal Large Language Models: A Survey

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Caffagni, Davide, Cocchi, Federico, Barsellotti, Luca, Moratelli, Nicholas, Sarto, Sara, Baraldi, Lorenzo, Cornia, Marcella, Cucchiara, Rita
Formato:	Preprint
Publicado:	2024
Materias:	Computer Vision and Pattern Recognition Artificial Intelligence Computation and Language Multimedia
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Wiki-LLaVA: Hierarchical Retrieval-Augmented Generation for Multimodal LLMs
por: Caffagni, Davide, et al.
Publicado: (2024)

LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning
por: Cocchi, Federico, et al.
Publicado: (2025)

Recurrence-Enhanced Vision-and-Language Transformers for Robust Multimodal Document Retrieval
por: Caffagni, Davide, et al.
Publicado: (2025)

Recurrence Meets Transformers for Universal Multimodal Retrieval
por: Caffagni, Davide, et al.
Publicado: (2025)

Augmenting Multimodal LLMs with Self-Reflective Tokens for Knowledge-based Visual Question Answering
por: Cocchi, Federico, et al.
Publicado: (2024)

Revisiting Image Captioning Training Paradigm via Direct CLIP-based Optimization
por: Moratelli, Nicholas, et al.
Publicado: (2024)

Positive-Augmented Contrastive Learning for Vision-and-Language Evaluation and Training
por: Sarto, Sara, et al.
Publicado: (2024)

Personalizing Multimodal Large Language Models for Image Captioning: An Experimental Analysis
por: Bucciarelli, Davide, et al.
Publicado: (2024)

Mitigating Hallucinations in Multimodal LLMs via Object-aware Preference Optimization
por: Compagnoni, Alberto, et al.
Publicado: (2025)

RaTA-Tool: Retrieval-based Tool Selection with Multimodal Large Language Models
por: Mattioli, Gabriele, et al.
Publicado: (2026)

ReAG: Reasoning-Augmented Generation for Knowledge-based Visual Question Answering
por: Compagnoni, Alberto, et al.
Publicado: (2025)

BRIDGE: Bridging Gaps in Image Captioning Evaluation with Stronger Visual Cues
por: Sarto, Sara, et al.
Publicado: (2024)

What Changed? Detecting and Evaluating Instruction-Guided Image Edits with Multimodal Large Language Models
por: Baraldi, Lorenzo, et al.
Publicado: (2025)

Seeing Beyond Words: Self-Supervised Visual Learning for Multimodal Large Language Models
por: Caffagni, Davide, et al.
Publicado: (2025)

Towards Retrieval-Augmented Architectures for Image Captioning
por: Sarto, Sara, et al.
Publicado: (2024)

Safe-CLIP: Removing NSFW Concepts from Vision-and-Language Models
por: Poppi, Samuele, et al.
Publicado: (2023)

Contrasting Deepfakes Diffusion via Contrastive Learning and Global-Local Similarities
por: Baraldi, Lorenzo, et al.
Publicado: (2024)

Tiny Inference-Time Scaling with Latent Verifiers
por: Bucciarelli, Davide, et al.
Publicado: (2026)

Causal Graphical Models for Vision-Language Compositional Understanding
por: Parascandolo, Fiorenzo, et al.
Publicado: (2024)

Learning to Mask and Permute Visual Tokens for Vision Transformer Pre-Training
por: Baraldi, Lorenzo, et al.
Publicado: (2023)

Few Channels Draw The Whole Picture: Revealing Massive Activations in Diffusion Transformers
por: Turri, Evelyn, et al.
Publicado: (2026)

Fluent and Accurate Image Captioning with a Self-Trained Reward Model
por: Moratelli, Nicholas, et al.
Publicado: (2024)

Look Twice: Training-Free Evidence Highlighting in Multimodal Large Language Models
por: Morini, Marco, et al.
Publicado: (2026)

Parents and Children: Distinguishing Multimodal DeepFakes from Natural Images
por: Amoroso, Roberto, et al.
Publicado: (2023)

Training-Free Open-Vocabulary Segmentation with Offline Diffusion-Augmented Prototype Generation
por: Barsellotti, Luca, et al.
Publicado: (2024)

Personalized Instance-based Navigation Toward User-Specific Objects in Realistic Environments
por: Barsellotti, Luca, et al.
Publicado: (2024)

Talking to DINO: Bridging Self-Supervised Vision Backbones with Language for Open-Vocabulary Segmentation
por: Barsellotti, Luca, et al.
Publicado: (2024)

Hyperbolic Safety-Aware Vision-Language Models
por: Poppi, Tobia, et al.
Publicado: (2025)

CounterVid: Counterfactual Video Generation for Mitigating Action and Temporal Hallucinations in Video-Language Models
por: Poppi, Tobia, et al.
Publicado: (2026)

Image Captioning Evaluation in the Age of Multimodal LLMs: Challenges and Future Perspectives
por: Sarto, Sara, et al.
Publicado: (2025)

Multi-Class Unlearning for Image Classification via Weight Filtering
por: Poppi, Samuele, et al.
Publicado: (2023)

Fashion-RAG: Multimodal Fashion Image Editing via Retrieval-Augmented Generation
por: Sanguigni, Fulvio, et al.
Publicado: (2025)

Embodied Agents for Efficient Exploration and Smart Scene Description
por: Bigazzi, Roberto, et al.
Publicado: (2023)

Explore and Explain: Self-supervised Navigation and Recounting
por: Bigazzi, Roberto, et al.
Publicado: (2020)

Harnessing Self-Supervised Features for Art Classification
por: Melis, Federico, et al.
Publicado: (2026)

Optimizing Resource Consumption in Diffusion Models through Hallucination Early Detection
por: Betti, Federico, et al.
Publicado: (2024)

Hallucination Early Detection in Diffusion Models
por: Betti, Federico, et al.
Publicado: (2026)

Spot the Difference: A Novel Task for Embodied Agents in Changing Environments
por: Landi, Federico, et al.
Publicado: (2022)

Embodied Navigation at the Art Gallery
por: Bigazzi, Roberto, et al.
Publicado: (2022)

RAID: A Dataset for Testing the Adversarial Robustness of AI-Generated Image Detectors
por: Eddoubi, Hicham, et al.
Publicado: (2025)