Augmented Vision-Language Models: A Systematic Review

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Davis, Anthony C, Sadiq, Burhan, Shu, Tianmin, Huang, Chien-Ming
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916872158445568
author Davis, Anthony C
Sadiq, Burhan
Shu, Tianmin
Huang, Chien-Ming
author_facet Davis, Anthony C
Sadiq, Burhan
Shu, Tianmin
Huang, Chien-Ming
contents Recent advances in visual-language machine learning models have demonstrated exceptional ability to use natural language and understand visual scenes by training on large, unstructured datasets. However, this training paradigm cannot produce interpretable explanations for its outputs, requires retraining to integrate new information, is highly resource-intensive, and struggles with certain forms of logical reasoning. One promising solution involves integrating neural networks with external symbolic information systems, forming neural symbolic systems that can enhance reasoning and memory abilities. These neural symbolic systems provide more interpretable explanations to their outputs and the capacity to assimilate new information without extensive retraining. Utilizing powerful pre-trained Vision-Language Models (VLMs) as the core neural component, augmented by external systems, offers a pragmatic approach to realizing the benefits of neural-symbolic integration. This systematic literature review aims to categorize techniques through which visual-language understanding can be improved by interacting with external symbolic information systems.
format Preprint
id arxiv_https___arxiv_org_abs_2507_22933
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Augmented Vision-Language Models: A Systematic Review
Davis, Anthony C
Sadiq, Burhan
Shu, Tianmin
Huang, Chien-Ming
Computation and Language
Artificial Intelligence
Recent advances in visual-language machine learning models have demonstrated exceptional ability to use natural language and understand visual scenes by training on large, unstructured datasets. However, this training paradigm cannot produce interpretable explanations for its outputs, requires retraining to integrate new information, is highly resource-intensive, and struggles with certain forms of logical reasoning. One promising solution involves integrating neural networks with external symbolic information systems, forming neural symbolic systems that can enhance reasoning and memory abilities. These neural symbolic systems provide more interpretable explanations to their outputs and the capacity to assimilate new information without extensive retraining. Utilizing powerful pre-trained Vision-Language Models (VLMs) as the core neural component, augmented by external systems, offers a pragmatic approach to realizing the benefits of neural-symbolic integration. This systematic literature review aims to categorize techniques through which visual-language understanding can be improved by interacting with external symbolic information systems.
title Augmented Vision-Language Models: A Systematic Review
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2507.22933