CognArtive: Large Language Models for Automating Art Analysis and Decoding Aesthetic Elements

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Khadangi, Afshin, Sartipi, Amir, Tchappi, Igor, Fridgen, Gilbert
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913681827168256
author Khadangi, Afshin
Sartipi, Amir
Tchappi, Igor
Fridgen, Gilbert
author_facet Khadangi, Afshin
Sartipi, Amir
Tchappi, Igor
Fridgen, Gilbert
contents Art, as a universal language, can be interpreted in diverse ways, with artworks embodying profound meanings and nuances. The advent of Large Language Models (LLMs) and the availability of Multimodal Large Language Models (MLLMs) raise the question of how these transformative models can be used to assess and interpret the artistic elements of artworks. While research has been conducted in this domain, to the best of our knowledge, a deep and detailed understanding of the technical and expressive features of artworks using LLMs has not been explored. In this study, we investigate the automation of a formal art analysis framework to analyze a high-throughput number of artworks rapidly and examine how their patterns evolve over time. We explore how LLMs can decode artistic expressions, visual elements, composition, and techniques, revealing emerging patterns that develop across periods. Finally, we discuss the strengths and limitations of LLMs in this context, emphasizing their ability to process vast quantities of art-related data and generate insightful interpretations. Due to the exhaustive and granular nature of the results, we have developed interactive data visualizations, available online https://cognartive.github.io/, to enhance understanding and accessibility.
format Preprint
id arxiv_https___arxiv_org_abs_2502_04353
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CognArtive: Large Language Models for Automating Art Analysis and Decoding Aesthetic Elements
Khadangi, Afshin
Sartipi, Amir
Tchappi, Igor
Fridgen, Gilbert
Computation and Language
Artificial Intelligence
Computer Vision and Pattern Recognition
Art, as a universal language, can be interpreted in diverse ways, with artworks embodying profound meanings and nuances. The advent of Large Language Models (LLMs) and the availability of Multimodal Large Language Models (MLLMs) raise the question of how these transformative models can be used to assess and interpret the artistic elements of artworks. While research has been conducted in this domain, to the best of our knowledge, a deep and detailed understanding of the technical and expressive features of artworks using LLMs has not been explored. In this study, we investigate the automation of a formal art analysis framework to analyze a high-throughput number of artworks rapidly and examine how their patterns evolve over time. We explore how LLMs can decode artistic expressions, visual elements, composition, and techniques, revealing emerging patterns that develop across periods. Finally, we discuss the strengths and limitations of LLMs in this context, emphasizing their ability to process vast quantities of art-related data and generate insightful interpretations. Due to the exhaustive and granular nature of the results, we have developed interactive data visualizations, available online https://cognartive.github.io/, to enhance understanding and accessibility.
title CognArtive: Large Language Models for Automating Art Analysis and Decoding Aesthetic Elements
topic Computation and Language
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.04353