Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | https://arxiv.org/abs/2506.08172 |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866912422294454272 |
|---|---|
| author | Manzanarez, Gerardo Aleman Arana, Nora de la Cruz Flores, Jorge Garcia Medina, Yobany Garcia Monroy, Raul Pernelle, Nathalie |
| author_facet | Manzanarez, Gerardo Aleman Arana, Nora de la Cruz Flores, Jorge Garcia Medina, Yobany Garcia Monroy, Raul Pernelle, Nathalie |
| contents | Automated story writing has been a subject of study for over 60 years. Large language models can generate narratively consistent and linguistically coherent short fiction texts. Despite these advancements, rigorous assessment of such outputs for literary merit - especially concerning aesthetic qualities - has received scant attention. In this paper, we address the challenge of evaluating AI-generated microfictions and argue that this task requires consideration of literary criteria across various aspects of the text, such as thematic coherence, textual clarity, interpretive depth, and aesthetic quality. To facilitate this, we present GrAImes: an evaluation protocol grounded in literary theory, specifically drawing from a literary perspective, to offer an objective framework for assessing AI-generated microfiction. Furthermore, we report the results of our validation of the evaluation protocol, as answered by both literature experts and literary enthusiasts. This protocol will serve as a foundation for evaluating automatically generated microfictions and assessing their literary value. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_08172 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Can Artificial Intelligence Write Like Borges? An Evaluation Protocol for Spanish Microfiction Manzanarez, Gerardo Aleman Arana, Nora de la Cruz Flores, Jorge Garcia Medina, Yobany Garcia Monroy, Raul Pernelle, Nathalie Computation and Language Automated story writing has been a subject of study for over 60 years. Large language models can generate narratively consistent and linguistically coherent short fiction texts. Despite these advancements, rigorous assessment of such outputs for literary merit - especially concerning aesthetic qualities - has received scant attention. In this paper, we address the challenge of evaluating AI-generated microfictions and argue that this task requires consideration of literary criteria across various aspects of the text, such as thematic coherence, textual clarity, interpretive depth, and aesthetic quality. To facilitate this, we present GrAImes: an evaluation protocol grounded in literary theory, specifically drawing from a literary perspective, to offer an objective framework for assessing AI-generated microfiction. Furthermore, we report the results of our validation of the evaluation protocol, as answered by both literature experts and literary enthusiasts. This protocol will serve as a foundation for evaluating automatically generated microfictions and assessing their literary value. |
| title | Can Artificial Intelligence Write Like Borges? An Evaluation Protocol for Spanish Microfiction |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2506.08172 |