Beyond RNNs: Benchmarking Attention-Based Image Captioning Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915173420236800 |
|---|---|
| author | Yanambakkam, Hemanth Teja Chinthala, Rahul |
| author_facet | Yanambakkam, Hemanth Teja Chinthala, Rahul |
| contents | Image captioning is a challenging task at the intersection of computer vision and natural language processing, requiring models to generate meaningful textual descriptions of images. Traditional approaches rely on recurrent neural networks (RNNs), but recent advancements in attention mechanisms have demonstrated significant improvements. This study benchmarks the performance of attention-based image captioning models against RNN-based approaches using the MS-COCO dataset. We evaluate the effectiveness of Bahdanau attention in enhancing the alignment between image features and generated captions. The models are assessed using natural language processing metrics such as BLEU, METEOR, GLEU, and WER. Our results show that attention-based models outperform RNNs in generating more accurate and semantically rich captions, with better alignment to human evaluation. This work provides insights into the impact of attention mechanisms in image captioning and highlights areas for future improvements. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_18734 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Beyond RNNs: Benchmarking Attention-Based Image Captioning Models Yanambakkam, Hemanth Teja Chinthala, Rahul Computer Vision and Pattern Recognition Computation and Language 68T45, 68T50 I.2.10; I.2.7; I.4.8 Image captioning is a challenging task at the intersection of computer vision and natural language processing, requiring models to generate meaningful textual descriptions of images. Traditional approaches rely on recurrent neural networks (RNNs), but recent advancements in attention mechanisms have demonstrated significant improvements. This study benchmarks the performance of attention-based image captioning models against RNN-based approaches using the MS-COCO dataset. We evaluate the effectiveness of Bahdanau attention in enhancing the alignment between image features and generated captions. The models are assessed using natural language processing metrics such as BLEU, METEOR, GLEU, and WER. Our results show that attention-based models outperform RNNs in generating more accurate and semantically rich captions, with better alignment to human evaluation. This work provides insights into the impact of attention mechanisms in image captioning and highlights areas for future improvements. |
| title | Beyond RNNs: Benchmarking Attention-Based Image Captioning Models |
| topic | Computer Vision and Pattern Recognition Computation and Language 68T45, 68T50 I.2.10; I.2.7; I.4.8 |
| url | https://arxiv.org/abs/2502.18734 |