AC-Lite : A Lightweight Image Captioning Model for Low-Resource Assamese Language

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Choudhury, Pankaj, Aggarwal, Yogesh, Jadhav, Prabhanjan, Guha, Prithwijit, Nandi, Sukumar
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912354297446400
author Choudhury, Pankaj
Aggarwal, Yogesh
Jadhav, Prabhanjan
Guha, Prithwijit
Nandi, Sukumar
author_facet Choudhury, Pankaj
Aggarwal, Yogesh
Jadhav, Prabhanjan
Guha, Prithwijit
Nandi, Sukumar
contents Most existing works in image caption synthesis use computation heavy deep neural networks and generates image descriptions in English language. This often restricts this important assistive tool for widespread use across language and accessibility barriers. This work presents AC-Lite, a computationally efficient model for image captioning in low-resource Assamese language. AC-Lite reduces computational requirements by replacing computation-heavy deep network components with lightweight alternatives. The AC-Lite model is designed through extensive ablation experiments with different image feature extractor networks and language decoders. A combination of ShuffleNetv2x1.5 with GRU based language decoder along with bilinear attention is found to provide the best performance with minimum compute. AC-Lite was observed to achieve an 82.3 CIDEr score on the COCO-AC dataset with 2.45 GFLOPs and 22.87M parameters.
format Preprint
id arxiv_https___arxiv_org_abs_2503_01453
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AC-Lite : A Lightweight Image Captioning Model for Low-Resource Assamese Language
Choudhury, Pankaj
Aggarwal, Yogesh
Jadhav, Prabhanjan
Guha, Prithwijit
Nandi, Sukumar
Computer Vision and Pattern Recognition
Artificial Intelligence
Computation and Language
Most existing works in image caption synthesis use computation heavy deep neural networks and generates image descriptions in English language. This often restricts this important assistive tool for widespread use across language and accessibility barriers. This work presents AC-Lite, a computationally efficient model for image captioning in low-resource Assamese language. AC-Lite reduces computational requirements by replacing computation-heavy deep network components with lightweight alternatives. The AC-Lite model is designed through extensive ablation experiments with different image feature extractor networks and language decoders. A combination of ShuffleNetv2x1.5 with GRU based language decoder along with bilinear attention is found to provide the best performance with minimum compute. AC-Lite was observed to achieve an 82.3 CIDEr score on the COCO-AC dataset with 2.45 GFLOPs and 22.87M parameters.
title AC-Lite : A Lightweight Image Captioning Model for Low-Resource Assamese Language
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2503.01453