Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2506.03607 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918045427957760 |
|---|---|
| author | Kwok, Wing Man Casca Tung, Yip Chiu Bhagchandani, Kunal |
| author_facet | Kwok, Wing Man Casca Tung, Yip Chiu Bhagchandani, Kunal |
| contents | Edge computing decentralizes processing power to network edge, enabling real-time AI-driven decision-making in IoT applications. In industrial automation such as robotics and rugged edge AI, real-time perception and intelligence are critical for autonomous operations. Deploying transformer-based image captioning models at the edge can enhance machine perception, improve scene understanding for autonomous robots, and aid in industrial inspection.
However, these edge or IoT devices are often constrained in computational resources for physical agility, yet they have strict response time requirements. Traditional deep learning models can be too large and computationally demanding for these devices. In this research, we present findings of transformer-based models for image captioning that operate effectively on edge devices. By evaluating resource-effective transformer models and applying knowledge distillation techniques, we demonstrate inference can be accelerated on resource-constrained devices while maintaining model performance using these techniques. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_03607 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Analyzing Transformer Models and Knowledge Distillation Approaches for Image Captioning on Edge AI Kwok, Wing Man Casca Tung, Yip Chiu Bhagchandani, Kunal Computer Vision and Pattern Recognition Edge computing decentralizes processing power to network edge, enabling real-time AI-driven decision-making in IoT applications. In industrial automation such as robotics and rugged edge AI, real-time perception and intelligence are critical for autonomous operations. Deploying transformer-based image captioning models at the edge can enhance machine perception, improve scene understanding for autonomous robots, and aid in industrial inspection. However, these edge or IoT devices are often constrained in computational resources for physical agility, yet they have strict response time requirements. Traditional deep learning models can be too large and computationally demanding for these devices. In this research, we present findings of transformer-based models for image captioning that operate effectively on edge devices. By evaluating resource-effective transformer models and applying knowledge distillation techniques, we demonstrate inference can be accelerated on resource-constrained devices while maintaining model performance using these techniques. |
| title | Analyzing Transformer Models and Knowledge Distillation Approaches for Image Captioning on Edge AI |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2506.03607 |