CNNtention: Can CNNs do better with Attention?
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866908172847939584 |
|---|---|
| author | Kapila, Nikhil Glattki, Julian Rathi, Tejas |
| author_facet | Kapila, Nikhil Glattki, Julian Rathi, Tejas |
| contents | Convolutional Neural Networks (CNNs) have been the standard for image classification tasks for a long time, but more recently attention-based mechanisms have gained traction. This project aims to compare traditional CNNs with attention-augmented CNNs across an image classification task. By evaluating and comparing their performance, accuracy and computational efficiency, the project will highlight benefits and trade-off of the localized feature extraction of traditional CNNs and the global context capture in attention-augmented CNNs. By doing this, we can reveal further insights into their respective strengths and weaknesses, guide the selection of models based on specific application needs and ultimately, enhance understanding of these architectures in the deep learning community.
This was our final project for CS7643 Deep Learning course at Georgia Tech. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_11657 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CNNtention: Can CNNs do better with Attention? Kapila, Nikhil Glattki, Julian Rathi, Tejas Computer Vision and Pattern Recognition Machine Learning 68T45 (Primary), 68T07 (Secondary) Convolutional Neural Networks (CNNs) have been the standard for image classification tasks for a long time, but more recently attention-based mechanisms have gained traction. This project aims to compare traditional CNNs with attention-augmented CNNs across an image classification task. By evaluating and comparing their performance, accuracy and computational efficiency, the project will highlight benefits and trade-off of the localized feature extraction of traditional CNNs and the global context capture in attention-augmented CNNs. By doing this, we can reveal further insights into their respective strengths and weaknesses, guide the selection of models based on specific application needs and ultimately, enhance understanding of these architectures in the deep learning community. This was our final project for CS7643 Deep Learning course at Georgia Tech. |
| title | CNNtention: Can CNNs do better with Attention? |
| topic | Computer Vision and Pattern Recognition Machine Learning 68T45 (Primary), 68T07 (Secondary) |
| url | https://arxiv.org/abs/2412.11657 |