Onboard Satellite Image Classification for Earth Observation: A Comparative Study of ViT Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910915889201152 |
|---|---|
| author | Le, Thanh-Dung Ha, Vu Nguyen Nguyen, Ti Ti Eappen, Geoffrey Thiruvasagam, Prabhu Chou, Hong-fu Tran, Duc-Dung Nguyen-Kha, Hung Garces-Socarras, Luis M. Gonzalez-Rios, Jorge L. Merlano-Duncan, Juan Carlos Chatzinotas, Symeon |
| author_facet | Le, Thanh-Dung Ha, Vu Nguyen Nguyen, Ti Ti Eappen, Geoffrey Thiruvasagam, Prabhu Chou, Hong-fu Tran, Duc-Dung Nguyen-Kha, Hung Garces-Socarras, Luis M. Gonzalez-Rios, Jorge L. Merlano-Duncan, Juan Carlos Chatzinotas, Symeon |
| contents | This study focuses on identifying the most effective pre-trained model for land use classification in onboard satellite processing, emphasizing achieving high accuracy, computational efficiency, and robustness against noisy data conditions commonly encountered during satellite-based inference. Through extensive experimentation, we compare the performance of traditional CNN-based, ResNet-based, and various pre-trained vision Transformer models. Our findings demonstrate that pre-trained Vision Transformer (ViT) models, particularly MobileViTV2 and EfficientViT-M2, outperform models trained from scratch in terms of accuracy and efficiency. These models achieve high performance with reduced computational requirements and exhibit greater resilience during inference under noisy conditions. While MobileViTV2 has excelled on clean validation data, EfficientViT-M2 has proved more robust when handling noise, making it the most suitable model for onboard satellite EO tasks. Our experimental results demonstrate that EfficientViT-M2 is the optimal choice for reliable and efficient RS-IC in satellite operations, achieving 98.76 % of accuracy, precision, and recall. Precisely, EfficientViT-M2 delivers the highest performance across all metrics, excels in training efficiency (1,000s) and inference time (10s), and demonstrates greater robustness (overall robustness score of 0.79). Consequently, EfficientViT-M2 consumes 63.93 % less power than MobileViTV2 (79.23 W) and 73.26 % less power than SwinTransformer (108.90 W). This highlights its significant advantage in energy efficiency. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_03901 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Onboard Satellite Image Classification for Earth Observation: A Comparative Study of ViT Models Le, Thanh-Dung Ha, Vu Nguyen Nguyen, Ti Ti Eappen, Geoffrey Thiruvasagam, Prabhu Chou, Hong-fu Tran, Duc-Dung Nguyen-Kha, Hung Garces-Socarras, Luis M. Gonzalez-Rios, Jorge L. Merlano-Duncan, Juan Carlos Chatzinotas, Symeon Computer Vision and Pattern Recognition Signal Processing This study focuses on identifying the most effective pre-trained model for land use classification in onboard satellite processing, emphasizing achieving high accuracy, computational efficiency, and robustness against noisy data conditions commonly encountered during satellite-based inference. Through extensive experimentation, we compare the performance of traditional CNN-based, ResNet-based, and various pre-trained vision Transformer models. Our findings demonstrate that pre-trained Vision Transformer (ViT) models, particularly MobileViTV2 and EfficientViT-M2, outperform models trained from scratch in terms of accuracy and efficiency. These models achieve high performance with reduced computational requirements and exhibit greater resilience during inference under noisy conditions. While MobileViTV2 has excelled on clean validation data, EfficientViT-M2 has proved more robust when handling noise, making it the most suitable model for onboard satellite EO tasks. Our experimental results demonstrate that EfficientViT-M2 is the optimal choice for reliable and efficient RS-IC in satellite operations, achieving 98.76 % of accuracy, precision, and recall. Precisely, EfficientViT-M2 delivers the highest performance across all metrics, excels in training efficiency (1,000s) and inference time (10s), and demonstrates greater robustness (overall robustness score of 0.79). Consequently, EfficientViT-M2 consumes 63.93 % less power than MobileViTV2 (79.23 W) and 73.26 % less power than SwinTransformer (108.90 W). This highlights its significant advantage in energy efficiency. |
| title | Onboard Satellite Image Classification for Earth Observation: A Comparative Study of ViT Models |
| topic | Computer Vision and Pattern Recognition Signal Processing |
| url | https://arxiv.org/abs/2409.03901 |