Multi-Stream Cellular Test-Time Adaptation of Real-Time Models Evolving in Dynamic Environments
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909497026412544 |
|---|---|
| author | Gérin, Benoît Halin, Anaïs Cioppa, Anthony Henry, Maxim Ghanem, Bernard Macq, Benoît De Vleeschouwer, Christophe Van Droogenbroeck, Marc |
| author_facet | Gérin, Benoît Halin, Anaïs Cioppa, Anthony Henry, Maxim Ghanem, Bernard Macq, Benoît De Vleeschouwer, Christophe Van Droogenbroeck, Marc |
| contents | In the era of the Internet of Things (IoT), objects connect through a dynamic network, empowered by technologies like 5G, enabling real-time data sharing. However, smart objects, notably autonomous vehicles, face challenges in critical local computations due to limited resources. Lightweight AI models offer a solution but struggle with diverse data distributions. To address this limitation, we propose a novel Multi-Stream Cellular Test-Time Adaptation (MSC-TTA) setup where models adapt on the fly to a dynamic environment divided into cells. Then, we propose a real-time adaptive student-teacher method that leverages the multiple streams available in each cell to quickly adapt to changing data distributions. We validate our methodology in the context of autonomous vehicles navigating across cells defined based on location and weather conditions. To facilitate future benchmarking, we release a new multi-stream large-scale synthetic semantic segmentation dataset, called DADE, and show that our multi-stream approach outperforms a single-stream baseline. We believe that our work will open research opportunities in the IoT and 5G eras, offering solutions for real-time model adaptation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_17930 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Multi-Stream Cellular Test-Time Adaptation of Real-Time Models Evolving in Dynamic Environments Gérin, Benoît Halin, Anaïs Cioppa, Anthony Henry, Maxim Ghanem, Bernard Macq, Benoît De Vleeschouwer, Christophe Van Droogenbroeck, Marc Computer Vision and Pattern Recognition Artificial Intelligence Image and Video Processing In the era of the Internet of Things (IoT), objects connect through a dynamic network, empowered by technologies like 5G, enabling real-time data sharing. However, smart objects, notably autonomous vehicles, face challenges in critical local computations due to limited resources. Lightweight AI models offer a solution but struggle with diverse data distributions. To address this limitation, we propose a novel Multi-Stream Cellular Test-Time Adaptation (MSC-TTA) setup where models adapt on the fly to a dynamic environment divided into cells. Then, we propose a real-time adaptive student-teacher method that leverages the multiple streams available in each cell to quickly adapt to changing data distributions. We validate our methodology in the context of autonomous vehicles navigating across cells defined based on location and weather conditions. To facilitate future benchmarking, we release a new multi-stream large-scale synthetic semantic segmentation dataset, called DADE, and show that our multi-stream approach outperforms a single-stream baseline. We believe that our work will open research opportunities in the IoT and 5G eras, offering solutions for real-time model adaptation. |
| title | Multi-Stream Cellular Test-Time Adaptation of Real-Time Models Evolving in Dynamic Environments |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Image and Video Processing |
| url | https://arxiv.org/abs/2404.17930 |