NC-TTT: A Noise Contrastive Approach for Test-Time Training
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913311535136768 |
|---|---|
| author | Osowiechi, David Hakim, Gustavo A. Vargas Noori, Mehrdad Cheraghalikhani, Milad Bahri, Ali Yazdanpanah, Moslem Ayed, Ismail Ben Desrosiers, Christian |
| author_facet | Osowiechi, David Hakim, Gustavo A. Vargas Noori, Mehrdad Cheraghalikhani, Milad Bahri, Ali Yazdanpanah, Moslem Ayed, Ismail Ben Desrosiers, Christian |
| contents | Despite their exceptional performance in vision tasks, deep learning models often struggle when faced with domain shifts during testing. Test-Time Training (TTT) methods have recently gained popularity by their ability to enhance the robustness of models through the addition of an auxiliary objective that is jointly optimized with the main task. Being strictly unsupervised, this auxiliary objective is used at test time to adapt the model without any access to labels. In this work, we propose Noise-Contrastive Test-Time Training (NC-TTT), a novel unsupervised TTT technique based on the discrimination of noisy feature maps. By learning to classify noisy views of projected feature maps, and then adapting the model accordingly on new domains, classification performance can be recovered by an important margin. Experiments on several popular test-time adaptation baselines demonstrate the advantages of our method compared to recent approaches for this task. The code can be found at:https://github.com/GustavoVargasHakim/NCTTT.git |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_08392 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | NC-TTT: A Noise Contrastive Approach for Test-Time Training Osowiechi, David Hakim, Gustavo A. Vargas Noori, Mehrdad Cheraghalikhani, Milad Bahri, Ali Yazdanpanah, Moslem Ayed, Ismail Ben Desrosiers, Christian Computer Vision and Pattern Recognition Machine Learning Despite their exceptional performance in vision tasks, deep learning models often struggle when faced with domain shifts during testing. Test-Time Training (TTT) methods have recently gained popularity by their ability to enhance the robustness of models through the addition of an auxiliary objective that is jointly optimized with the main task. Being strictly unsupervised, this auxiliary objective is used at test time to adapt the model without any access to labels. In this work, we propose Noise-Contrastive Test-Time Training (NC-TTT), a novel unsupervised TTT technique based on the discrimination of noisy feature maps. By learning to classify noisy views of projected feature maps, and then adapting the model accordingly on new domains, classification performance can be recovered by an important margin. Experiments on several popular test-time adaptation baselines demonstrate the advantages of our method compared to recent approaches for this task. The code can be found at:https://github.com/GustavoVargasHakim/NCTTT.git |
| title | NC-TTT: A Noise Contrastive Approach for Test-Time Training |
| topic | Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2404.08392 |