On the Efficiency and Robustness of Vibration-based Foundation Models for IoT Sensing: A Case Study
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866914739481739264 |
|---|---|
| author | Kimura, Tomoyoshi Li, Jinyang Wang, Tianshi Kara, Denizhan Chen, Yizhuo Hu, Yigong Wang, Ruijie Wigness, Maggie Liu, Shengzhong Srivastava, Mani Diggavi, Suhas Abdelzaher, Tarek |
| author_facet | Kimura, Tomoyoshi Li, Jinyang Wang, Tianshi Kara, Denizhan Chen, Yizhuo Hu, Yigong Wang, Ruijie Wigness, Maggie Liu, Shengzhong Srivastava, Mani Diggavi, Suhas Abdelzaher, Tarek |
| contents | This paper demonstrates the potential of vibration-based Foundation Models (FMs), pre-trained with unlabeled sensing data, to improve the robustness of run-time inference in (a class of) IoT applications. A case study is presented featuring a vehicle classification application using acoustic and seismic sensing. The work is motivated by the success of foundation models in the areas of natural language processing and computer vision, leading to generalizations of the FM concept to other domains as well, where significant amounts of unlabeled data exist that can be used for self-supervised pre-training. One such domain is IoT applications. Foundation models for selected sensing modalities in the IoT domain can be pre-trained in an environment-agnostic fashion using available unlabeled sensor data and then fine-tuned to the deployment at hand using a small amount of labeled data. The paper shows that the pre-training/fine-tuning approach improves the robustness of downstream inference and facilitates adaptation to different environmental conditions. More specifically, we present a case study in a real-world setting to evaluate a simple (vibration-based) FM-like model, called FOCAL, demonstrating its superior robustness and adaptation, compared to conventional supervised deep neural networks (DNNs). We also demonstrate its superior convergence over supervised solutions. Our findings highlight the advantages of vibration-based FMs (and FM-inspired selfsupervised models in general) in terms of inference robustness, runtime efficiency, and model adaptation (via fine-tuning) in resource-limited IoT settings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_02461 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | On the Efficiency and Robustness of Vibration-based Foundation Models for IoT Sensing: A Case Study Kimura, Tomoyoshi Li, Jinyang Wang, Tianshi Kara, Denizhan Chen, Yizhuo Hu, Yigong Wang, Ruijie Wigness, Maggie Liu, Shengzhong Srivastava, Mani Diggavi, Suhas Abdelzaher, Tarek Machine Learning Signal Processing This paper demonstrates the potential of vibration-based Foundation Models (FMs), pre-trained with unlabeled sensing data, to improve the robustness of run-time inference in (a class of) IoT applications. A case study is presented featuring a vehicle classification application using acoustic and seismic sensing. The work is motivated by the success of foundation models in the areas of natural language processing and computer vision, leading to generalizations of the FM concept to other domains as well, where significant amounts of unlabeled data exist that can be used for self-supervised pre-training. One such domain is IoT applications. Foundation models for selected sensing modalities in the IoT domain can be pre-trained in an environment-agnostic fashion using available unlabeled sensor data and then fine-tuned to the deployment at hand using a small amount of labeled data. The paper shows that the pre-training/fine-tuning approach improves the robustness of downstream inference and facilitates adaptation to different environmental conditions. More specifically, we present a case study in a real-world setting to evaluate a simple (vibration-based) FM-like model, called FOCAL, demonstrating its superior robustness and adaptation, compared to conventional supervised deep neural networks (DNNs). We also demonstrate its superior convergence over supervised solutions. Our findings highlight the advantages of vibration-based FMs (and FM-inspired selfsupervised models in general) in terms of inference robustness, runtime efficiency, and model adaptation (via fine-tuning) in resource-limited IoT settings. |
| title | On the Efficiency and Robustness of Vibration-based Foundation Models for IoT Sensing: A Case Study |
| topic | Machine Learning Signal Processing |
| url | https://arxiv.org/abs/2404.02461 |