Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | https://arxiv.org/abs/2507.16696 |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866908830688870400 |
|---|---|
| author | Fan, Pingyi Jiang, Anbai Zhang, Shuwei Lv, Zhiqiang Han, Bing Zheng, Xinhu Liang, Wenrui Li, Junjie Zhang, Wei-Qiang Qian, Yanmin Chen, Xie Lu, Cheng Liu, Jia |
| author_facet | Fan, Pingyi Jiang, Anbai Zhang, Shuwei Lv, Zhiqiang Han, Bing Zheng, Xinhu Liang, Wenrui Li, Junjie Zhang, Wei-Qiang Qian, Yanmin Chen, Xie Lu, Cheng Liu, Jia |
| contents | With the rapid deployment of SCADA systems, how to effectively analyze industrial signals and detect abnormal states is an urgent need for the industry. Due to the significant heterogeneity of these signals, which we summarize as the M5 problem, previous works only focus on small sub-problems and employ specialized models, failing to utilize the synergies between modalities and the powerful scaling law. However, we argue that the M5 signals can be modeled in a unified manner due to the intrinsic similarity. As a result, we propose FISHER, a Foundation model for multi-modal Industrial Signal compreHEnsive Representation. To support arbitrary sampling rates, FISHER considers the increment of sampling rate as the concatenation of sub-band information. Specifically, FISHER takes the STFT sub-band as the modeling unit and adopts a teacher student SSL framework for pre-training. We also develop the RMIS benchmark, which evaluates the representations of M5 industrial signals on multiple health management tasks. Compared with top SSL models, FISHER showcases versatile and outstanding capabilities with a general performance gain up to 4.2%, along with much more efficient scaling curves. We also investigate the scaling law on downstream tasks and derive potential avenues for future work. Both FISHER and RMIS are now open-sourced. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_16696 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | FISHER: A Foundation Model for Multi-Modal Industrial Signal Comprehensive Representation Fan, Pingyi Jiang, Anbai Zhang, Shuwei Lv, Zhiqiang Han, Bing Zheng, Xinhu Liang, Wenrui Li, Junjie Zhang, Wei-Qiang Qian, Yanmin Chen, Xie Lu, Cheng Liu, Jia Machine Learning Artificial Intelligence Multimedia Sound With the rapid deployment of SCADA systems, how to effectively analyze industrial signals and detect abnormal states is an urgent need for the industry. Due to the significant heterogeneity of these signals, which we summarize as the M5 problem, previous works only focus on small sub-problems and employ specialized models, failing to utilize the synergies between modalities and the powerful scaling law. However, we argue that the M5 signals can be modeled in a unified manner due to the intrinsic similarity. As a result, we propose FISHER, a Foundation model for multi-modal Industrial Signal compreHEnsive Representation. To support arbitrary sampling rates, FISHER considers the increment of sampling rate as the concatenation of sub-band information. Specifically, FISHER takes the STFT sub-band as the modeling unit and adopts a teacher student SSL framework for pre-training. We also develop the RMIS benchmark, which evaluates the representations of M5 industrial signals on multiple health management tasks. Compared with top SSL models, FISHER showcases versatile and outstanding capabilities with a general performance gain up to 4.2%, along with much more efficient scaling curves. We also investigate the scaling law on downstream tasks and derive potential avenues for future work. Both FISHER and RMIS are now open-sourced. |
| title | FISHER: A Foundation Model for Multi-Modal Industrial Signal Comprehensive Representation |
| topic | Machine Learning Artificial Intelligence Multimedia Sound |
| url | https://arxiv.org/abs/2507.16696 |