SPAR: Self-supervised Placement-Aware Representation Learning for Distributed Sensing
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866908806562185216 |
|---|---|
| author | Chen, Yizhuo Wang, Tianchen Lyu, You Hu, Yanlan Li, Jinyang Kimura, Tomoyoshi Zhao, Hongjue Hu, Yigong Kara, Denizhan Abdelzaher, Tarek |
| author_facet | Chen, Yizhuo Wang, Tianchen Lyu, You Hu, Yanlan Li, Jinyang Kimura, Tomoyoshi Zhao, Hongjue Hu, Yigong Kara, Denizhan Abdelzaher, Tarek |
| contents | We present SPAR, a framework for self-supervised placement-aware representation learning in distributed sensing. Distributed sensing spans applications where multiple spatially distributed and multimodal sensors jointly observe an environment, from vehicle monitoring to human activity recognition and earthquake localization. A central challenge shared by this wide spectrum of applications is that observed signals are inseparably shaped by sensor placements, including their spatial locations and structural characteristics. However, existing pretraining methods remain largely placement-agnostic. SPAR addresses this gap through a unifying principle: the duality between signals and positions. Guided by this principle, SPAR introduces spatial and structural positional embeddings together with dual reconstruction objectives, explicitly modeling how observing positions and observed signals shape each other. Placement is thus treated not as auxiliary metadata but as intrinsic to representation learning. SPAR is theoretically supported by analyses from information theory and occlusion-invariant learning. Extensive experiments on three real-world datasets show that SPAR achieves superior robustness and generalization across various modalities, placements, and downstream tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_16936 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | SPAR: Self-supervised Placement-Aware Representation Learning for Distributed Sensing Chen, Yizhuo Wang, Tianchen Lyu, You Hu, Yanlan Li, Jinyang Kimura, Tomoyoshi Zhao, Hongjue Hu, Yigong Kara, Denizhan Abdelzaher, Tarek Machine Learning We present SPAR, a framework for self-supervised placement-aware representation learning in distributed sensing. Distributed sensing spans applications where multiple spatially distributed and multimodal sensors jointly observe an environment, from vehicle monitoring to human activity recognition and earthquake localization. A central challenge shared by this wide spectrum of applications is that observed signals are inseparably shaped by sensor placements, including their spatial locations and structural characteristics. However, existing pretraining methods remain largely placement-agnostic. SPAR addresses this gap through a unifying principle: the duality between signals and positions. Guided by this principle, SPAR introduces spatial and structural positional embeddings together with dual reconstruction objectives, explicitly modeling how observing positions and observed signals shape each other. Placement is thus treated not as auxiliary metadata but as intrinsic to representation learning. SPAR is theoretically supported by analyses from information theory and occlusion-invariant learning. Extensive experiments on three real-world datasets show that SPAR achieves superior robustness and generalization across various modalities, placements, and downstream tasks. |
| title | SPAR: Self-supervised Placement-Aware Representation Learning for Distributed Sensing |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2505.16936 |