NegoCollab: A Common Representation Negotiation Approach for Heterogeneous Collaborative Perception
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914294340255744 |
|---|---|
| author | Shao, Congzhang Yuan, Quan Luo, Guiyang Hu, Yue Wang, Danni Liu, Yilin Pan, Rui Chen, Bo Li, Jinglin |
| author_facet | Shao, Congzhang Yuan, Quan Luo, Guiyang Hu, Yue Wang, Danni Liu, Yilin Pan, Rui Chen, Bo Li, Jinglin |
| contents | Collaborative perception improves task performance by expanding the perception range through information sharing among agents. . Immutable heterogeneity poses a significant challenge in collaborative perception, as participating agents may employ different and fixed perception models. This leads to domain gaps in the intermediate features shared among agents, consequently degrading collaborative performance. Aligning the features of all agents to a common representation can eliminate domain gaps with low training cost. However, in existing methods, the common representation is designated as the representation of a specific agent, making it difficult for agents with significant domain discrepancies from this specific agent to achieve proper alignment. This paper proposes NegoCollab, a heterogeneous collaboration method based on the negotiated common representation. It introduces a negotiator during training to derive the common representation from the local representations of each modality's agent, effectively reducing the inherent domain gap with the various local representations. In NegoCollab, the mutual transformation of features between the local representation space and the common representation space is achieved by a pair of sender and receiver. To better align local representations to the common representation containing multimodal information, we introduce structural alignment loss and pragmatic alignment loss in addition to the distribution alignment loss to supervise the training. This enables the knowledge in the common representation to be fully distilled into the sender. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_27647 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | NegoCollab: A Common Representation Negotiation Approach for Heterogeneous Collaborative Perception Shao, Congzhang Yuan, Quan Luo, Guiyang Hu, Yue Wang, Danni Liu, Yilin Pan, Rui Chen, Bo Li, Jinglin Computer Vision and Pattern Recognition Collaborative perception improves task performance by expanding the perception range through information sharing among agents. . Immutable heterogeneity poses a significant challenge in collaborative perception, as participating agents may employ different and fixed perception models. This leads to domain gaps in the intermediate features shared among agents, consequently degrading collaborative performance. Aligning the features of all agents to a common representation can eliminate domain gaps with low training cost. However, in existing methods, the common representation is designated as the representation of a specific agent, making it difficult for agents with significant domain discrepancies from this specific agent to achieve proper alignment. This paper proposes NegoCollab, a heterogeneous collaboration method based on the negotiated common representation. It introduces a negotiator during training to derive the common representation from the local representations of each modality's agent, effectively reducing the inherent domain gap with the various local representations. In NegoCollab, the mutual transformation of features between the local representation space and the common representation space is achieved by a pair of sender and receiver. To better align local representations to the common representation containing multimodal information, we introduce structural alignment loss and pragmatic alignment loss in addition to the distribution alignment loss to supervise the training. This enables the knowledge in the common representation to be fully distilled into the sender. |
| title | NegoCollab: A Common Representation Negotiation Approach for Heterogeneous Collaborative Perception |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2510.27647 |