Token Communications: A Large Model-Driven Framework for Cross-modal Context-aware Semantic Communications
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866916847165636608 |
|---|---|
| author | Qiao, Li Mashhadi, Mahdi Boloursaz Gao, Zhen Tafazolli, Rahim Bennis, Mehdi Niyato, Dusit |
| author_facet | Qiao, Li Mashhadi, Mahdi Boloursaz Gao, Zhen Tafazolli, Rahim Bennis, Mehdi Niyato, Dusit |
| contents | In this paper, we introduce token communications (TokCom), a large model-driven framework to leverage cross-modal context information in generative semantic communications (GenSC). TokCom is a new paradigm, motivated by the recent success of generative foundation models and multimodal large language models (GFM/MLLMs), where the communication units are tokens, enabling efficient transformer-based token processing at the transmitter and receiver. In this paper, we introduce the potential opportunities and challenges of leveraging context in GenSC, explore how to integrate GFM/MLLMs-based token processing into semantic communication systems to leverage cross-modal context effectively at affordable complexity, present the key principles for efficient TokCom at various layers in future wireless networks. In a typical image semantic communication setup, we demonstrate a significant improvement of the bandwidth efficiency, achieved by TokCom by leveraging the context information among tokens. Finally, the potential research directions are identified to facilitate adoption of TokCom in future wireless networks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_12096 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Token Communications: A Large Model-Driven Framework for Cross-modal Context-aware Semantic Communications Qiao, Li Mashhadi, Mahdi Boloursaz Gao, Zhen Tafazolli, Rahim Bennis, Mehdi Niyato, Dusit Multimedia Computer Vision and Pattern Recognition Information Theory Signal Processing In this paper, we introduce token communications (TokCom), a large model-driven framework to leverage cross-modal context information in generative semantic communications (GenSC). TokCom is a new paradigm, motivated by the recent success of generative foundation models and multimodal large language models (GFM/MLLMs), where the communication units are tokens, enabling efficient transformer-based token processing at the transmitter and receiver. In this paper, we introduce the potential opportunities and challenges of leveraging context in GenSC, explore how to integrate GFM/MLLMs-based token processing into semantic communication systems to leverage cross-modal context effectively at affordable complexity, present the key principles for efficient TokCom at various layers in future wireless networks. In a typical image semantic communication setup, we demonstrate a significant improvement of the bandwidth efficiency, achieved by TokCom by leveraging the context information among tokens. Finally, the potential research directions are identified to facilitate adoption of TokCom in future wireless networks. |
| title | Token Communications: A Large Model-Driven Framework for Cross-modal Context-aware Semantic Communications |
| topic | Multimedia Computer Vision and Pattern Recognition Information Theory Signal Processing |
| url | https://arxiv.org/abs/2502.12096 |