Context-Aware Iterative Token Detection and Masked Transmission for Wireless Token Communication
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917221443305472 |
|---|---|
| author | Shin, Junyong Park, Joohyuk Park, Jihong Choi, Jinho Jeon, Yo-Seb |
| author_facet | Shin, Junyong Park, Joohyuk Park, Jihong Choi, Jinho Jeon, Yo-Seb |
| contents | The success of large-scale language models has established tokens as compact and meaningful units for natural-language representation, which motivates token communication over wireless channels, where tokens are considered fundamental units for wireless transmission. We propose a context-aware token communication framework that uses a pretrained masked language model (MLM) as a shared contextual probability model between the transmitter (Tx) and receiver (Rx). At Rx, we develop an iterative token detection method that jointly exploits MLM-guided contextual priors and channel observations based on a Bayesian perspective. At Tx, we additionally introduce a context-aware masking strategy which skips highly predictable token transmission to reduce transmission rate. Simulation results demonstrate that the proposed framework substantially improves reconstructed sentence quality and supports effective rate adaptation under various channel conditions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_17770 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Context-Aware Iterative Token Detection and Masked Transmission for Wireless Token Communication Shin, Junyong Park, Joohyuk Park, Jihong Choi, Jinho Jeon, Yo-Seb Signal Processing Artificial Intelligence The success of large-scale language models has established tokens as compact and meaningful units for natural-language representation, which motivates token communication over wireless channels, where tokens are considered fundamental units for wireless transmission. We propose a context-aware token communication framework that uses a pretrained masked language model (MLM) as a shared contextual probability model between the transmitter (Tx) and receiver (Rx). At Rx, we develop an iterative token detection method that jointly exploits MLM-guided contextual priors and channel observations based on a Bayesian perspective. At Tx, we additionally introduce a context-aware masking strategy which skips highly predictable token transmission to reduce transmission rate. Simulation results demonstrate that the proposed framework substantially improves reconstructed sentence quality and supports effective rate adaptation under various channel conditions. |
| title | Context-Aware Iterative Token Detection and Masked Transmission for Wireless Token Communication |
| topic | Signal Processing Artificial Intelligence |
| url | https://arxiv.org/abs/2601.17770 |