In-Context Learning for Gradient-Free Receiver Adaptation: Principles, Applications, and Theory
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912448776241152 |
|---|---|
| author | Zecchin, Matteo Raviv, Tomer Kalathil, Dileep Narayanan, Krishna Shlezinger, Nir Simeone, Osvaldo |
| author_facet | Zecchin, Matteo Raviv, Tomer Kalathil, Dileep Narayanan, Krishna Shlezinger, Nir Simeone, Osvaldo |
| contents | In recent years, deep learning has facilitated the creation of wireless receivers capable of functioning effectively in conditions that challenge traditional model-based designs. Leveraging programmable hardware architectures, deep learning-based receivers offer the potential to dynamically adapt to varying channel environments. However, current adaptation strategies, including joint training, hypernetwork-based methods, and meta-learning, either demonstrate limited flexibility or necessitate explicit optimization through gradient descent. This paper presents gradient-free adaptation techniques rooted in the emerging paradigm of in-context learning (ICL). We review architectural frameworks for ICL based on Transformer models and structured state-space models (SSMs), alongside theoretical insights into how sequence models effectively learn adaptation from contextual information. Further, we explore the application of ICL to cell-free massive MIMO networks, providing both theoretical analyses and empirical evidence. Our findings indicate that ICL represents a principled and efficient approach to real-time receiver adaptation using pilot signals and auxiliary contextual information-without requiring online retraining. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_15176 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | In-Context Learning for Gradient-Free Receiver Adaptation: Principles, Applications, and Theory Zecchin, Matteo Raviv, Tomer Kalathil, Dileep Narayanan, Krishna Shlezinger, Nir Simeone, Osvaldo Information Theory Machine Learning Signal Processing In recent years, deep learning has facilitated the creation of wireless receivers capable of functioning effectively in conditions that challenge traditional model-based designs. Leveraging programmable hardware architectures, deep learning-based receivers offer the potential to dynamically adapt to varying channel environments. However, current adaptation strategies, including joint training, hypernetwork-based methods, and meta-learning, either demonstrate limited flexibility or necessitate explicit optimization through gradient descent. This paper presents gradient-free adaptation techniques rooted in the emerging paradigm of in-context learning (ICL). We review architectural frameworks for ICL based on Transformer models and structured state-space models (SSMs), alongside theoretical insights into how sequence models effectively learn adaptation from contextual information. Further, we explore the application of ICL to cell-free massive MIMO networks, providing both theoretical analyses and empirical evidence. Our findings indicate that ICL represents a principled and efficient approach to real-time receiver adaptation using pilot signals and auxiliary contextual information-without requiring online retraining. |
| title | In-Context Learning for Gradient-Free Receiver Adaptation: Principles, Applications, and Theory |
| topic | Information Theory Machine Learning Signal Processing |
| url | https://arxiv.org/abs/2506.15176 |