Application of Transformers for Nonlinear Channel Compensation in Optical Systems

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Hamgini, Behnam Behinaein, Najafi, Hossein, Bakhshali, Ali, Zhang, Zhuhong
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910549378334720
author Hamgini, Behnam Behinaein
Najafi, Hossein
Bakhshali, Ali
Zhang, Zhuhong
author_facet Hamgini, Behnam Behinaein
Najafi, Hossein
Bakhshali, Ali
Zhang, Zhuhong
contents In this paper, we introduce a new nonlinear optical channel equalizer based on Transformers. By leveraging parallel computation and attending directly to the memory across a sequence of symbols, we show that Transformers can be used effectively for nonlinear compensation (NLC) in coherent long-haul transmission systems. For this application, we present an implementation of the encoder part of the Transformer and analyze its performance over a wide range of different hyper-parameters. It is shown that by proper embeddings and processing blocks of symbols at each iteration and also carefully selecting subsets of the encoder's output to be processed together, an efficient nonlinear equalization can be achieved for different complexity constraints. To reduce the computational complexity of the attention mechanism, we further propose the use of a physic-informed mask inspired by nonlinear perturbation theory. We also compare the Transformer-NLC with digital back-propagation (DBP) under different transmission scenarios in order to demonstrate the flexibility and generalizability of the proposed data-driven solution.
format Preprint
id arxiv_https___arxiv_org_abs_2304_13119
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Application of Transformers for Nonlinear Channel Compensation in Optical Systems
Hamgini, Behnam Behinaein
Najafi, Hossein
Bakhshali, Ali
Zhang, Zhuhong
Information Theory
Machine Learning
Signal Processing
In this paper, we introduce a new nonlinear optical channel equalizer based on Transformers. By leveraging parallel computation and attending directly to the memory across a sequence of symbols, we show that Transformers can be used effectively for nonlinear compensation (NLC) in coherent long-haul transmission systems. For this application, we present an implementation of the encoder part of the Transformer and analyze its performance over a wide range of different hyper-parameters. It is shown that by proper embeddings and processing blocks of symbols at each iteration and also carefully selecting subsets of the encoder's output to be processed together, an efficient nonlinear equalization can be achieved for different complexity constraints. To reduce the computational complexity of the attention mechanism, we further propose the use of a physic-informed mask inspired by nonlinear perturbation theory. We also compare the Transformer-NLC with digital back-propagation (DBP) under different transmission scenarios in order to demonstrate the flexibility and generalizability of the proposed data-driven solution.
title Application of Transformers for Nonlinear Channel Compensation in Optical Systems
topic Information Theory
Machine Learning
Signal Processing
url https://arxiv.org/abs/2304.13119