Pragmatic Communication for Remote Control of Finite-State Markov Processes

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Talli, Pietro, Santi, Edoardo David, Chiariotti, Federico, Soleymani, Touraj, Mason, Federico, Zanella, Andrea, Gündüz, Deniz
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913353903898624
author Talli, Pietro
Santi, Edoardo David
Chiariotti, Federico
Soleymani, Touraj
Mason, Federico
Zanella, Andrea
Gündüz, Deniz
author_facet Talli, Pietro
Santi, Edoardo David
Chiariotti, Federico
Soleymani, Touraj
Mason, Federico
Zanella, Andrea
Gündüz, Deniz
contents Pragmatic or goal-oriented communication can optimize communication decisions beyond the reliable transmission of data, instead aiming at directly affecting application performance with the minimum channel utilization. In this paper, we develop a general theoretical framework for the remote control of finite-state Markov processes, using pragmatic communication over a costly zero-delay communication channel. To that end, we model a cyber-physical system composed of an encoder, which observes and transmits the states of a process in real-time, and a decoder, which receives that information and controls the behavior of the process. The encoder and the decoder should cooperatively optimize the trade-off between the control performance (i.e., reward) and the communication cost (i.e., channel use). This scenario underscores a pragmatic (i.e., goal-oriented) communication problem, where the purpose is to convey only the data that is most valuable for the underlying task, taking into account the state of the decoder (hence, the pragmatic aspect). We investigate two different decision-making architectures: in pull-based remote control, the decoder is the only decision-maker, while in push-based remote control, the encoder and the decoder constitute two independent decision-makers, leading to a multi-agent scenario. We propose three algorithms to optimize our system (i.e., design the encoder and the decoder policies), discuss the optimality guarantees ofs the algorithms, and shed light on their computational complexity and fundamental limits.
format Preprint
id arxiv_https___arxiv_org_abs_2405_10672
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Pragmatic Communication for Remote Control of Finite-State Markov Processes
Talli, Pietro
Santi, Edoardo David
Chiariotti, Federico
Soleymani, Touraj
Mason, Federico
Zanella, Andrea
Gündüz, Deniz
Multiagent Systems
Networking and Internet Architecture
Pragmatic or goal-oriented communication can optimize communication decisions beyond the reliable transmission of data, instead aiming at directly affecting application performance with the minimum channel utilization. In this paper, we develop a general theoretical framework for the remote control of finite-state Markov processes, using pragmatic communication over a costly zero-delay communication channel. To that end, we model a cyber-physical system composed of an encoder, which observes and transmits the states of a process in real-time, and a decoder, which receives that information and controls the behavior of the process. The encoder and the decoder should cooperatively optimize the trade-off between the control performance (i.e., reward) and the communication cost (i.e., channel use). This scenario underscores a pragmatic (i.e., goal-oriented) communication problem, where the purpose is to convey only the data that is most valuable for the underlying task, taking into account the state of the decoder (hence, the pragmatic aspect). We investigate two different decision-making architectures: in pull-based remote control, the decoder is the only decision-maker, while in push-based remote control, the encoder and the decoder constitute two independent decision-makers, leading to a multi-agent scenario. We propose three algorithms to optimize our system (i.e., design the encoder and the decoder policies), discuss the optimality guarantees ofs the algorithms, and shed light on their computational complexity and fundamental limits.
title Pragmatic Communication for Remote Control of Finite-State Markov Processes
topic Multiagent Systems
Networking and Internet Architecture
url https://arxiv.org/abs/2405.10672