TACO: Rethinking Semantic Communications with Task Adaptation and Context Embedding

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wijesinghe, Achintha, Wang, Weiwei, Wanninayaka, Suchinthaka, Zhang, Songyang, Ding, Zhi
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908367007514624
author Wijesinghe, Achintha
Wang, Weiwei
Wanninayaka, Suchinthaka
Zhang, Songyang
Ding, Zhi
author_facet Wijesinghe, Achintha
Wang, Weiwei
Wanninayaka, Suchinthaka
Zhang, Songyang
Ding, Zhi
contents Recent advancements in generative artificial intelligence have introduced groundbreaking approaches to innovating next-generation semantic communication, which prioritizes conveying the meaning of a message rather than merely transmitting raw data. A fundamental challenge in semantic communication lies in accurately identifying and extracting the most critical semantic information while adapting to downstream tasks without degrading performance, particularly when the objective at the receiver may evolve over time. To enable flexible adaptation to multiple tasks at the receiver, this work introduces a novel semantic communication framework, which is capable of jointly capturing task-specific information to enhance downstream task performance and contextual information. Through rigorous experiments on popular image datasets and computer vision tasks, our framework shows promising improvement compared to existing work, including superior performance in downstream tasks, better generalizability, ultra-high bandwidth efficiency, and low reconstruction latency.
format Preprint
id arxiv_https___arxiv_org_abs_2505_10834
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle TACO: Rethinking Semantic Communications with Task Adaptation and Context Embedding
Wijesinghe, Achintha
Wang, Weiwei
Wanninayaka, Suchinthaka
Zhang, Songyang
Ding, Zhi
Artificial Intelligence
Machine Learning
Image and Video Processing
Signal Processing
Recent advancements in generative artificial intelligence have introduced groundbreaking approaches to innovating next-generation semantic communication, which prioritizes conveying the meaning of a message rather than merely transmitting raw data. A fundamental challenge in semantic communication lies in accurately identifying and extracting the most critical semantic information while adapting to downstream tasks without degrading performance, particularly when the objective at the receiver may evolve over time. To enable flexible adaptation to multiple tasks at the receiver, this work introduces a novel semantic communication framework, which is capable of jointly capturing task-specific information to enhance downstream task performance and contextual information. Through rigorous experiments on popular image datasets and computer vision tasks, our framework shows promising improvement compared to existing work, including superior performance in downstream tasks, better generalizability, ultra-high bandwidth efficiency, and low reconstruction latency.
title TACO: Rethinking Semantic Communications with Task Adaptation and Context Embedding
topic Artificial Intelligence
Machine Learning
Image and Video Processing
Signal Processing
url https://arxiv.org/abs/2505.10834