Knowledge Abstraction for Knowledge-based Semantic Communication: A Generative Causality Invariant Approach

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Nguyen, Minh-Duong, Pham, Quoc-Viet, Tran, Nguyen H., Do, Hoang-Khoi, Ngo, Duy T., Hwang, Won-Joo
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911073897021440
author Nguyen, Minh-Duong
Pham, Quoc-Viet
Tran, Nguyen H.
Do, Hoang-Khoi
Ngo, Duy T.
Hwang, Won-Joo
author_facet Nguyen, Minh-Duong
Pham, Quoc-Viet
Tran, Nguyen H.
Do, Hoang-Khoi
Ngo, Duy T.
Hwang, Won-Joo
contents In this study, we design a low-complexity and generalized AI model that can capture common knowledge to improve data reconstruction of the channel decoder for semantic communication. Specifically, we propose a generative adversarial network that leverages causality-invariant learning to extract causal and non-causal representations from the data. Causal representations are invariant and encompass crucial information to identify the data's label. They can encapsulate semantic knowledge and facilitate effective data reconstruction at the receiver. Moreover, the causal mechanism ensures that learned representations remain consistent across different domains, making the system reliable even with users collecting data from diverse domains. As user-collected data evolves over time causing knowledge divergence among users, we design sparse update protocols to improve the invariant properties of the knowledge while minimizing communication overheads. Three key observations were drawn from our empirical evaluations. Firstly, causality-invariant knowledge ensures consistency across different devices despite the diverse training data. Secondly, invariant knowledge has promising performance in classification tasks, which is pivotal for goal-oriented semantic communications. Thirdly, our knowledge-based data reconstruction highlights the robustness of our decoder, which surpasses other state-of-the-art data reconstruction and semantic compression methods in terms of Peak Signal-to-Noise Ratio (PSNR).
format Preprint
id arxiv_https___arxiv_org_abs_2507_17784
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Knowledge Abstraction for Knowledge-based Semantic Communication: A Generative Causality Invariant Approach
Nguyen, Minh-Duong
Pham, Quoc-Viet
Tran, Nguyen H.
Do, Hoang-Khoi
Ngo, Duy T.
Hwang, Won-Joo
Machine Learning
68
I.2.0
In this study, we design a low-complexity and generalized AI model that can capture common knowledge to improve data reconstruction of the channel decoder for semantic communication. Specifically, we propose a generative adversarial network that leverages causality-invariant learning to extract causal and non-causal representations from the data. Causal representations are invariant and encompass crucial information to identify the data's label. They can encapsulate semantic knowledge and facilitate effective data reconstruction at the receiver. Moreover, the causal mechanism ensures that learned representations remain consistent across different domains, making the system reliable even with users collecting data from diverse domains. As user-collected data evolves over time causing knowledge divergence among users, we design sparse update protocols to improve the invariant properties of the knowledge while minimizing communication overheads. Three key observations were drawn from our empirical evaluations. Firstly, causality-invariant knowledge ensures consistency across different devices despite the diverse training data. Secondly, invariant knowledge has promising performance in classification tasks, which is pivotal for goal-oriented semantic communications. Thirdly, our knowledge-based data reconstruction highlights the robustness of our decoder, which surpasses other state-of-the-art data reconstruction and semantic compression methods in terms of Peak Signal-to-Noise Ratio (PSNR).
title Knowledge Abstraction for Knowledge-based Semantic Communication: A Generative Causality Invariant Approach
topic Machine Learning
68
I.2.0
url https://arxiv.org/abs/2507.17784