Generative AI in Data Center Networking: Fundamentals, Perspectives, and Case Study

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Liu, Yinqiu, Du, Hongyang, Niyato, Dusit, Kang, Jiawen, Xiong, Zehui, Wen, Yonggang, Kim, Dong In
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914949320671232
author Liu, Yinqiu
Du, Hongyang
Niyato, Dusit
Kang, Jiawen
Xiong, Zehui
Wen, Yonggang
Kim, Dong In
author_facet Liu, Yinqiu
Du, Hongyang
Niyato, Dusit
Kang, Jiawen
Xiong, Zehui
Wen, Yonggang
Kim, Dong In
contents Generative AI (GenAI), exemplified by Large Language Models (LLMs) such as OpenAI's ChatGPT, is revolutionizing various fields. Central to this transformation is Data Center Networking (DCN), which not only provides the computational power necessary for GenAI training and inference but also delivers GenAI-driven services to users. This article examines an interplay between GenAI and DCNs, highlighting their symbiotic relationship and mutual advancements. We begin by reviewing current challenges within DCNs and discuss how GenAI contributes to enhancing DCN capabilities through innovations, such as data augmentation, process automation, and domain transfer. We then focus on analyzing the distinctive characteristics of GenAI workloads on DCNs, gaining insights that catalyze the evolution of DCNs to more effectively support GenAI and LLMs. Moreover, to illustrate the seamless integration of GenAI with DCNs, we present a case study on full-lifecycle DCN digital twins. In this study, we employ LLMs equipped with Retrieval Augmented Generation (RAG) to formulate optimization problems for DCNs and adopt Diffusion-Deep Reinforcement Learning (DRL) for optimizing the RAG knowledge placement strategy. This approach not only demonstrates the application of advanced GenAI methods within DCNs but also positions the digital twin as a pivotal GenAI service operating on DCNs. We anticipate that this article can promote further research into enhancing the virtuous interaction between GenAI and DCNs.
format Preprint
id arxiv_https___arxiv_org_abs_2409_09343
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generative AI in Data Center Networking: Fundamentals, Perspectives, and Case Study
Liu, Yinqiu
Du, Hongyang
Niyato, Dusit
Kang, Jiawen
Xiong, Zehui
Wen, Yonggang
Kim, Dong In
Networking and Internet Architecture
Generative AI (GenAI), exemplified by Large Language Models (LLMs) such as OpenAI's ChatGPT, is revolutionizing various fields. Central to this transformation is Data Center Networking (DCN), which not only provides the computational power necessary for GenAI training and inference but also delivers GenAI-driven services to users. This article examines an interplay between GenAI and DCNs, highlighting their symbiotic relationship and mutual advancements. We begin by reviewing current challenges within DCNs and discuss how GenAI contributes to enhancing DCN capabilities through innovations, such as data augmentation, process automation, and domain transfer. We then focus on analyzing the distinctive characteristics of GenAI workloads on DCNs, gaining insights that catalyze the evolution of DCNs to more effectively support GenAI and LLMs. Moreover, to illustrate the seamless integration of GenAI with DCNs, we present a case study on full-lifecycle DCN digital twins. In this study, we employ LLMs equipped with Retrieval Augmented Generation (RAG) to formulate optimization problems for DCNs and adopt Diffusion-Deep Reinforcement Learning (DRL) for optimizing the RAG knowledge placement strategy. This approach not only demonstrates the application of advanced GenAI methods within DCNs but also positions the digital twin as a pivotal GenAI service operating on DCNs. We anticipate that this article can promote further research into enhancing the virtuous interaction between GenAI and DCNs.
title Generative AI in Data Center Networking: Fundamentals, Perspectives, and Case Study
topic Networking and Internet Architecture
url https://arxiv.org/abs/2409.09343