End-to-End Edge AI Service Provisioning Framework in 6G ORAN

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Tang, Yun, Srinivasan, Udhaya Chandhar, Scott, Benjamin James, Umealor, Obumneme, Kevogo, Dennis, Guo, Weisi
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915199777243136
author Tang, Yun
Srinivasan, Udhaya Chandhar
Scott, Benjamin James
Umealor, Obumneme
Kevogo, Dennis
Guo, Weisi
author_facet Tang, Yun
Srinivasan, Udhaya Chandhar
Scott, Benjamin James
Umealor, Obumneme
Kevogo, Dennis
Guo, Weisi
contents With the advent of 6G, Open Radio Access Network (O-RAN) architectures are evolving to support intelligent, adaptive, and automated network orchestration. This paper proposes a novel Edge AI and Network Service Orchestration framework that leverages Large Language Model (LLM) agents deployed as O-RAN rApps. The proposed LLM-agent-powered system enables interactive and intuitive orchestration by translating the user's use case description into deployable AI services and corresponding network configurations. The LLM agent automates multiple tasks, including AI model selection from repositories (e.g., Hugging Face), service deployment, network adaptation, and real-time monitoring via xApps. We implement a prototype using open-source O-RAN projects (OpenAirInterface and FlexRIC) to demonstrate the feasibility and functionality of our framework. Our demonstration showcases the end-to-end flow of AI service orchestration, from user interaction to network adaptation, ensuring Quality of Service (QoS) compliance. This work highlights the potential of integrating LLM-driven automation into 6G O-RAN ecosystems, paving the way for more accessible and efficient edge AI ecosystems.
format Preprint
id arxiv_https___arxiv_org_abs_2503_11933
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle End-to-End Edge AI Service Provisioning Framework in 6G ORAN
Tang, Yun
Srinivasan, Udhaya Chandhar
Scott, Benjamin James
Umealor, Obumneme
Kevogo, Dennis
Guo, Weisi
Networking and Internet Architecture
Artificial Intelligence
With the advent of 6G, Open Radio Access Network (O-RAN) architectures are evolving to support intelligent, adaptive, and automated network orchestration. This paper proposes a novel Edge AI and Network Service Orchestration framework that leverages Large Language Model (LLM) agents deployed as O-RAN rApps. The proposed LLM-agent-powered system enables interactive and intuitive orchestration by translating the user's use case description into deployable AI services and corresponding network configurations. The LLM agent automates multiple tasks, including AI model selection from repositories (e.g., Hugging Face), service deployment, network adaptation, and real-time monitoring via xApps. We implement a prototype using open-source O-RAN projects (OpenAirInterface and FlexRIC) to demonstrate the feasibility and functionality of our framework. Our demonstration showcases the end-to-end flow of AI service orchestration, from user interaction to network adaptation, ensuring Quality of Service (QoS) compliance. This work highlights the potential of integrating LLM-driven automation into 6G O-RAN ecosystems, paving the way for more accessible and efficient edge AI ecosystems.
title End-to-End Edge AI Service Provisioning Framework in 6G ORAN
topic Networking and Internet Architecture
Artificial Intelligence
url https://arxiv.org/abs/2503.11933