Towards Constraint-aware Learning for Resource Allocation in NFV Networks
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915408686088192 |
|---|---|
| author | Wang, Tianfu Yang, Long Wang, Chao Qin, Chuan Deng, Liwei Wu, Wei Wang, Junyang Shen, Li Xiong, Hui |
| author_facet | Wang, Tianfu Yang, Long Wang, Chao Qin, Chuan Deng, Liwei Wu, Wei Wang, Junyang Shen, Li Xiong, Hui |
| contents | Virtual Network Embedding (VNE) is a fundamental resource allocation challenge that is associated with hard and multifaceted constraints in network function virtualization (NFV). Existing works for VNE struggle to handle such complex constraints, leading to compromised system performance and stability. In this paper, we propose a \textbf{CON}straint-\textbf{A}ware \textbf{L}earning framework, named \textbf{CONAL}, for efficient constraint handling in VNE. Concretely, we formulate the VNE problem as a constrained Markov decision process with violation tolerance, enabling precise assessments of both solution quality and constraint violations. To achieve the persistent zero violation to guarantee solutions' feasibility, we propose a reachability-guided optimization with an adaptive reachability budget method. This method also stabilizes policy optimization by appropriately handling scenarios with no feasible solutions. Furthermore, we propose a constraint-aware graph representation method to efficiently learn cross-graph relations and constrained path connectivity in VNE. Finally, extensive experimental results demonstrate the superiority of our proposed method over state-of-the-art baselines. Our code is available at \href{https://github.com/GeminiLight/conal-vne}{https://github.com/GeminiLight/conal-vne}. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_22999 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards Constraint-aware Learning for Resource Allocation in NFV Networks Wang, Tianfu Yang, Long Wang, Chao Qin, Chuan Deng, Liwei Wu, Wei Wang, Junyang Shen, Li Xiong, Hui Networking and Internet Architecture Virtual Network Embedding (VNE) is a fundamental resource allocation challenge that is associated with hard and multifaceted constraints in network function virtualization (NFV). Existing works for VNE struggle to handle such complex constraints, leading to compromised system performance and stability. In this paper, we propose a \textbf{CON}straint-\textbf{A}ware \textbf{L}earning framework, named \textbf{CONAL}, for efficient constraint handling in VNE. Concretely, we formulate the VNE problem as a constrained Markov decision process with violation tolerance, enabling precise assessments of both solution quality and constraint violations. To achieve the persistent zero violation to guarantee solutions' feasibility, we propose a reachability-guided optimization with an adaptive reachability budget method. This method also stabilizes policy optimization by appropriately handling scenarios with no feasible solutions. Furthermore, we propose a constraint-aware graph representation method to efficiently learn cross-graph relations and constrained path connectivity in VNE. Finally, extensive experimental results demonstrate the superiority of our proposed method over state-of-the-art baselines. Our code is available at \href{https://github.com/GeminiLight/conal-vne}{https://github.com/GeminiLight/conal-vne}. |
| title | Towards Constraint-aware Learning for Resource Allocation in NFV Networks |
| topic | Networking and Internet Architecture |
| url | https://arxiv.org/abs/2410.22999 |