Geminet: Learning the Duality-based Iterative Process for Lightweight Traffic Engineering in Changing Topologies

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Liu, Ximeng, Liu, Zhuoran, Mao, Yingming, Li, Yatao, Zhao, Shizhen, Wang, Xinbing
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917408974831616
author Liu, Ximeng
Liu, Zhuoran
Mao, Yingming
Li, Yatao
Zhao, Shizhen
Wang, Xinbing
author_facet Liu, Ximeng
Liu, Zhuoran
Mao, Yingming
Li, Yatao
Zhao, Shizhen
Wang, Xinbing
contents Recently, researchers have explored ML-based Traffic Engineering (TE), leveraging neural networks to solve TE problems traditionally addressed by optimization. However, existing ML-based TE schemes remain impractical: they either fail to handle topology changes or suffer from poor scalability due to excessive computational and memory overhead. To overcome these limitations, we propose Geminet, a lightweight and scalable ML-based TE framework that can handle changing topologies. Geminet is built upon two key insights: (i) a methodology that decouples neural networks from topology by learning an iterative gradient-descent-based adjustment process, as the update rule of gradient descent is topology-agnostic, relying only on a few gradient-related quantities; (ii) shifting optimization from path-level routing weights to edge-level dual variables, reducing memory consumption by leveraging the fact that edges are far fewer than paths. Evaluations on WAN and data center datasets show that Geminet significantly improves scalability. Its neural network size is only 0.04% to 7% of existing schemes, while handling topology variations as effectively as HARP, a state-of-the-art ML-based TE approach, without performance degradation. When trained on large-scale topologies, Geminet consumes under 10 GiB of memory, more than eight times less than the 80-plus GiB required by HARP, while achieving 5.45 times faster convergence speed, demonstrating its potential for large-scale deployment.
format Preprint
id arxiv_https___arxiv_org_abs_2506_23640
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Geminet: Learning the Duality-based Iterative Process for Lightweight Traffic Engineering in Changing Topologies
Liu, Ximeng
Liu, Zhuoran
Mao, Yingming
Li, Yatao
Zhao, Shizhen
Wang, Xinbing
Networking and Internet Architecture
Machine Learning
Recently, researchers have explored ML-based Traffic Engineering (TE), leveraging neural networks to solve TE problems traditionally addressed by optimization. However, existing ML-based TE schemes remain impractical: they either fail to handle topology changes or suffer from poor scalability due to excessive computational and memory overhead. To overcome these limitations, we propose Geminet, a lightweight and scalable ML-based TE framework that can handle changing topologies. Geminet is built upon two key insights: (i) a methodology that decouples neural networks from topology by learning an iterative gradient-descent-based adjustment process, as the update rule of gradient descent is topology-agnostic, relying only on a few gradient-related quantities; (ii) shifting optimization from path-level routing weights to edge-level dual variables, reducing memory consumption by leveraging the fact that edges are far fewer than paths. Evaluations on WAN and data center datasets show that Geminet significantly improves scalability. Its neural network size is only 0.04% to 7% of existing schemes, while handling topology variations as effectively as HARP, a state-of-the-art ML-based TE approach, without performance degradation. When trained on large-scale topologies, Geminet consumes under 10 GiB of memory, more than eight times less than the 80-plus GiB required by HARP, while achieving 5.45 times faster convergence speed, demonstrating its potential for large-scale deployment.
title Geminet: Learning the Duality-based Iterative Process for Lightweight Traffic Engineering in Changing Topologies
topic Networking and Internet Architecture
Machine Learning
url https://arxiv.org/abs/2506.23640