Taiji: A DPU Memory Elasticity Solution for In-production Cloud Environments
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866918201962528768 |
|---|---|
| author | Zheng, Hao Wang, Longxiang Xu, Yun Wang, Qiang Shen, Yibin Dong, Xiaoshe Di, Bang Wei, Jia Dong, Shenyu Zhang, Xingjun Chen, Weichen Han, Zhao Zhao, Sanqian Huang, Dongdong Qi, Jie Yang, Yifan Gao, Zhao Wang, Yi Li, Jinhu Ren, Xudong He, Min Yang, Hang Zheng, Xiao Hao, Haijiao Wu, Jiesheng |
| author_facet | Zheng, Hao Wang, Longxiang Xu, Yun Wang, Qiang Shen, Yibin Dong, Xiaoshe Di, Bang Wei, Jia Dong, Shenyu Zhang, Xingjun Chen, Weichen Han, Zhao Zhao, Sanqian Huang, Dongdong Qi, Jie Yang, Yifan Gao, Zhao Wang, Yi Li, Jinhu Ren, Xudong He, Min Yang, Hang Zheng, Xiao Hao, Haijiao Wu, Jiesheng |
| contents | The growth of cloud computing drives data centers toward higher density and efficiency. Data processing units (DPUs) enhance server network and storage performance but face challenges such as long hardware upgrade cycles and limited resources. To address these, we propose Taiji, a resource-elasticity architecture for DPUs. Combining hybrid virtualization with parallel memory swapping, Taiji switches the DPU's operating system (OS) into a guest OS and inserts a lightweight virtualization layer, making nearly all DPU memory swappable. It achieves memory overcommitment for the switched guest OS via high-performance memory elasticity, fully transparent to upper-layer applications, and supports hot-switch and hot-upgrade to meet in-production cloud requirements. Experiments show that Taiji expands DPU memory resources by over 50%, maintains virtualization overhead around 5%, and ensures 90% of swap-ins complete within 10 microseconds. Taiji delivers an efficient, reliable, low-overhead elasticity solution for DPUs and is deployed in large-scale production systems across more than 30,000 servers. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_09936 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Taiji: A DPU Memory Elasticity Solution for In-production Cloud Environments Zheng, Hao Wang, Longxiang Xu, Yun Wang, Qiang Shen, Yibin Dong, Xiaoshe Di, Bang Wei, Jia Dong, Shenyu Zhang, Xingjun Chen, Weichen Han, Zhao Zhao, Sanqian Huang, Dongdong Qi, Jie Yang, Yifan Gao, Zhao Wang, Yi Li, Jinhu Ren, Xudong He, Min Yang, Hang Zheng, Xiao Hao, Haijiao Wu, Jiesheng Operating Systems The growth of cloud computing drives data centers toward higher density and efficiency. Data processing units (DPUs) enhance server network and storage performance but face challenges such as long hardware upgrade cycles and limited resources. To address these, we propose Taiji, a resource-elasticity architecture for DPUs. Combining hybrid virtualization with parallel memory swapping, Taiji switches the DPU's operating system (OS) into a guest OS and inserts a lightweight virtualization layer, making nearly all DPU memory swappable. It achieves memory overcommitment for the switched guest OS via high-performance memory elasticity, fully transparent to upper-layer applications, and supports hot-switch and hot-upgrade to meet in-production cloud requirements. Experiments show that Taiji expands DPU memory resources by over 50%, maintains virtualization overhead around 5%, and ensures 90% of swap-ins complete within 10 microseconds. Taiji delivers an efficient, reliable, low-overhead elasticity solution for DPUs and is deployed in large-scale production systems across more than 30,000 servers. |
| title | Taiji: A DPU Memory Elasticity Solution for In-production Cloud Environments |
| topic | Operating Systems |
| url | https://arxiv.org/abs/2511.09936 |