Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.12126 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908344544919552 |
|---|---|
| author | Xing, Sizhe Sun, Aolong Wang, Chengxi Wang, Yizhi Dong, Boyu Hu, Junhui Deng, Xuyu Yan, An Liu, Yingjun Hu, Fangchen Li, Zhongya Huang, Ouhan Zhao, Junhao Zhou, Yingjun Li, Ziwei Shi, Jianyang Xiao, Xi Penty, Richard Cheng, Qixiang Chi, Nan Zhang, Junwen |
| author_facet | Xing, Sizhe Sun, Aolong Wang, Chengxi Wang, Yizhi Dong, Boyu Hu, Junhui Deng, Xuyu Yan, An Liu, Yingjun Hu, Fangchen Li, Zhongya Huang, Ouhan Zhao, Junhao Zhou, Yingjun Li, Ziwei Shi, Jianyang Xiao, Xi Penty, Richard Cheng, Qixiang Chi, Nan Zhang, Junwen |
| contents | The rapid advancement of generative artificial intelligence (AI) in recent years has profoundly reshaped modern lifestyles, necessitating a revolutionary architecture to support the growing demands for computational power. Cloud computing has become the driving force behind this transformation. However, it consumes significant power and faces computation security risks due to the reliance on extensive data centers and servers in the cloud. Reducing power consumption while enhancing computational scale remains persistent challenges in cloud computing. Here, we propose and experimentally demonstrate an optical cloud computing system that can be seamlessly deployed across edge-metro network. By modulating inputs and models into light, a wide range of edge nodes can directly access the optical computing center via the edge-metro network. The experimental validations show an energy efficiency of 118.6 mW/TOPs (tera operations per second), reducing energy consumption by two orders of magnitude compared to traditional electronic-based cloud computing solutions. Furthermore, it is experimentally validated that this architecture can perform various complex generative AI models through parallel computing to achieve image generation tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_12126 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Seamless Optical Cloud Computing across Edge-Metro Network for Generative AI Xing, Sizhe Sun, Aolong Wang, Chengxi Wang, Yizhi Dong, Boyu Hu, Junhui Deng, Xuyu Yan, An Liu, Yingjun Hu, Fangchen Li, Zhongya Huang, Ouhan Zhao, Junhao Zhou, Yingjun Li, Ziwei Shi, Jianyang Xiao, Xi Penty, Richard Cheng, Qixiang Chi, Nan Zhang, Junwen Distributed, Parallel, and Cluster Computing Computer Vision and Pattern Recognition Machine Learning Image and Video Processing Signal Processing The rapid advancement of generative artificial intelligence (AI) in recent years has profoundly reshaped modern lifestyles, necessitating a revolutionary architecture to support the growing demands for computational power. Cloud computing has become the driving force behind this transformation. However, it consumes significant power and faces computation security risks due to the reliance on extensive data centers and servers in the cloud. Reducing power consumption while enhancing computational scale remains persistent challenges in cloud computing. Here, we propose and experimentally demonstrate an optical cloud computing system that can be seamlessly deployed across edge-metro network. By modulating inputs and models into light, a wide range of edge nodes can directly access the optical computing center via the edge-metro network. The experimental validations show an energy efficiency of 118.6 mW/TOPs (tera operations per second), reducing energy consumption by two orders of magnitude compared to traditional electronic-based cloud computing solutions. Furthermore, it is experimentally validated that this architecture can perform various complex generative AI models through parallel computing to achieve image generation tasks. |
| title | Seamless Optical Cloud Computing across Edge-Metro Network for Generative AI |
| topic | Distributed, Parallel, and Cluster Computing Computer Vision and Pattern Recognition Machine Learning Image and Video Processing Signal Processing |
| url | https://arxiv.org/abs/2412.12126 |