Toward Democratized Generative AI in Next-Generation Mobile Edge Networks
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909389084950528 |
|---|---|
| author | Zhang, Ruichen He, Jiayi Luo, Xiaofeng Niyato, Dusit Kang, Jiawen Xiong, Zehui Li, Yonghui Sikdar, Biplab |
| author_facet | Zhang, Ruichen He, Jiayi Luo, Xiaofeng Niyato, Dusit Kang, Jiawen Xiong, Zehui Li, Yonghui Sikdar, Biplab |
| contents | The rapid development of generative AI technologies, including large language models (LLMs), has brought transformative changes to various fields. However, deploying such advanced models on mobile and edge devices remains challenging due to their high computational, memory, communication, and energy requirements. To address these challenges, we propose a model-centric framework for democratizing generative AI deployment on mobile and edge networks. First, we comprehensively review key compact model strategies, such as quantization, model pruning, and knowledge distillation, and present key performance metrics to optimize generative AI for mobile deployment. Next, we provide a focused review of mobile and edge networks, emphasizing the specific challenges and requirements of these environments. We further conduct a case study demonstrating the effectiveness of these strategies by deploying LLMs on real mobile edge devices. Experimental results highlight the practicality of democratized LLMs, with significant improvements in generalization accuracy, hallucination rate, accessibility, and resource consumption. Finally, we discuss potential research directions to further advance the deployment of generative AI in resource-constrained environments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_09148 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Toward Democratized Generative AI in Next-Generation Mobile Edge Networks Zhang, Ruichen He, Jiayi Luo, Xiaofeng Niyato, Dusit Kang, Jiawen Xiong, Zehui Li, Yonghui Sikdar, Biplab Networking and Internet Architecture The rapid development of generative AI technologies, including large language models (LLMs), has brought transformative changes to various fields. However, deploying such advanced models on mobile and edge devices remains challenging due to their high computational, memory, communication, and energy requirements. To address these challenges, we propose a model-centric framework for democratizing generative AI deployment on mobile and edge networks. First, we comprehensively review key compact model strategies, such as quantization, model pruning, and knowledge distillation, and present key performance metrics to optimize generative AI for mobile deployment. Next, we provide a focused review of mobile and edge networks, emphasizing the specific challenges and requirements of these environments. We further conduct a case study demonstrating the effectiveness of these strategies by deploying LLMs on real mobile edge devices. Experimental results highlight the practicality of democratized LLMs, with significant improvements in generalization accuracy, hallucination rate, accessibility, and resource consumption. Finally, we discuss potential research directions to further advance the deployment of generative AI in resource-constrained environments. |
| title | Toward Democratized Generative AI in Next-Generation Mobile Edge Networks |
| topic | Networking and Internet Architecture |
| url | https://arxiv.org/abs/2411.09148 |