FL-NAS: Towards Fairness of NAS for Resource Constrained Devices via Large Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911774776754176 |
|---|---|
| author | Qin, Ruiyang Hu, Yuting Yan, Zheyu Xiong, Jinjun Abbasi, Ahmed Shi, Yiyu |
| author_facet | Qin, Ruiyang Hu, Yuting Yan, Zheyu Xiong, Jinjun Abbasi, Ahmed Shi, Yiyu |
| contents | Neural Architecture Search (NAS) has become the de fecto tools in the industry in automating the design of deep neural networks for various applications, especially those driven by mobile and edge devices with limited computing resources. The emerging large language models (LLMs), due to their prowess, have also been incorporated into NAS recently and show some promising results. This paper conducts further exploration in this direction by considering three important design metrics simultaneously, i.e., model accuracy, fairness, and hardware deployment efficiency. We propose a novel LLM-based NAS framework, FL-NAS, in this paper, and show experimentally that FL-NAS can indeed find high-performing DNNs, beating state-of-the-art DNN models by orders-of-magnitude across almost all design considerations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_06696 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | FL-NAS: Towards Fairness of NAS for Resource Constrained Devices via Large Language Models Qin, Ruiyang Hu, Yuting Yan, Zheyu Xiong, Jinjun Abbasi, Ahmed Shi, Yiyu Machine Learning Artificial Intelligence Neural Architecture Search (NAS) has become the de fecto tools in the industry in automating the design of deep neural networks for various applications, especially those driven by mobile and edge devices with limited computing resources. The emerging large language models (LLMs), due to their prowess, have also been incorporated into NAS recently and show some promising results. This paper conducts further exploration in this direction by considering three important design metrics simultaneously, i.e., model accuracy, fairness, and hardware deployment efficiency. We propose a novel LLM-based NAS framework, FL-NAS, in this paper, and show experimentally that FL-NAS can indeed find high-performing DNNs, beating state-of-the-art DNN models by orders-of-magnitude across almost all design considerations. |
| title | FL-NAS: Towards Fairness of NAS for Resource Constrained Devices via Large Language Models |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2402.06696 |