Energy-Aware LLMs: A step towards sustainable AI for downstream applications
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914513988616192 |
|---|---|
| author | Tran, Nguyen Phuc Jaumard, Brigitte Delgado, Oscar |
| author_facet | Tran, Nguyen Phuc Jaumard, Brigitte Delgado, Oscar |
| contents | Advanced Large Language Models (LLMs) have revolutionized various fields, including communication networks, sparking an innovation wave that has led to new applications and services, and significantly enhanced solution schemes. Despite all these impressive developments, most LLMs typically require huge computational resources, resulting in terribly high energy consumption. Thus, this research study proposes an end-to-end pipeline that investigates the trade-off between energy efficiency and model performance for an LLM during fault ticket analysis in communication networks. It further evaluates the pipeline performance using two real-world datasets for the tasks of root cause analysis and response feedback in a communication network. Our results show that an appropriate combination of quantization and pruning techniques is able to reduce energy consumption while significantly improving model performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_17783 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Energy-Aware LLMs: A step towards sustainable AI for downstream applications Tran, Nguyen Phuc Jaumard, Brigitte Delgado, Oscar Performance Artificial Intelligence Computation and Language Machine Learning Advanced Large Language Models (LLMs) have revolutionized various fields, including communication networks, sparking an innovation wave that has led to new applications and services, and significantly enhanced solution schemes. Despite all these impressive developments, most LLMs typically require huge computational resources, resulting in terribly high energy consumption. Thus, this research study proposes an end-to-end pipeline that investigates the trade-off between energy efficiency and model performance for an LLM during fault ticket analysis in communication networks. It further evaluates the pipeline performance using two real-world datasets for the tasks of root cause analysis and response feedback in a communication network. Our results show that an appropriate combination of quantization and pruning techniques is able to reduce energy consumption while significantly improving model performance. |
| title | Energy-Aware LLMs: A step towards sustainable AI for downstream applications |
| topic | Performance Artificial Intelligence Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2503.17783 |