A Survey of Sustainability in Large Language Models: Applications, Economics, and Challenges

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Singh, Aditi, Patel, Nirmal Prakashbhai, Ehtesham, Abul, Kumar, Saket, Khoei, Tala Talaei
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913655362158592
author Singh, Aditi
Patel, Nirmal Prakashbhai
Ehtesham, Abul
Kumar, Saket
Khoei, Tala Talaei
author_facet Singh, Aditi
Patel, Nirmal Prakashbhai
Ehtesham, Abul
Kumar, Saket
Khoei, Tala Talaei
contents Large Language Models (LLMs) have transformed numerous domains by providing advanced capabilities in natural language understanding, generation, and reasoning. Despite their groundbreaking applications across industries such as research, healthcare, and creative media, their rapid adoption raises critical concerns regarding sustainability. This survey paper comprehensively examines the environmental, economic, and computational challenges associated with LLMs, focusing on energy consumption, carbon emissions, and resource utilization in data centers. By synthesizing insights from existing literature, this work explores strategies such as resource-efficient training, sustainable deployment practices, and lifecycle assessments to mitigate the environmental impacts of LLMs. Key areas of emphasis include energy optimization, renewable energy integration, and balancing performance with sustainability. The findings aim to guide researchers, practitioners, and policymakers in developing actionable strategies for sustainable AI systems, fostering a responsible and environmentally conscious future for artificial intelligence.
format Preprint
id arxiv_https___arxiv_org_abs_2412_04782
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Survey of Sustainability in Large Language Models: Applications, Economics, and Challenges
Singh, Aditi
Patel, Nirmal Prakashbhai
Ehtesham, Abul
Kumar, Saket
Khoei, Tala Talaei
Artificial Intelligence
Computational Engineering, Finance, and Science
Large Language Models (LLMs) have transformed numerous domains by providing advanced capabilities in natural language understanding, generation, and reasoning. Despite their groundbreaking applications across industries such as research, healthcare, and creative media, their rapid adoption raises critical concerns regarding sustainability. This survey paper comprehensively examines the environmental, economic, and computational challenges associated with LLMs, focusing on energy consumption, carbon emissions, and resource utilization in data centers. By synthesizing insights from existing literature, this work explores strategies such as resource-efficient training, sustainable deployment practices, and lifecycle assessments to mitigate the environmental impacts of LLMs. Key areas of emphasis include energy optimization, renewable energy integration, and balancing performance with sustainability. The findings aim to guide researchers, practitioners, and policymakers in developing actionable strategies for sustainable AI systems, fostering a responsible and environmentally conscious future for artificial intelligence.
title A Survey of Sustainability in Large Language Models: Applications, Economics, and Challenges
topic Artificial Intelligence
Computational Engineering, Finance, and Science
url https://arxiv.org/abs/2412.04782