Brevity is the soul of sustainability: Characterizing LLM response lengths
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912455588839424 |
|---|---|
| author | Poddar, Soham Koley, Paramita Misra, Janardan Podder, Sanjay Balani, Navveen Ganguly, Niloy Ghosh, Saptarshi |
| author_facet | Poddar, Soham Koley, Paramita Misra, Janardan Podder, Sanjay Balani, Navveen Ganguly, Niloy Ghosh, Saptarshi |
| contents | A significant portion of the energy consumed by Large Language Models (LLMs) arises from their inference processes; hence developing energy-efficient methods for inference is crucial. While several techniques exist for inference optimization, output compression remains relatively unexplored, with only a few preliminary efforts addressing this aspect. In this work, we first benchmark 12 decoder-only LLMs across 5 datasets, revealing that these models often produce responses that are substantially longer than necessary. We then conduct a comprehensive quality assessment of LLM responses, formally defining six information categories present in LLM responses. We show that LLMs often tend to include redundant or additional information besides the minimal answer. To address this issue of long responses by LLMs, we explore several simple and intuitive prompt-engineering strategies. Empirical evaluation shows that appropriate prompts targeting length reduction and controlling information content can achieve significant energy optimization between 25-60\% by reducing the response length while preserving the quality of LLM responses. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_08686 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Brevity is the soul of sustainability: Characterizing LLM response lengths Poddar, Soham Koley, Paramita Misra, Janardan Podder, Sanjay Balani, Navveen Ganguly, Niloy Ghosh, Saptarshi Computation and Language Computers and Society A significant portion of the energy consumed by Large Language Models (LLMs) arises from their inference processes; hence developing energy-efficient methods for inference is crucial. While several techniques exist for inference optimization, output compression remains relatively unexplored, with only a few preliminary efforts addressing this aspect. In this work, we first benchmark 12 decoder-only LLMs across 5 datasets, revealing that these models often produce responses that are substantially longer than necessary. We then conduct a comprehensive quality assessment of LLM responses, formally defining six information categories present in LLM responses. We show that LLMs often tend to include redundant or additional information besides the minimal answer. To address this issue of long responses by LLMs, we explore several simple and intuitive prompt-engineering strategies. Empirical evaluation shows that appropriate prompts targeting length reduction and controlling information content can achieve significant energy optimization between 25-60\% by reducing the response length while preserving the quality of LLM responses. |
| title | Brevity is the soul of sustainability: Characterizing LLM response lengths |
| topic | Computation and Language Computers and Society |
| url | https://arxiv.org/abs/2506.08686 |