From Transformers to LLMs: A Systematic Survey of Efficiency Considerations in NLP

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ansar, Wazib, Goswami, Saptarsi, Chakrabarti, Amlan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915702080798720
author Ansar, Wazib
Goswami, Saptarsi
Chakrabarti, Amlan
author_facet Ansar, Wazib
Goswami, Saptarsi
Chakrabarti, Amlan
contents The emergence of Transformer-based Large Language Models (LLMs) has substantially augmented the capabilities of Natural Language Processing (NLP), thereby intensifying the demand for computational resources. Therefore, enhancing efficiency based on factors like computational requirements, energy consumption, carbon footprint and financial cost has become a vital area of research. This motivates us to conduct a systematic literature review on Transformer-based LLMs in NLP from the perspective of efficiency. In this survey of 312 articles published between the years 2011 and 2025, efficiency-improvement endeavors have been systematically discussed targeting various aspects such as data curation, model design, model downsizing, and dynamic inferencing. This has been augmented with efficiency considerations in model adaptation strategies like pre-training, fine-tuning, prompt-engineering and Retrieval-Augmented Generation (RAG). Furthermore, a statistical analysis of the articles has been performed followed by an in-depth evaluation of the efficiency and efficacy of more than 30 renowned NLP models has been conducted on 13 evaluation benchmarks. This paper offers valuable insights for researchers, professionals as well as scholars, and explores the trend of research toward sustainable practices in NLP.
format Preprint
id arxiv_https___arxiv_org_abs_2406_16893
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle From Transformers to LLMs: A Systematic Survey of Efficiency Considerations in NLP
Ansar, Wazib
Goswami, Saptarsi
Chakrabarti, Amlan
Computation and Language
Artificial Intelligence
The emergence of Transformer-based Large Language Models (LLMs) has substantially augmented the capabilities of Natural Language Processing (NLP), thereby intensifying the demand for computational resources. Therefore, enhancing efficiency based on factors like computational requirements, energy consumption, carbon footprint and financial cost has become a vital area of research. This motivates us to conduct a systematic literature review on Transformer-based LLMs in NLP from the perspective of efficiency. In this survey of 312 articles published between the years 2011 and 2025, efficiency-improvement endeavors have been systematically discussed targeting various aspects such as data curation, model design, model downsizing, and dynamic inferencing. This has been augmented with efficiency considerations in model adaptation strategies like pre-training, fine-tuning, prompt-engineering and Retrieval-Augmented Generation (RAG). Furthermore, a statistical analysis of the articles has been performed followed by an in-depth evaluation of the efficiency and efficacy of more than 30 renowned NLP models has been conducted on 13 evaluation benchmarks. This paper offers valuable insights for researchers, professionals as well as scholars, and explores the trend of research toward sustainable practices in NLP.
title From Transformers to LLMs: A Systematic Survey of Efficiency Considerations in NLP
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2406.16893