Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latency

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Husom, Erik Johannes, Goknil, Arda, Astekin, Merve, Shar, Lwin Khin, Kåsen, Andre, Sen, Sagar, Mithassel, Benedikt Andreas, Soylu, Ahmet
Format:	Preprint
Published:	2025
Subjects:	Computers and Society Artificial Intelligence Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2504.03360