Copertina

EntroLLM: Entropy Encoded Weight Compression for Efficient Large Language Model Inference on Edge Devices

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Sanyal, Arnab, Datta, Gourav, Mukherjee, Prithwish, Chinchali, Sandeep P., Orshansky, Michael
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

LE-NeuS: Latency-Efficient Neuro-Symbolic Video Understanding via Adaptive Temporal Verification
di: Liang, Shawn, et al.
Pubblicazione: (2026)

OASIS: Optimized Lightweight Autoencoder System for Distributed In-Sensor computing
di: Zhou, Chengwei, et al.
Pubblicazione: (2025)

EntroCut: Entropy-Guided Adaptive Truncation for Efficient Chain-of-Thought Reasoning in Small-scale Large Reasoning Models
di: Yan, Hongxi, et al.
Pubblicazione: (2026)

EntroGD: Scalable Generalized Deduplication for Efficient Direct Analytics on Compressed IoT Data
di: Zhao, Xiaobo, et al.
Pubblicazione: (2025)

Exploiting Distribution Constraints for Scalable and Efficient Image Retrieval
di: Omama, Mohammad, et al.
Pubblicazione: (2024)

EntroCoT: Enhancing Chain-of-Thought via Adaptive Entropy-Guided Segmentation
di: Li, Zihang, et al.
Pubblicazione: (2026)

MoS-VLA: A Vision-Language-Action Model with One-Shot Skill Adaptation
di: Zhao, Ruihan, et al.
Pubblicazione: (2025)

Hermes: Memory-Efficient Pipeline Inference for Large Models on Edge Devices
di: Han, Xueyuan, et al.
Pubblicazione: (2024)

TensorCommitments: A Lightweight Verifiable Inference for Language Models
di: Baser, Oguzhan, et al.
Pubblicazione: (2026)

TinyLLM: Evaluation and Optimization of Small Language Models for Agentic Tasks on Edge Devices
di: Haque, Mohd Ariful, et al.
Pubblicazione: (2025)

EntroAD: Structural Entropy-Guided Prompt Adaptation for Zero-Shot Anomaly Detection
di: Zhao, Xinyu, et al.
Pubblicazione: (2026)

EDGE-LLM: Enabling Efficient Large Language Model Adaptation on Edge Devices via Layerwise Unified Compression and Adaptive Layer Tuning and Voting
di: Yu, Zhongzhi, et al.
Pubblicazione: (2024)

On-Device Qwen2.5: Efficient LLM Inference with Model Compression and Hardware Acceleration
di: Xiang, Maoyang, et al.
Pubblicazione: (2025)

SecureSpectra: Safeguarding Digital Identity from Deep Fake Threats via Intelligent Signatures
di: Baser, Oguzhan, et al.
Pubblicazione: (2024)

Failure-Resilient Distributed Inference with Model Compression over Heterogeneous Edge Devices
di: Wang, Li, et al.
Pubblicazione: (2024)

Peek2: Regex-free Byte-level Byte-Pair Encoding Pretokenizer for LLM Inference on Edge Devices
di: Zai, Liu, et al.
Pubblicazione: (2026)

Learning Scalable Temporal Representations in Spiking Neural Networks Without Labels
di: Zhou, Chengwei, et al.
Pubblicazione: (2025)

SlimEdge: Performance and Device Aware Distributed DNN Deployment on Resource-Constrained Edge Hardware
di: Kumar, Mahadev Sunil, et al.
Pubblicazione: (2025)

GELATO: Generative Entropy- and Lyapunov-based Adaptive Token Offloading for Device-Edge Speculative LLM Inference
di: Tang, Zengzipeng, et al.
Pubblicazione: (2026)

Dynamic Compressing Prompts for Efficient Inference of Large Language Models
di: Hu, Jinwu, et al.
Pubblicazione: (2025)

ReDistill: Residual Encoded Distillation for Peak Memory Reduction of CNNs
di: Chen, Fang, et al.
Pubblicazione: (2024)

PhonemeFake: Redefining Deepfake Realism with Language-Driven Segmental Manipulation and Adaptive Bilevel Detection
di: Baser, Oguzhan, et al.
Pubblicazione: (2025)

Model Compression and Efficient Inference for Large Language Models: A Survey
di: Wang, Wenxiao, et al.
Pubblicazione: (2024)

EntroLnn: Entropy-Guided Liquid Neural Networks for Operando Refinement of Battery Capacity Fade Trajectories
di: Li, Wei, et al.
Pubblicazione: (2026)

Safe Networked Robotics with Probabilistic Verification
di: Narasimhan, Sai Shankar, et al.
Pubblicazione: (2023)

CSA: Data-efficient Mapping of Unimodal Features to Multimodal Features
di: Li, Po-han, et al.
Pubblicazione: (2024)

Presto: Hardware Acceleration of Ciphers for Hybrid Homomorphic Encryption
di: Jeon, Yeonsoo, et al.
Pubblicazione: (2025)

HyperVL: An Efficient and Dynamic Multimodal Large Language Model for Edge Devices
di: HyperAI Team, et al.
Pubblicazione: (2025)

EntroPIC: Towards Stable Long-Term Training of LLMs via Entropy Stabilization with Proportional-Integral Control
di: Yang, Kai, et al.
Pubblicazione: (2025)

Mixed-Precision Quantization for Deep Vision Models with Integer Quadratic Programming
di: Deng, Zihao, et al.
Pubblicazione: (2023)

EdgeFM: Efficient Edge Inference for Vision-Language Models
di: Deng, Mengling, et al.
Pubblicazione: (2026)

Designing Efficient LLM Accelerators for Edge Devices
di: Haris, Jude, et al.
Pubblicazione: (2024)

CoVSpec: Efficient Device-Edge Co-Inference for Vision-Language Models via Speculative Decoding
di: Jia, Yuanyuan, et al.
Pubblicazione: (2026)

Efficient Driving Behavior Narration and Reasoning on Edge Device Using Large Language Models
di: Huang, Yizhou, et al.
Pubblicazione: (2024)

Prompt Compression with Context-Aware Sentence Encoding for Fast and Improved LLM Inference
di: Liskavets, Barys, et al.
Pubblicazione: (2024)

SynDiff-AD: Improving Semantic Segmentation and End-to-End Autonomous Driving with Synthetic Data from Latent Diffusion Models
di: Goel, Harsh, et al.
Pubblicazione: (2024)

Model-Distributed Inference for Large Language Models at the Edge
di: Macario, Davide, et al.
Pubblicazione: (2025)

SpreadsheetLLM: Encoding Spreadsheets for Large Language Models
di: Dong, Haoyu, et al.
Pubblicazione: (2024)

Large Language Models Inference Engines based on Spiking Neural Networks
di: Balaji, Adarsha, et al.
Pubblicazione: (2025)

Prediction-Powered Inference with Inverse Probability Weighting
di: Datta, Jyotishka, et al.
Pubblicazione: (2025)