DASH: Input-Aware Dynamic Layer Skipping for Efficient LLM Inference with Markov Decision Policies

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yang, Ning, Liu, Fangxin, Wang, Junjie, Yang, Tao, Liu, Kan, Guan, Haibing, Jiang, Li
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!