Cover Image

Toward Adaptive Large Language Models Structured Pruning via Hybrid-grained Weight Importance Assessment

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Jun, Kong, Zhenglun, Zhao, Pu, Yang, Changdi, Tang, Hao, Shen, Xuan, Yuan, Geng, Niu, Wei, Zhang, Wenbin, Lin, Xue, Huang, Dong, Wang, Yanzhi
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

TSLA: A Task-Specific Learning Adaptation for Semantic Segmentation on Autonomous Vehicles Platform
by: Liu, Jun, et al.
Published: (2025)

RoRA: Efficient Fine-Tuning of LLM with Reliability Optimization for Rank Adaptation
by: Liu, Jun, et al.
Published: (2025)

Structured Agent Distillation for Large Language Model
by: Liu, Jun, et al.
Published: (2025)

Pruning Foundation Models for High Accuracy without Retraining
by: Zhao, Pu, et al.
Published: (2024)

RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory
by: Liu, Jun, et al.
Published: (2025)

Rethinking Token Reduction for State Space Models
by: Zhan, Zheng, et al.
Published: (2024)

Fast and Memory-Efficient Video Diffusion Using Streamlined Inference
by: Zhan, Zheng, et al.
Published: (2024)

InstructGIE: Towards Generalizable Image Editing
by: Meng, Zichong, et al.
Published: (2024)

When Should a Robot Think? Resource-Aware Reasoning via Reinforcement Learning for Embodied Robotic Decision-Making
by: Liu, Jun, et al.
Published: (2026)

Exploring Token Pruning in Vision State Space Models
by: Zhan, Zheng, et al.
Published: (2024)

ACE: Exploring Activation Cosine Similarity and Variance for Accurate and Calibration-Efficient LLM Pruning
by: Mi, Zhendong, et al.
Published: (2025)

Squat: Quant Small Language Models on the Edge
by: Shen, Xuan, et al.
Published: (2024)

Search for Efficient Large Language Models
by: Shen, Xuan, et al.
Published: (2024)

ALTER: All-in-One Layer Pruning and Temporal Expert Routing for Efficient Diffusion Generation
by: Yang, Xiaomeng, et al.
Published: (2025)

Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge
by: Shen, Xuan, et al.
Published: (2023)

Enabling Flexible Multi-LLM Integration for Scalable Knowledge Aggregation
by: Kong, Zhenglun, et al.
Published: (2025)

DiffClass: Diffusion-Based Class Incremental Learning
by: Meng, Zichong, et al.
Published: (2024)

Brain Tumor Classification on MRI in Light of Molecular Markers
by: Liu, Jun, et al.
Published: (2024)

QuartDepth: Post-Training Quantization for Real-Time Depth Estimation on the Edge
by: Shen, Xuan, et al.
Published: (2025)

Token Transforming: A Unified and Training-Free Token Compression Framework for Vision Transformer Acceleration
by: Zeng, Fanhu, et al.
Published: (2025)

Adaptive Pruning for Large Language Models with Structural Importance Awareness
by: Zheng, Haotian, et al.
Published: (2024)

Sample-aware Adaptive Structured Pruning for Large Language Models
by: Kong, Jun, et al.
Published: (2025)

Quasar-ViT: Hardware-Oriented Quantization-Aware Architecture Search for Vision Transformers
by: Li, Zhengang, et al.
Published: (2024)

7B Fully Open Source Moxin-LLM/VLM -- From Pretraining to GRPO-based Reinforcement Learning Enhancement
by: Zhao, Pu, et al.
Published: (2024)

Open-Source Multimodal Moxin Models with Moxin-VLM and Moxin-VLA
by: Zhao, Pu, et al.
Published: (2025)

Advancing time series completion via RFAMoE and MDFF
by: Zhang, Ci, et al.
Published: (2025)

Heterogeneous Graph Prompt Learning via Adaptive Weight Pruning
by: Wei, Chu-Yuan, et al.
Published: (2025)

Numerical Pruning for Efficient Autoregressive Models
by: Shen, Xuan, et al.
Published: (2024)

Token Reduction Should Go Beyond Efficiency in Generative Models -- From Vision, Language to Multimodality
by: Kong, Zhenglun, et al.
Published: (2025)

SwiftPrune: Hessian-Free Weight Pruning for Large Language Models
by: Kang, Yuhan, et al.
Published: (2025)

IPPRO: Importance-based Pruning with PRojective Offset for Magnitude-indifferent Structural Pruning
by: Jung, Jaeheun, et al.
Published: (2025)

The Structural Scalpel: Automated Contiguous Layer Pruning for Large Language Models
by: Lu, Yao, et al.
Published: (2025)

TAMP: Token-Adaptive Layerwise Pruning in Multimodal Large Language Models
by: Lee, Jaewoo, et al.
Published: (2025)

DM3D: Distortion-Minimized Weight Pruning for Lossless 3D Object Detection
by: Xu, Kaixin, et al.
Published: (2024)

Prompt-prompted Adaptive Structured Pruning for Efficient LLM Generation
by: Dong, Harry, et al.
Published: (2024)

OmniMem: Scalable and Adaptive Memory Retrieval for Long Video Generation
by: Zhao, Lin, et al.
Published: (2026)

Diff-ES: Stage-wise Structural Diffusion Pruning via Evolutionary Search
by: Liu, Zongfang, et al.
Published: (2026)

PRANCE: Joint Token-Optimization and Structural Channel-Pruning for Adaptive ViT Inference
by: Li, Ye, et al.
Published: (2024)

PrunePath: Towards Highly Structured Sparse Language Models
by: Gu, Zhexuan, et al.
Published: (2026)

IWP: Token Pruning as Implicit Weight Pruning in Large Vision Language Models
by: Lee, Dong-Jae, et al.
Published: (2026)