Imagen de Portada

DISP-LLM: Dimension-Independent Structural Pruning for Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Gao, Shangqian, Lin, Chi-Heng, Hua, Ting, Zheng, Tang, Shen, Yilin, Jin, Hongxia, Hsu, Yen-Chang
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

FlexiGPT: Pruning and Extending Large Language Models with Low-Rank Weight Sharing
por: Smith, James Seale, et al.
Publicado: (2025)

MoDeGPT: Modular Decomposition for Large Language Model Compression
por: Lin, Chi-Heng, et al.
Publicado: (2024)

ToMoE: Converting Dense Large Language Models to Mixture-of-Experts through Dynamic Structural Pruning
por: Gao, Shangqian, et al.
Publicado: (2025)

DynaMo: Accelerating Language Model Inference with Dynamic Multi-Token Sampling
por: Tuli, Shikhar, et al.
Publicado: (2024)

Dynamic Noise Preference Optimization: Self-Improvement of Large Language Models with Self-Synthetic Data
por: Yang, Haoyan, et al.
Publicado: (2025)

MossNet: Mixture of State-Space Experts is a Multi-Head Attention
por: Tuli, Shikhar, et al.
Publicado: (2025)

DarwinLM: Evolutionary Structured Pruning of Large Language Models
por: Tang, Shengkun, et al.
Publicado: (2025)

MINI-LLM: Memory-Efficient Structured Pruning for Large Language Models
por: Cheng, Hongrong, et al.
Publicado: (2024)

All-in-One Tuning and Structural Pruning for Domain-Specific LLMs
por: Lu, Lei, et al.
Publicado: (2024)

Jointly Training and Pruning CNNs via Learnable Agent Guidance and Alignment
por: Ganjdanesh, Alireza, et al.
Publicado: (2024)

Transformation-Augmented GRPO for Enhancing Exploration in Reasoning of Large Language Models
por: Le, Khiem, et al.
Publicado: (2026)

Continual Diffusion: Continual Customization of Text-to-Image Diffusion with C-LoRA
por: Smith, James Seale, et al.
Publicado: (2023)

Olica: Efficient Structured Pruning of Large Language Models without Retraining
por: He, Jiujun, et al.
Publicado: (2025)

High-Fidelity Pruning for Large Language Models
por: Zhu, Yijun, et al.
Publicado: (2026)

Sample-aware Adaptive Structured Pruning for Large Language Models
por: Kong, Jun, et al.
Publicado: (2025)

Prompt-prompted Adaptive Structured Pruning for Efficient LLM Generation
por: Dong, Harry, et al.
Publicado: (2024)

PIP: Perturbation-based Iterative Pruning for Large Language Models
por: Cao, Yi, et al.
Publicado: (2025)

Continual Diffusion with STAMINA: STack-And-Mask INcremental Adapters
por: Smith, James Seale, et al.
Publicado: (2023)

Pruning Large Language Models to Intra-module Low-rank Architecture with Transitional Activations
por: Shen, Bowen, et al.
Publicado: (2024)

LLM-BIP: Structured Pruning for Large Language Models with Block-Wise Forward Importance Propagation
por: Wu, Haihang
Publicado: (2024)

Adaptive Pruning for Large Language Models with Structural Importance Awareness
por: Zheng, Haotian, et al.
Publicado: (2024)

Toward Adaptive Large Language Models Structured Pruning via Hybrid-grained Weight Importance Assessment
por: Liu, Jun, et al.
Publicado: (2024)

Instruction-Following Pruning for Large Language Models
por: Hou, Bairu, et al.
Publicado: (2025)

Measuring Taiwanese Mandarin Language Understanding
por: Chen, Po-Heng, et al.
Publicado: (2024)

Deterministic Differentiable Structured Pruning for Large Language Models
por: Huang, Weiyu, et al.
Publicado: (2026)

Improving Generalization in LLM Structured Pruning via Function-Aware Neuron Grouping
por: Yu, Tao, et al.
Publicado: (2025)

Any Large Language Model Can Be a Reliable Judge: Debiasing with a Reasoning-based Bias Detector
por: Yang, Haoyan, et al.
Publicado: (2025)

Iterative Structured Pruning for Large Language Models with Multi-Domain Calibration
por: Wu, Guangxin, et al.
Publicado: (2026)

KVPruner: Structural Pruning for Faster and Memory-Efficient Large Language Models
por: Lv, Bo, et al.
Publicado: (2024)

Structural Pruning of Large Vision Language Models: A Comprehensive Study on Pruning Dynamics, Recovery, and Data Efficiency
por: Huang, Yiran, et al.
Publicado: (2026)

Understanding Performance Collapse in Layer-Pruned Large Language Models via Decision Representation Transitions
por: Shi, Boyu, et al.
Publicado: (2026)

One-for-All Pruning: A Universal Model for Customized Compression of Large Language Models
por: Ye, Rongguang, et al.
Publicado: (2025)

Not All Prompts Are Made Equal: Prompt-based Pruning of Text-to-Image Diffusion Models
por: Ganjdanesh, Alireza, et al.
Publicado: (2024)

Unlocking Memorization in Large Language Models with Dynamic Soft Prompting
por: Wang, Zhepeng, et al.
Publicado: (2024)

RCPU: Rotation-Constrained Error Compensation for Structured Pruning of Large Language Models
por: Haruta, Shuichiro, et al.
Publicado: (2025)

GPTailor: Large Language Model Pruning Through Layer Cutting and Stitching
por: Su, Guinan, et al.
Publicado: (2025)

Bypass Back-propagation: Optimization-based Structural Pruning for Large Language Models via Policy Gradient
por: Gao, Yuan, et al.
Publicado: (2024)

Characterizing Truthfulness in Large Language Model Generations with Local Intrinsic Dimension
por: Yin, Fan, et al.
Publicado: (2024)

IG-Pruning: Input-Guided Block Pruning for Large Language Models
por: Qiao, Kangyu, et al.
Publicado: (2025)

SDMPrune: Self-Distillation MLP Pruning for Efficient Large Language Models
por: Zhu, Hourun, et al.
Publicado: (2025)