Imagen de Portada

GPTailor: Large Language Model Pruning Through Layer Cutting and Stitching

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Su, Guinan, Shen, Li, Yin, Lu, Liu, Shiwei, Yang, Yanwu, Geiping, Jonas
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Rewiring Experts on the Fly:Continuous Rerouting for Better Online Adaptation in Mixture-of-Expert models
por: Su, Guinan, et al.
Publicado: (2025)

Multi-Stream LLMs: Unblocking Language Models with Parallel Streams of Thoughts, Inputs and Outputs
por: Su, Guinan, et al.
Publicado: (2026)

Efficient Parallel Samplers for Recurrent-Depth Models and Their Connection to Diffusion Language Models
por: Geiping, Jonas, et al.
Publicado: (2025)

Sample Smart, Not Hard: Correctness-First Decoding for Better Reasoning in LLMs
por: Li, Xueyan, et al.
Publicado: (2025)

When Fewer Layers Break More Chains: Layer Pruning Harms Test-Time Scaling in LLMs
por: Wang, Keyu, et al.
Publicado: (2025)

MedSAMix: A Training-Free Model Merging Approach for Medical Image Segmentation
por: Yang, Yanwu, et al.
Publicado: (2025)

Fine, I'll Merge It Myself: A Multi-Fidelity Framework for Automated Model Merging
por: Su, Guinan, et al.
Publicado: (2025)

Condense, Don't Just Prune: Enhancing Efficiency and Performance in MoE Layer Pruning
por: Cao, Mingyu, et al.
Publicado: (2024)

Is C4 Dataset Optimal for Pruning? An Investigation of Calibration Data for LLM Pruning
por: Bandari, Abhinav, et al.
Publicado: (2024)

A Simple Linear Patch Revives Layer-Pruned Large Language Models
por: Chen, Xinrui, et al.
Publicado: (2025)

A Watermark for Large Language Models
por: Kirchenbauer, John, et al.
Publicado: (2023)

LaCo: Large Language Model Pruning via Layer Collapse
por: Yang, Yifei, et al.
Publicado: (2024)

High-Fidelity Pruning for Large Language Models
por: Zhu, Yijun, et al.
Publicado: (2026)

An Interpretable N-gram Perplexity Threat Model for Large Language Model Jailbreaks
por: Boreiko, Valentyn, et al.
Publicado: (2024)

Efficiently Dispatching Flash Attention For Partially Filled Attention Masks
por: Sharma, Agniv, et al.
Publicado: (2024)

E$^3$-Pruner: Towards Efficient, Economical, and Effective Layer Pruning for Large Language Models
por: Yuan, Tao, et al.
Publicado: (2025)

IG-Pruning: Input-Guided Block Pruning for Large Language Models
por: Qiao, Kangyu, et al.
Publicado: (2025)

Understanding Performance Collapse in Layer-Pruned Large Language Models via Decision Representation Transitions
por: Shi, Boyu, et al.
Publicado: (2026)

InfoMerge: Information-aware Token Compression for Efficient Video Large Language Models
por: Liu, Xinxin, et al.
Publicado: (2026)

Instruction-Following Pruning for Large Language Models
por: Hou, Bairu, et al.
Publicado: (2025)

Why Lift so Heavy? Slimming Large Language Models by Cutting Off the Layers
por: Yuan, Shuzhou, et al.
Publicado: (2024)

Models That Know How Evaluations Are Designed Score Safer
por: Deckenbach, Katharina, et al.
Publicado: (2026)

Why Diffusion Language Models Struggle with Truly Parallel (Non-Autoregressive) Decoding?
por: Li, Pengxiang, et al.
Publicado: (2026)

Answer Matching Outperforms Multiple Choice for Language Model Evaluation
por: Chandak, Nikhil, et al.
Publicado: (2025)

NutePrune: Efficient Progressive Pruning with Numerous Teachers for Large Language Models
por: Li, Shengrui, et al.
Publicado: (2024)

Diffusion Language Models Know the Answer Before Decoding
por: Li, Pengxiang, et al.
Publicado: (2025)

On the Reliability of Watermarks for Large Language Models
por: Kirchenbauer, John, et al.
Publicado: (2023)

ActTail: Global Activation Sparsity in Large Language Models
por: Hou, Wenwen, et al.
Publicado: (2026)

PAT: Pruning-Aware Tuning for Large Language Models
por: Liu, Yijiang, et al.
Publicado: (2024)

Frustratingly Easy Task-aware Pruning for Large Language Models
por: Tian, Yuanhe, et al.
Publicado: (2025)

DarwinLM: Evolutionary Structured Pruning of Large Language Models
por: Tang, Shengkun, et al.
Publicado: (2025)

SkipGPT: Dynamic Layer Pruning Reinvented with Token Awareness and Module Decoupling
por: Zhao, Anhao, et al.
Publicado: (2025)

BlockPruner: Fine-grained Pruning for Large Language Models
por: Zhong, Longguang, et al.
Publicado: (2024)

DRPruning: Efficient Large Language Model Pruning through Distributionally Robust Optimization
por: Deng, Hexuan, et al.
Publicado: (2024)

Contextual Compression Encoding for Large Language Models: A Novel Framework for Multi-Layered Parameter Space Pruning
por: Schmitt, Barnaby, et al.
Publicado: (2025)

CoViPAL: Layer-wise Contextualized Visual Token Pruning for Large Vision-Language Models
por: Tang, Zicong, et al.
Publicado: (2025)

PASER: Post-Training Data Selection for Efficient Pruned Large Language Model Recovery
por: He, Bowei, et al.
Publicado: (2025)

SDMPrune: Self-Distillation MLP Pruning for Efficient Large Language Models
por: Zhu, Hourun, et al.
Publicado: (2025)

ROSE: Reordered SparseGPT for More Accurate One-Shot Large Language Models Pruning
por: Su, Mingluo, et al.
Publicado: (2026)

Pruning as a Cooperative Game: Surrogate-Assisted Layer Contribution Estimation for Large Language Models
por: Ding, Xuan, et al.
Publicado: (2026)