Compressing Large Language Models with Automated Sub-Network Search

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sukthanker, Rhea Sanjay, Staffler, Benedikt, Hutter, Frank, Klein, Aaron
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Multi-objective Differentiable Neural Architecture Search
by: Sukthanker, Rhea Sanjay, et al.
Published: (2024)

HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models
by: Sukthanker, Rhea Sanjay, et al.
Published: (2024)

Where to Begin: Efficient Pretraining via Subnetwork Selection and Distillation
by: Krishnakumar, Arjun, et al.
Published: (2025)

Weight-Entanglement Meets Gradient-Based Neural Architecture Search
by: Sukthanker, Rhea Sanjay, et al.
Published: (2023)

Structural Pruning of Pre-trained Language Models via Neural Architecture Search
by: Klein, Aaron, et al.
Published: (2024)

Transfer Learning for Finetuning Large Language Models
by: Strangmann, Tobias, et al.
Published: (2024)

Metacognitive Myopia in Large Language Models
by: Scholten, Florian, et al.
Published: (2024)

Compression Laws for Large Language Models
by: Sengupta, Ayan, et al.
Published: (2025)

Evaluating Large Language Models for Generalization and Robustness via Data Compression
by: Li, Yucheng, et al.
Published: (2024)

LoRAP: Transformer Sub-Layers Deserve Differentiated Structured Compression for Large Language Models
by: Li, Guangyan, et al.
Published: (2024)

The Chameleon Nature of LLMs: Quantifying Multi-Turn Stance Instability in Search-Enabled Language Models
by: Ratnakar, Shivam, et al.
Published: (2025)

Auto-Search and Refinement: An Automated Framework for Gender Bias Mitigation in Large Language Models
by: Xu, Yue, et al.
Published: (2025)

Prompt Compression for Large Language Models: A Survey
by: Li, Zongqian, et al.
Published: (2024)

Optimizing Singular Spectrum for Large Language Model Compression
by: Li, Dengjie, et al.
Published: (2025)

SPQ: An Ensemble Technique for Large Language Model Compression
by: Yao, Jiamin, et al.
Published: (2026)

Compressed Sensing for Capability Localization in Large Language Models
by: Bair, Anna, et al.
Published: (2026)

Pose Priors from Language Models
by: Subramanian, Sanjay, et al.
Published: (2024)

HindiLLM: Large Language Model for Hindi
by: Chouhan, Sanjay, et al.
Published: (2024)

PocketLLM: Ultimate Compression of Large Language Models via Meta Networks
by: Tian, Ye, et al.
Published: (2025)

Confidence-Aware Sub-Structure Beam Search (CABS): Mitigating Hallucination in Structured Data Generation with Large Language Models
by: Wei, Chengwei, et al.
Published: (2024)

When Compression Meets Model Compression: Memory-Efficient Double Compression for Large Language Models
by: Wang, Weilan, et al.
Published: (2025)

Language Modeling Is Compression
by: Delétang, Grégoire, et al.
Published: (2023)

Data-free Weight Compress and Denoise for Large Language Models
by: Peng, Runyu, et al.
Published: (2024)

A Review on Large Language Models for Visual Analytics
by: Agarwal, Navya Sonal, et al.
Published: (2025)

Contrastive Perplexity for Controlled Generation: An Application in Detoxifying Large Language Models
by: Klein, Tassilo, et al.
Published: (2024)

A Survey on Model Compression for Large Language Models
by: Zhu, Xunyu, et al.
Published: (2023)

Saten: Sparse Augmented Tensor Networks for Post-Training Compression of Large Language Models
by: Solgi, Ryan, et al.
Published: (2025)

Large Language Models as Search Engines: Societal Challenges
by: Sadeddine, Zacchary, et al.
Published: (2025)

On the Compressibility of Quantized Large Language Models
by: Mao, Yu, et al.
Published: (2024)

In-Context Former: Lightning-fast Compressing Context for Large Language Model
by: Wang, Xiangfeng, et al.
Published: (2024)

500xCompressor: Generalized Prompt Compression for Large Language Models
by: Li, Zongqian, et al.
Published: (2024)

Vision-centric Token Compression in Large Language Model
by: Xing, Ling, et al.
Published: (2025)

Multilingual Brain Surgeon: Large Language Models Can be Compressed Leaving No Language Behind
by: Zeng, Hongchuan, et al.
Published: (2024)

Search-in-the-Chain: Interactively Enhancing Large Language Models with Search for Knowledge-intensive Tasks
by: Xu, Shicheng, et al.
Published: (2023)

Automated Privacy Information Annotation in Large Language Model Interactions
by: Zeng, Hang, et al.
Published: (2025)

Automated Benchmark Auditing for AI Agents and Large Language Models
by: Wang, Junlin, et al.
Published: (2026)

Hallucination is Inevitable: An Innate Limitation of Large Language Models
by: Xu, Ziwei, et al.
Published: (2024)

An Empirical Study on Prompt Compression for Large Language Models
by: Zhang, Zheng, et al.
Published: (2025)

Ensembling Finetuned Language Models for Text Classification
by: Arango, Sebastian Pineda, et al.
Published: (2024)

Searching for Structure: Investigating Emergent Communication with Large Language Models
by: Kouwenhoven, Tom, et al.
Published: (2024)