Copertina

Capability-Guided Compression: Toward Interpretability-Aware Budget Allocation for Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Gupta, Rishaank
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Investigating Symbolic Capabilities of Large Language Models
di: Dave, Neisarg, et al.
Pubblicazione: (2024)

Towards Linguistically-Aware and Language-Independent Tokenization for Large Language Models (LLMs)
di: Rahman, Abrar, et al.
Pubblicazione: (2024)

BIPEFT: Budget-Guided Iterative Search for Parameter Efficient Fine-Tuning of Large Pretrained Language Models
di: Chang, Aofei, et al.
Pubblicazione: (2024)

Interpretable Steering of Large Language Models with Feature Guided Activation Additions
di: Soo, Samuel, et al.
Pubblicazione: (2025)

BAQ: Efficient Bit Allocation Quantization for Large Language Models
di: Zhang, Chao, et al.
Pubblicazione: (2025)

Crosslingual Capabilities and Knowledge Barriers in Multilingual Large Language Models
di: Chua, Lynn, et al.
Pubblicazione: (2024)

Crafting Large Language Models for Enhanced Interpretability
di: Sun, Chung-En, et al.
Pubblicazione: (2024)

Alloc-MoE: Budget-Aware Expert Activation Allocation for Efficient Mixture-of-Experts Inference
di: Liu, Baihui, et al.
Pubblicazione: (2026)

AutoGuide: Automated Generation and Selection of Context-Aware Guidelines for Large Language Model Agents
di: Fu, Yao, et al.
Pubblicazione: (2024)

Towards Chapter-to-Chapter Context-Aware Literary Translation via Large Language Models
di: Jin, Linghao, et al.
Pubblicazione: (2024)

Mind the Gap: Examining the Self-Improvement Capabilities of Large Language Models
di: Song, Yuda, et al.
Pubblicazione: (2024)

A Review of Developmental Interpretability in Large Language Models
di: Kendiukhov, Ihor
Pubblicazione: (2025)

Automatically Interpreting Millions of Features in Large Language Models
di: Paulo, Gonçalo, et al.
Pubblicazione: (2024)

SCALPEL: Selective Capability Ablation via Low-rank Parameter Editing for Large Language Model Interpretability Analysis
di: Fu, Zihao, et al.
Pubblicazione: (2026)

Radio: Rate-Distortion Optimization for Large Language Model Compression
di: Young, Sean I.
Pubblicazione: (2025)

Extreme Compression of Large Language Models via Additive Quantization
di: Egiazarian, Vage, et al.
Pubblicazione: (2024)

Towards Interpretable Sequence Continuation: Analyzing Shared Circuits in Large Language Models
di: Lan, Michael, et al.
Pubblicazione: (2023)

Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization
di: Liu, Yixin, et al.
Pubblicazione: (2023)

TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators
di: Li, Jianling, et al.
Pubblicazione: (2025)

On the Compressibility of Quantized Large Language Models
di: Mao, Yu, et al.
Pubblicazione: (2024)

SliceGPT: Compress Large Language Models by Deleting Rows and Columns
di: Ashkboos, Saleh, et al.
Pubblicazione: (2024)

FoldGPT: Simple and Effective Large Language Model Compression Scheme
di: Liu, Songwei, et al.
Pubblicazione: (2024)

Iterative Layer-wise Distillation for Efficient Compression of Large Language Models
di: Kovalev, Grigory, et al.
Pubblicazione: (2025)

Foundations of Large Language Model Compression -- Part 1: Weight Quantization
di: Young, Sean I.
Pubblicazione: (2024)

FineZip : Pushing the Limits of Large Language Models for Practical Lossless Text Compression
di: Mittu, Fazal, et al.
Pubblicazione: (2024)

Towards Interpretable Hate Speech Detection using Large Language Model-extracted Rationales
di: Nirmal, Ayushi, et al.
Pubblicazione: (2024)

On Calibration of Large Language Models: From Response To Capability
di: Yang, Sin-Han, et al.
Pubblicazione: (2026)

Exploring and Benchmarking the Planning Capabilities of Large Language Models
di: Bohnet, Bernd, et al.
Pubblicazione: (2024)

FinanceQA: A Benchmark for Evaluating Financial Analysis Capabilities of Large Language Models
di: Mateega, Spencer, et al.
Pubblicazione: (2025)

CARL-GT: Evaluating Causal Reasoning Capabilities of Large Language Models
di: Tu, Ruibo, et al.
Pubblicazione: (2024)

How Attention Sinks Emerge in Large Language Models: An Interpretability Perspective
di: Peng, Runyu, et al.
Pubblicazione: (2026)

PocketLLM: Ultimate Compression of Large Language Models via Meta Networks
di: Tian, Ye, et al.
Pubblicazione: (2025)

Basis Sharing: Cross-Layer Parameter Sharing for Large Language Model Compression
di: Wang, Jingcun, et al.
Pubblicazione: (2024)

Proxy Compression for Language Modeling
di: Zheng, Lin, et al.
Pubblicazione: (2026)

Budgeted LoRA: Distillation as Structured Compute Allocation for Efficient Inference
di: Sabry, Mohammed, et al.
Pubblicazione: (2026)

Evaluating the Generalization Capabilities of Large Language Models on Code Reasoning
di: Yang, Rem, et al.
Pubblicazione: (2025)

Knapsack RL: Unlocking Exploration of LLMs via Optimizing Budget Allocation
di: Li, Ziniu, et al.
Pubblicazione: (2025)

Rethinking Interpretability in the Era of Large Language Models
di: Singh, Chandan, et al.
Pubblicazione: (2024)

Thermometer: Towards Universal Calibration for Large Language Models
di: Shen, Maohao, et al.
Pubblicazione: (2024)

FERA: Uncertainty-Aware Federated Reasoning for Large Language Models
di: Wang, Ruhan, et al.
Pubblicazione: (2026)