Copertina

All-in-One Tuning and Structural Pruning for Domain-Specific LLMs

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Lu, Lei, Wang, Zhepeng, Bao, Runxue, Wang, Mengbing, Li, Fangyi, Wu, Yawen, Jiang, Weiwen, Xu, Jie, Wang, Yanzhi, Gao, Shangqian
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Unlocking Memorization in Large Language Models with Dynamic Soft Prompting
di: Wang, Zhepeng, et al.
Pubblicazione: (2024)

ALTER: All-in-One Layer Pruning and Temporal Expert Routing for Efficient Diffusion Generation
di: Yang, Xiaomeng, et al.
Pubblicazione: (2025)

A Self-guided Multimodal Approach to Enhancing Graph Representation Learning for Alzheimer's Diseases
di: Wang, Zhepeng, et al.
Pubblicazione: (2024)

Auto-Train-Once: Controller Network Guided Automatic Network Pruning from Scratch
di: Wu, Xidong, et al.
Pubblicazione: (2024)

Not All Prompts Are Made Equal: Prompt-based Pruning of Text-to-Image Diffusion Models
di: Ganjdanesh, Alireza, et al.
Pubblicazione: (2024)

Pruning as a Domain-specific LLM Extractor
di: Zhang, Nan, et al.
Pubblicazione: (2024)

Efficient Fine-Tuning and Concept Suppression for Pruned Diffusion Models
di: Shirkavand, Reza, et al.
Pubblicazione: (2024)

Any Large Language Model Can Be a Reliable Judge: Debiasing with a Reasoning-based Bias Detector
di: Yang, Haoyan, et al.
Pubblicazione: (2025)

Jointly Training and Pruning CNNs via Learnable Agent Guidance and Alignment
di: Ganjdanesh, Alireza, et al.
Pubblicazione: (2024)

Safe Screening Rules for Group SLOPE
di: Bao, Runxue, et al.
Pubblicazione: (2025)

Safe Screening Rules for Group OWL Models
di: Bao, Runxue, et al.
Pubblicazione: (2025)

ToMoE: Converting Dense Large Language Models to Mixture-of-Experts through Dynamic Structural Pruning
di: Gao, Shangqian, et al.
Pubblicazione: (2025)

One Dual Stimulus Response Molecular Imprinted Hydrogel for Specific Recognition and Enrichment of Doxorubicin
di: Tian Yawen, et al.
Pubblicazione: (2025)

PristiQ: A Co-Design Framework for Preserving Data Security of Quantum Learning in the Cloud
di: Wang, Zhepeng, et al.
Pubblicazione: (2024)

DARE: Difficulty-Adaptive Reinforcement Learning with Co-Evolved Difficulty Estimation
di: Zhou, Yang, et al.
Pubblicazione: (2026)

DISP-LLM: Dimension-Independent Structural Pruning for Large Language Models
di: Gao, Shangqian, et al.
Pubblicazione: (2024)

HDCompression: Hybrid-Diffusion Image Compression for Ultra-Low Bitrates
di: Lu, Lei, et al.
Pubblicazione: (2025)

SFT Doesn't Always Hurt General Capabilities: Revisiting Domain-Specific Fine-Tuning in LLMs
di: Lin, Jiacheng, et al.
Pubblicazione: (2025)

Cost-Aware Contrastive Routing for LLMs
di: Shirkavand, Reza, et al.
Pubblicazione: (2025)

Domain-Specific Pruning of Large Mixture-of-Experts Models with Few-shot Demonstrations
di: Dong, Zican, et al.
Pubblicazione: (2025)

Association between TyG ‐related indices and colorectal cancer risk: A prospective cohort study
di: Runxue Jiang, et al.
Pubblicazione: (2025)

Dynamic Bayesian Optimization Framework for Instruction Tuning in Partial Differential Equation Discovery
di: Qu, Junqi, et al.
Pubblicazione: (2025)

One for Dozens: Adaptive REcommendation for All Domains with Counterfactual Augmentation
di: Luo, Huishi, et al.
Pubblicazione: (2024)

Domain Adaptation-based Edge Computing for Cross-Conditions Fault Diagnosis
di: Wang, Yanzhi, et al.
Pubblicazione: (2024)

Probe Pruning: Accelerating LLMs through Dynamic Pruning via Model-Probing
di: Le, Qi, et al.
Pubblicazione: (2025)

Pruning for Protection: Increasing Jailbreak Resistance in Aligned LLMs Without Fine-Tuning
di: Hasan, Adib, et al.
Pubblicazione: (2024)

From Physical Degradation Models to Task-Aware All-in-One Image Restoration
di: Gao, Hu, et al.
Pubblicazione: (2026)

Privacy-Preserving LLMs Routing
di: Wu, Xidong, et al.
Pubblicazione: (2026)

Fine-Tuned Language Models for Domain-Specific Summarization and Tagging
di: Wang, Jun, et al.
Pubblicazione: (2025)

When AIs Judge AIs: The Rise of Agent-as-a-Judge Evaluation for LLMs
di: Yu, Fangyi
Pubblicazione: (2025)

Policy-Oriented Binary Classification: Improving (KD-)CART Final Splits for Subpopulation Targeting
di: Wang, Lei Bill, et al.
Pubblicazione: (2025)

AnyTaskTune: Advanced Domain-Specific Solutions through Task-Fine-Tuning
di: Cui, Jiaxi, et al.
Pubblicazione: (2024)

All‐In‐One Additive Enabled Efficient and Stable Narrow‐Bandgap Perovskites for Monolithic All‐Perovskite Tandem Solar Cells
di: Deng Wang, et al.
Pubblicazione: (2024)

HybridFlow: Infusing Continuity into Masked Codebook for Extreme Low-Bitrate Image Compression
di: Lu, Lei, et al.
Pubblicazione: (2024)

Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge
di: Shen, Xuan, et al.
Pubblicazione: (2023)

One Request, Multiple Experts: LLM Orchestrates Domain Specific Models via Adaptive Task Routing
di: Yang, Xu, et al.
Pubblicazione: (2025)

Tree-Regularized Bayesian Latent Class Analysis for Improving Weakly Separated Dietary Pattern Subtyping in Small-Sized Subpopulations
di: Li, Mengbing, et al.
Pubblicazione: (2023)

GradPruner: Gradient-Guided Layer Pruning Enabling Efficient Fine-Tuning and Inference for LLMs
di: Huang, Wei, et al.
Pubblicazione: (2026)

CFSP: An Efficient Structured Pruning Framework for LLMs with Coarse-to-Fine Activation Information
di: Wang, Yuxin, et al.
Pubblicazione: (2024)

Deriving Coding-Specific Sub-Models from LLMs using Resource-Efficient Pruning
di: Puccioni, Laura, et al.
Pubblicazione: (2025)