Copertina

Hybrid and Unitary PEFT for Resource-Efficient Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Qi, Haomin, Dai, Zihan, Huang, Chengbo
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Governance-Aware Hybrid Fine-Tuning for Multilingual Large Language Models
di: Qi, Haomin, et al.
Pubblicazione: (2025)

PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models
di: Belanec, Robert, et al.
Pubblicazione: (2025)

PEFT A2Z: Parameter-Efficient Fine-Tuning Survey for Large Language and Vision Models
di: Prottasha, Nusrat Jahan, et al.
Pubblicazione: (2025)

TS-PEFT: Unveiling Token-Level Redundancy in Parameter-Efficient Fine-Tuning
di: Ma, Dabiao, et al.
Pubblicazione: (2025)

Enhancing Low-Resource LLMs Classification with PEFT and Synthetic Data
di: Patwa, Parth, et al.
Pubblicazione: (2024)

Q-PEFT: Query-dependent Parameter Efficient Fine-tuning for Text Reranking with Large Language Models
di: Peng, Zhiyuan, et al.
Pubblicazione: (2024)

Challenges in Adapting Multilingual LLMs to Low-Resource Languages using LoRA PEFT Tuning
di: Khade, Omkar, et al.
Pubblicazione: (2024)

PEFT-Bench: A Parameter-Efficient Fine-Tuning Methods Benchmark
di: Belanec, Robert, et al.
Pubblicazione: (2025)

Reliable Control-Point Selection for Steering Reasoning in Large Language Models
di: Zhuang, Haomin, et al.
Pubblicazione: (2026)

Train More Parameters But Mind Their Placement: Insights into Language Adaptation with PEFT
di: Kunz, Jenny
Pubblicazione: (2024)

ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning
di: Li, Xianming, et al.
Pubblicazione: (2026)

PEFT-U: Parameter-Efficient Fine-Tuning for User Personalization
di: Clarke, Christopher, et al.
Pubblicazione: (2024)

Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning
di: Gu, Naibin, et al.
Pubblicazione: (2024)

Alignment for Efficient Tool Calling of Large Language Models
di: Xu, Hongshen, et al.
Pubblicazione: (2025)

PEFT-Arena: Understanding Parameter-Efficient Finetuning from a Stability-Plasticity Perspective
di: Huang, Yangyi, et al.
Pubblicazione: (2026)

Efficient Language Modeling for Low-Resource Settings with Hybrid RNN-Transformer Architectures
di: Lindenmaier, Gabriel, et al.
Pubblicazione: (2025)

Towards Resource Efficient and Interpretable Bias Mitigation in Large Language Models
di: Tong, Schrasing, et al.
Pubblicazione: (2024)

On the Scaling of PEFT: Towards Million Personal Models of Trillion Parameters
di: Lab, Mind, et al.
Pubblicazione: (2026)

HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition
di: Liu, Yuxuan, et al.
Pubblicazione: (2024)

FISH-Tuning: Enhancing PEFT Methods with Fisher Information
di: Xue, Kang, et al.
Pubblicazione: (2025)

MambaPEFT: Exploring Parameter-Efficient Fine-Tuning for Mamba
di: Yoshimura, Masakazu, et al.
Pubblicazione: (2024)

AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning
di: Zhou, Han, et al.
Pubblicazione: (2023)

Activation Control for Efficiently Eliciting Long Chain-of-thought Ability of Language Models
di: Zhao, Zekai, et al.
Pubblicazione: (2025)

OverleafCopilot: Empowering Academic Writing in Overleaf with Large Language Models
di: Wen, Haomin, et al.
Pubblicazione: (2024)

Monkey Jump : MoE-Style PEFT for Efficient Multi-Task Learning
di: Prottasha, Nusrat Jahan, et al.
Pubblicazione: (2026)

Punctuation-aware Hybrid Trainable Sparse Attention for Large Language Models
di: Qiu, Junxiang, et al.
Pubblicazione: (2026)

A Hybrid Framework with Large Language Models for Rare Disease Phenotyping
di: Wu, Jinge, et al.
Pubblicazione: (2024)

OutlierTune: Efficient Channel-Wise Quantization for Large Language Models
di: Wang, Jinguang, et al.
Pubblicazione: (2024)

How to Tune a Multilingual Encoder Model for Germanic Languages: A Study of PEFT, Full Fine-Tuning, and Language Adapters
di: Oji, Romina, et al.
Pubblicazione: (2025)

ComPEFT: Compression for Communicating Parameter Efficient Updates via Sparsification and Quantization
di: Yadav, Prateek, et al.
Pubblicazione: (2023)

Social Science Meets LLMs: How Reliable Are Large Language Models in Social Simulations?
di: Huang, Yue, et al.
Pubblicazione: (2024)

Efficient Sequential Decision Making with Large Language Models
di: Chen, Dingyang, et al.
Pubblicazione: (2024)

SDSAT: Accelerating LLM Inference through Speculative Decoding with Semantic Adaptive Tokens
di: Liu, Chengbo, et al.
Pubblicazione: (2024)

Synthetic Data Generation in Low-Resource Settings via Fine-Tuning of Large Language Models
di: Kaddour, Jean, et al.
Pubblicazione: (2023)

Plutus: Benchmarking Large Language Models in Low-Resource Greek Finance
di: Peng, Xueqing, et al.
Pubblicazione: (2025)

A Closer Look into Mixture-of-Experts in Large Language Models
di: Lo, Ka Man, et al.
Pubblicazione: (2024)

Assessment of Generative Named Entity Recognition in the Era of Large Language Models
di: Zhan, Qi, et al.
Pubblicazione: (2026)

Resource-Efficient Medical Report Generation using Large Language Models
di: Abdullah, et al.
Pubblicazione: (2024)

Hybrid Alignment Training for Large Language Models
di: Wang, Chenglong, et al.
Pubblicazione: (2024)

LMCD: Language Models are Zeroshot Cognitive Diagnosis Learners
di: He, Yu, et al.
Pubblicazione: (2025)