Imagen de Portada

High-Rank Structured Modulation for Parameter-Efficient Fine-Tuning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Liu, Yongkang, Li, Xing, Zhao, Mengjie, Zhang, Shanru, Wang, Zijing, Li, Qian, Feng, Shi, Ren, Feiliang, Wang, Daling, Schütze, Hinrich
Formato:	Preprint
Publicado:	2026
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

SMoA: Spectrum Modulation Adapter for Parameter-Efficient Fine-Tuning
por: Liu, Yongkang, et al.
Publicado: (2026)

ChunkFT: Byte-Streamed Optimization for Memory-Efficient Full Fine-Tuning
por: Liu, Yongkang, et al.
Publicado: (2026)

HiFT: A Hierarchical Full Parameter Fine-Tuning Strategy
por: Liu, Yongkang, et al.
Publicado: (2024)

Look Within or Look Beyond? A Theoretical Comparison Between Parameter-Efficient and Full Fine-Tuning
por: Liu, Yongkang, et al.
Publicado: (2025)

DiM\textsuperscript{3}: Bridging Multilingual and Multimodal Models via Direction- and Magnitude-Aware Merging
por: Wang, Zijing, et al.
Publicado: (2026)

Evaluate What You Can't Evaluate: Unassessable Quality for Generated Response
por: Liu, Yongkang, et al.
Publicado: (2023)

ChatZero:Zero-shot Cross-Lingual Dialogue Generation via Pseudo-Target Language
por: Liu, Yongkang, et al.
Publicado: (2024)

PlaM: Training-Free Plateau-Guided Model Merging for Better Visual Grounding in MLLMs
por: Wang, Zijing, et al.
Publicado: (2026)

A Unified Data Augmentation Framework for Low-Resource Multi-Domain Dialogue Generation
por: Liu, Yongkang, et al.
Publicado: (2024)

SAD: A Large-Scale Strategic Argumentative Dialogue Dataset
por: Liu, Yongkang, et al.
Publicado: (2026)

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
por: Gao, Ziqi, et al.
Publicado: (2024)

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
por: Jiang, Ting, et al.
Publicado: (2024)

Parameter-Efficient Fine-Tuning via Circular Convolution
por: Chen, Aochuan, et al.
Publicado: (2024)

MEKiT: Multi-source Heterogeneous Knowledge Injection Method via Instruction Tuning for Emotion-Cause Pair Extraction
por: Mu, Shiyi, et al.
Publicado: (2025)

Why Do More Experts Fail? A Theoretical Analysis of Model Merging
por: Wang, Zijing, et al.
Publicado: (2025)

MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning
por: Ren, Pengjie, et al.
Publicado: (2024)

OFA: A Framework of Initializing Unseen Subword Embeddings for Efficient Large-scale Multilingual Continued Pretraining
por: Liu, Yihong, et al.
Publicado: (2023)

Parameter-Efficient Fine-Tuning for Foundation Models
por: Zhang, Dan, et al.
Publicado: (2025)

From Parameters to Data: A Task-Parameter-Guided Fine-Tuning Pipeline for Efficient LLM Alignment
por: Chen, Hao, et al.
Publicado: (2026)

GKnow: Measuring the Entanglement of Gender Bias and Factual Gender
por: Veloso, Leonor, et al.
Publicado: (2026)

The Anatomy of an Edit: Mechanism-Guided Activation Steering for Knowledge Editing
por: Cao, Yuan, et al.
Publicado: (2026)

FoRA: Fisher-orthogonal Rank Adaptation for Parameter-Efficient Fine-Tuning
por: Park, Juneyoung, et al.
Publicado: (2026)

DoRA: Enhancing Parameter-Efficient Fine-Tuning with Dynamic Rank Distribution
por: Mao, Yulong, et al.
Publicado: (2024)

Learn it or Leave it: Module Composition and Pruning for Continual Learning
por: Wang, Mingyang, et al.
Publicado: (2024)

Matrix-Transformation Based Low-Rank Adaptation (MTLoRA): A Brain-Inspired Method for Parameter-Efficient Fine-Tuning
por: Liang, Yao, et al.
Publicado: (2024)

Semantic are Beacons: A Semantic Perspective for Unveiling Parameter-Efficient Fine-Tuning in Knowledge Learning
por: Wang, Renzhi, et al.
Publicado: (2024)

GLUScope: A Tool for Analyzing GLU Neurons in Transformer Language Models
por: Gerstner, Sebastian, et al.
Publicado: (2026)

Understanding Gated Neurons in Transformers from Their Input-Output Functionality
por: Gerstner, Sebastian, et al.
Publicado: (2025)

Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
por: Ren, Weijieying, et al.
Publicado: (2024)

LongForm: Effective Instruction Tuning with Reverse Instructions
por: Köksal, Abdullatif, et al.
Publicado: (2023)

Fine-Tuned LLMs Know They Don't Know: A Parameter-Efficient Approach to Recovering Honesty
por: Shi, Zeyu, et al.
Publicado: (2025)

Knowledge Graph-Infused Fine-Tuning for Structured Reasoning in Large Language Models
por: Zhang, Wuyang, et al.
Publicado: (2025)

LoR2C : Low-Rank Residual Connection Adaptation for Parameter-Efficient Fine-Tuning
por: Zhao, Jiancheng, et al.
Publicado: (2025)

ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning
por: Li, Xianming, et al.
Publicado: (2026)

DropLoRA: Sparse Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
por: Zhang, Haojie
Publicado: (2025)

TriAdaptLoRA: Brain-Inspired Triangular Adaptive Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
por: Liang, Yao, et al.
Publicado: (2025)

Long Exposure: Accelerating Parameter-Efficient Fine-Tuning for LLMs under Shadowy Sparsity
por: Wang, Tuowei, et al.
Publicado: (2025)

RankAdaptor: Hierarchical Rank Allocation for Efficient Fine-Tuning Pruned LLMs via Performance Model
por: Zhou, Changhai, et al.
Publicado: (2024)

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models
por: Liu, Zeyu, et al.
Publicado: (2024)

Parameter-Efficient Fine-Tuning for Medical Text Summarization: A Comparative Study of Lora, Prompt Tuning, and Full Fine-Tuning
por: Shernazarov, Ulugbek, et al.
Publicado: (2026)