Copertina

FoRA: Fisher-orthogonal Rank Adaptation for Parameter-Efficient Fine-Tuning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Park, Juneyoung, Lee, Seongbae, Lee, Han-Sang, Lee, Kyuho, Kim, Minjae, Hyeon, Seungheon, Kwon, Kiduk, Kim, Seongwan, Lee, Jaeho
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Riemannian Optimization for LoRA on the Stiefel Manifold
di: Park, Juneyoung, et al.
Pubblicazione: (2025)

Memory-Efficient Structured Backpropagation for On-Device LLM Fine-Tuning
di: Park, Juneyoung, et al.
Pubblicazione: (2026)

LCSB: Layer-Cyclic Selective Backpropagation for Memory-Efficient On-Device LLM Fine-Tuning
di: Park, Juneyoung, et al.
Pubblicazione: (2026)

Rethinking the Rank Threshold for LoRA Fine-Tuning
di: Park, Juneyoung
Pubblicazione: (2026)

FoRA: Low-Rank Adaptation Model beyond Multimodal Siamese Network
di: Xie, Weiying, et al.
Pubblicazione: (2024)

GraLoRA: Granular Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
di: Jung, Yeonjoon, et al.
Pubblicazione: (2025)

ABM-LoRA: Activation Boundary Matching for Fast Convergence in Low-Rank Adaptation
di: Lee, Dongha, et al.
Pubblicazione: (2025)

CleaR: Towards Robust and Generalized Parameter-Efficient Fine-Tuning for Noisy Label Learning
di: Kim, Yeachan, et al.
Pubblicazione: (2024)

Decoder-Free Distillation for Quantized Image Restoration
di: Sharif, S. M. A., et al.
Pubblicazione: (2026)

Towards Federated Low-Rank Adaptation of Language Models with Rank Heterogeneity
di: Byun, Yuji, et al.
Pubblicazione: (2024)

Prompt-based Depth Pruning of Large Language Models
di: Wee, Juyun, et al.
Pubblicazione: (2025)

ZIP: An Efficient Zeroth-order Prompt Tuning for Black-box Vision-Language Models
di: Park, Seonghwan, et al.
Pubblicazione: (2025)

Beware of the Batch Size: Hyperparameter Bias in Evaluating LoRA
di: Lee, Sangyoon, et al.
Pubblicazione: (2026)

TransPL: VQ-Code Transition Matrices for Pseudo-Labeling of Time Series Unsupervised Domain Adaptation
di: Kim, Jaeho, et al.
Pubblicazione: (2025)

Hybrid-LoRA: Bridging Full Fine-Tuning and Low-Rank Adaptation for Post-Training
di: Zhang, Chengqian, et al.
Pubblicazione: (2026)

QWHA: Quantization-Aware Walsh-Hadamard Adaptation for Parameter-Efficient Fine-Tuning on Large Language Models
di: Jeon, Hyesung, et al.
Pubblicazione: (2025)

Decoupling of functional and household income distribution by economic growth: new findings from analysing the three‐way growth‐equity nexus
di: Juneyoung Lee, et al.
Pubblicazione: (2024)

A Systematic Evaluation of Parameter-Efficient Fine-Tuning Methods for the Security of Code LLMs
di: Lee, Kiho, et al.
Pubblicazione: (2025)

DropLoRA: Sparse Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
di: Zhang, Haojie
Pubblicazione: (2025)

Area and Device Count Efficient Binary Logic Circuits using Anti‐Ambipolar Switch Devices
di: Jae Hyeon Jun, et al.
Pubblicazione: (2024)

C2A: Client-Customized Adaptation for Parameter-Efficient Federated Learning
di: Kim, Yeachan, et al.
Pubblicazione: (2024)

State-offset Tuning: State-based Parameter-Efficient Fine-Tuning for State Space Models
di: Kang, Wonjun, et al.
Pubblicazione: (2025)

LoRA-Edge: Tensor-Train-Assisted LoRA for Practical CNN Fine-Tuning on Edge Devices
di: Kwak, Hyunseok, et al.
Pubblicazione: (2025)

Position: The AI Conference Peer Review Crisis Demands Author Feedback and Reviewer Rewards
di: Kim, Jaeho, et al.
Pubblicazione: (2025)

SAFE ma-QAOA: Surrogate-Assisted and Fine-Tuning Enhanced Multi-Angle QAOA with Parameter Distillation
di: Kim, Hyunwoo, et al.
Pubblicazione: (2026)

Effective 10‐bit OLED driver IC with 11‐bit DAC, double capacitor‐coupled adder, and offset calibration for enhanced panel driving
di: Changwhan Kim, et al.
Pubblicazione: (2025)

FALQON: Accelerating LoRA Fine-tuning with Low-Bit Floating-Point Arithmetic
di: Choi, Kanghyun, et al.
Pubblicazione: (2025)

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models
di: Liu, Zeyu, et al.
Pubblicazione: (2024)

PaCA: Partial Connection Adaptation for Efficient Fine-Tuning
di: Woo, Sunghyeon, et al.
Pubblicazione: (2025)

Synergizing Polysulfide Trapping and Fast Ion Kinetics Enabled by Poly(Acrylamide‐co‐Lithium Acrylate) Aqueous Binder for High‐Sulfur‐Loading Lithium–Sulfur Batteries
di: Seongbae Park, et al.
Pubblicazione: (2026)

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
di: Jiang, Ting, et al.
Pubblicazione: (2024)

HBRB-BoW: A Retrained Bag-of-Words Vocabulary for ORB-SLAM via Hierarchical BRB-KMeans
di: Lee, Minjae, et al.
Pubblicazione: (2026)

Rank-O-ToM: Unlocking Emotional Nuance Ranking to Enhance Affective Theory-of-Mind
di: Kim, JiHyun, et al.
Pubblicazione: (2025)

Next-Depth Lookahead Tree
di: Lee, Jaeho, et al.
Pubblicazione: (2025)

OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models
di: Lee, Changhun, et al.
Pubblicazione: (2023)

Selective Generation for Controllable Language Models
di: Lee, Minjae, et al.
Pubblicazione: (2023)

RoRA: Efficient Fine-Tuning of LLM with Reliability Optimization for Rank Adaptation
di: Liu, Jun, et al.
Pubblicazione: (2025)

Leveraging Text-Driven Semantic Variation for Robust OOD Segmentation
di: Song, Seungheon, et al.
Pubblicazione: (2025)

FuRA: Full-Rank Parameter-Efficient Fine-Tuning with Spectral Preconditioning
di: Zhao, Yequan, et al.
Pubblicazione: (2026)

DoRA: Enhancing Parameter-Efficient Fine-Tuning with Dynamic Rank Distribution
di: Mao, Yulong, et al.
Pubblicazione: (2024)