Cover Image

Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Weiyang, Qiu, Zeju, Feng, Yao, Xiu, Yuliang, Xue, Yuxuan, Yu, Longhui, Feng, Haiwen, Liu, Zhen, Heo, Juyeon, Peng, Songyou, Wen, Yandong, Black, Michael J., Weller, Adrian, Schölkopf, Bernhard
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Artificial Intelligence Computation and Language Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Orthogonal Finetuning Made Scalable
by: Qiu, Zeju, et al.
Published: (2025)

Controlling Text-to-Image Diffusion by Orthogonal Finetuning
by: Qiu, Zeju, et al.
Published: (2023)

PEFT-Arena: Understanding Parameter-Efficient Finetuning from a Stability-Plasticity Perspective
by: Huang, Yangyi, et al.
Published: (2026)

Can Large Language Models Understand Symbolic Graphics Programs?
by: Qiu, Zeju, et al.
Published: (2024)

POET-X: Memory-efficient LLM Training by Scaling Orthogonal Transformation
by: Qiu, Zeju, et al.
Published: (2026)

Ghost on the Shell: An Expressive Representation of General 3D Shapes
by: Liu, Zhen, et al.
Published: (2023)

Reparameterized LLM Training via Orthogonal Equivalence Transformation
by: Qiu, Zeju, et al.
Published: (2025)

Re-Thinking Inverse Graphics With Large Language Models
by: Kulits, Peter, et al.
Published: (2024)

ETCH: Generalizing Body Fitting to Clothed Humans via Equivariant Tightness
by: Li, Boqian, et al.
Published: (2025)

Rethinking Easy-to-Hard: Limits of Curriculum Learning in Post-Training for Deductive Reasoning
by: Mordig, Maximilian, et al.
Published: (2026)

Symbolic Graphics Programming with Large Language Models
by: Chen, Yamei, et al.
Published: (2025)

Pion: A Spectrum-Preserving Optimizer via Orthogonal Equivalence Transformation
by: Shi, Kexuan, et al.
Published: (2026)

Verbalized Machine Learning: Revisiting Machine Learning with Language Models
by: Xiao, Tim Z., et al.
Published: (2024)

Flipping Against All Odds: Reducing LLM Coin Flip Bias via Verbalized Rejection Sampling
by: Xiao, Tim Z., et al.
Published: (2025)

Estimation of Concept Explanations Should be Uncertainty Aware
by: Piratla, Vihari, et al.
Published: (2023)

Identifying Intervenable and Interpretable Features via Orthogonality Regularization
by: Miller, Moritz, et al.
Published: (2026)

GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphs
by: Gao, Gege, et al.
Published: (2023)

Towards Anatomically Plausible Human Image Generation via Synthetic Localized Preferences
by: Li, Bao, et al.
Published: (2026)

PuzzleAvatar: Assembling 3D Avatars from Personal Albums
by: Xiu, Yuliang, et al.
Published: (2024)

ChatHuman: Chatting about 3D Humans with Tools
by: Lin, Jing, et al.
Published: (2024)

Rigidity-Aware Geometric Pretraining for Protein Design and Conformational Ensembles
by: Ni, Zhanghan, et al.
Published: (2026)

Renovating Names in Open-Vocabulary Segmentation Benchmarks
by: Huang, Haiwen, et al.
Published: (2024)

ChatGarment: Garment Estimation, Generation and Editing via Large Language Models
by: Bian, Siyuan, et al.
Published: (2024)

ButterflyQuant: Ultra-low-bit LLM Quantization through Learnable Orthogonal Butterfly Transforms
by: Xu, Bingxin, et al.
Published: (2025)

MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models
by: Yu, Longhui, et al.
Published: (2023)

OMoE: Diversifying Mixture of Low-Rank Adaptation by Orthogonal Finetuning
by: Feng, Jinyuan, et al.
Published: (2025)

Toward Human Understanding with Controllable Synthesis
by: Cuevas-Velasquez, Hanz, et al.
Published: (2024)

Agentic Design of Compositional Machines
by: Zhang, Wenqian, et al.
Published: (2025)

A diverse Multilingual News Headlines Dataset from around the World
by: Leeb, Felix, et al.
Published: (2024)

Predicting 4D Hand Trajectory from Monocular Videos
by: Ye, Yufei, et al.
Published: (2025)

Knowledge Augmented Finetuning Matters in both RAG and Agent Based Dialog Systems
by: Cai, Yucheng, et al.
Published: (2025)

Orthogonal Finetuning for Direct Preference Optimization
by: Yang, Chenxu, et al.
Published: (2024)

Streaming Autoregressive Video Generation via Diagonal Distillation
by: Liu, Jinxiu, et al.
Published: (2026)

Your Finetuned Large Language Model is Already a Powerful Out-of-distribution Detector
by: Zhang, Andi, et al.
Published: (2024)

Physics of Learning: A Lagrangian perspective to different learning paradigms
by: Guo, Siyuan, et al.
Published: (2025)

Text Style Transfer with Parameter-efficient LLM Finetuning and Round-trip Translation
by: Liu, Ruoxi, et al.
Published: (2026)

InterDyn: Controllable Interactive Dynamics with Video Diffusion Models
by: Akkerman, Rick, et al.
Published: (2024)

Do LLMs estimate uncertainty well in instruction-following?
by: Heo, Juyeon, et al.
Published: (2024)

Rethinking Preference Alignment for Diffusion Models with Classifier-Free Guidance
by: Jiang, Zhou, et al.
Published: (2026)

Customizing Large Language Model Generation Style using Parameter-Efficient Finetuning
by: Liu, Xinyue, et al.
Published: (2024)