Cover Image

Two Is Better Than One: Rotations Scale LoRAs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Guo, Hongcan, Nan, Guoshun, Yang, Yuan, Zhang, Diyang, Li, Haotian, Chen, Zhican, Zhou, Qinchuan, Ran, Yuhan, Cao, Xinye, Leng, Sicong, Tao, Xiaofeng, Jiang, Xudong
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Software Engineering 68T50 I.2.6
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Improving Recursive Transformers with Mixture of LoRAs
by: Nouriborji, Mohammadmahdi, et al.
Published: (2025)

Advancing Expert Specialization for Better MoE
by: Guo, Hongcan, et al.
Published: (2025)

Targeted Lexical Injection: Unlocking Latent Cross-Lingual Alignment in Lugha-Llama via Early-Layer LoRA Fine-Tuning
by: Ngugi, Stanley
Published: (2025)

Optimizing Retrieval-Augmented Generation (RAG) for Colloquial Cantonese: A LoRA-Based Systematic Review
by: Calonge, David Santandreu, et al.
Published: (2025)

Discrete Opial type inequalities for interval-valued functions
by: Zhao, Dafang, et al.
Published: (2023)

Integral-Differential Calculus
by: Molnar, Grant
Published: (2026)

Transformations and functions that preserve the asymptotic mean of digits in the ternary representation of a number
by: Pratsiovytyi, M. V., et al.
Published: (2026)

On differentiability and mass distributions of topologically typical multivariate Archimedean copulas
by: Dietrich, Nicolas, et al.
Published: (2024)

Frequency of a Digit in the Representation of a Number and the Asymptotic Mean Value of the Digits
by: Klymchuk, S. O., et al.
Published: (2026)

Precompactness in bivariate metric semigroup-valued bounded variation spaces
by: Xu, Jingshi, et al.
Published: (2025)

Multiple Dirichlet series predictions for moments of $L$-functions: unitary, symplectic and orthogonal examples
by: Baluyot, Siegfred, et al.
Published: (2025)

Low lying zeros of Rankin-Selberg $L$-functions
by: Shashkov, Alexander
Published: (2023)

Del Pezzo surfaces of degree one and examples of Zariski multiples
by: Shimada, Ichiro
Published: (2025)

Structured Nonsmooth Optimization Using Functional Encoding and Branching Information
by: Luo, Fengqiao
Published: (2024)

Asymptotic mean of digits of the $Q_s$-representation of the fractional part of a real number and related problems of fractal geometry and fractal analysis
by: Pratsiovytyi, M. V., et al.
Published: (2026)

A Survey of a Random Matrix Model for a Family of Cusp Forms
by: Barrett, Owen, et al.
Published: (2024)

A saturation phenomenon for a nonlinear nonlocal eigenvalue problem
by: Della Pietra, Francesco, et al.
Published: (2016)

Semantic Convergence: Investigating Shared Representations Across Scaled LLMs
by: Son, Daniel, et al.
Published: (2025)

Modular differential equations of minimal orders of the elliptic genus of Calabi--Yau varieties
by: Adler, Dmitrii, et al.
Published: (2025)

Exploring Efficient Learning of Small BERT Networks with LoRA and DoRA
by: Frees, Daniel, et al.
Published: (2025)

Continuous Latent Diffusion Language Model
by: Guo, Hongcan, et al.
Published: (2026)

Inversin of double Fourier integral of non-Lebesgue integrable bounded variation functions
by: Torres-Teutle, Edgar, et al.
Published: (2024)

QuAILoRA: Quantization-Aware Initialization for LoRA
by: Lawton, Neal, et al.
Published: (2024)

KDSTM: Neural Semi-supervised Topic Modeling with Knowledge Distillation
by: Xu, Weijie, et al.
Published: (2023)

Characterization of the weak-type boundedness of the Hilbert transform on weighted Lorentz spaces
by: Agora, Elona, et al.
Published: (2024)

Lorentz-Shimogaki and Boyd theorems for weighted Lorentz spaces
by: Agora, Elona, et al.
Published: (2024)

Weak Type Boundedness of the Hardy Littlewood Maximal Operator on Weighted Lorentz Spaces
by: Agora, Elona, et al.
Published: (2024)

Stability of Khintchine inequalities with optimal constants between the second and the $p$-th moment for $p \ge 3$
by: Jakimiuk, Jacek
Published: (2025)

jina-embeddings-v3: Multilingual Embeddings With Task LoRA
by: Sturua, Saba, et al.
Published: (2024)

Multi-Model Synthetic Training for Mission-Critical Small Language Models
by: Platt, Nolan, et al.
Published: (2025)

Affine Gateaux Differentials and the von Mises Statistical Calculus
by: Cerreia-Vioglio, Simone, et al.
Published: (2024)

Sharp Rosenthal-type inequalities for mixtures and log-concave variables
by: Chasapis, Giorgos, et al.
Published: (2022)

Currently there are no reasons to doubt the Riemann Hypothesis: The zeta function beyond the realm of computation
by: Farmer, David W.
Published: (2022)

IFMTBench: A Comprehensive Benchmark for Multilingual Translation Instruction Following
by: Sun, Mingrui, et al.
Published: (2026)

Fine-tuning of Large Language Models for Constituency Parsing Using a Sequence to Sequence Approach
by: Delgado, Francisco Jose Cortes, et al.
Published: (2025)

Doğal Dil İşlemede Tokenizasyon Standartları ve Ölçümü: Türkçe Üzerinden Büyük Dil Modellerinin Karşılaştırmalı Analizi
by: Bayram, M. Ali, et al.
Published: (2025)

Büyük Dil Modelleri için TR-MMLU Benchmarkı: Performans Değerlendirmesi, Zorluklar ve İyileştirme Fırsatları
by: Bayram, M. Ali, et al.
Published: (2025)

Iterative blow-ups for maps with bounded $\mathcal{A}$-variation: a refinement, with application to $\mathrm{BD}$ and $\mathrm{BV}$
by: Caroccia, Marco, et al.
Published: (2025)

Sheaf-Laplacian Obstruction and Projection Hardness for Cross-Modal Compatibility on a Modality-Independent Site
by: Sloboda, Tibor
Published: (2026)

Fuzzy Variational Calculus in Linearly Correlated Space: Part I
by: Frederico, Gastão S. F., et al.
Published: (2025)