Copertina

MOMA: Masked Orthogonal Matrix Alignment for Zero-Additional-Parameter Model Merging

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Kong, Fanshuang, Zhang, Richong, Nie, Zhijie, Zhou, Hang, Wang, Ziqiao, Sun, Qiang, Hu, Chunming
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Activated Parameter Locating via Causal Intervention for Model Merging
di: Kong, Fanshuang, et al.
Pubblicazione: (2024)

LH-Mix: Local Hierarchy Correlation Guided Mixup over Hierarchical Prompt Tuning
di: Kong, Fanshuang, et al.
Pubblicazione: (2024)

inversedMixup: Data Augmentation via Inverting Mixed Embeddings
di: Kong, Fanshuang, et al.
Pubblicazione: (2026)

On SkipGram Word Embedding Models with Negative Sampling: Unified Framework and Impact of Noise Distributions
di: Liu, Dezhi, et al.
Pubblicazione: (2020)

Improving Zero-Shot Cross-Lingual Transfer via Progressive Code-Switching
di: Li, Zhuoran, et al.
Pubblicazione: (2024)

Nora: Normalized Orthogonal Row Alignment for Scalable Matrix Optimizer
di: Yuan, Jinghui, et al.
Pubblicazione: (2026)

Implicit Word Reordering with Knowledge Distillation for Cross-Lingual Dependency Parsing
di: Li, Zhuoran, et al.
Pubblicazione: (2025)

Orthogonal Model Merging
di: Yang, Sihan, et al.
Pubblicazione: (2026)

Improved Operator Learning by Orthogonal Attention
di: Xiao, Zipeng, et al.
Pubblicazione: (2023)

Safety Alignment as Continual Learning: Mitigating the Alignment Tax via Orthogonal Gradient Projection
di: Sun, Guanglong, et al.
Pubblicazione: (2026)

Unraveling LoRA Interference: Orthogonal Subspaces for Robust Model Merging
di: Zhang, Haobo, et al.
Pubblicazione: (2025)

Expert Merging: Model Merging with Unsupervised Expert Alignment and Importance-Guided Layer Chunking
di: Zhang, Dengming, et al.
Pubblicazione: (2025)

Model Breadcrumbs: Scaling Multi-Task Model Merging with Sparse Masks
di: Davari, MohammadReza, et al.
Pubblicazione: (2023)

Rethinking Graph Masked Autoencoders through Alignment and Uniformity
di: Wang, Liang, et al.
Pubblicazione: (2024)

FedMerge: Federated Personalization via Model Merging
di: Chen, Shutong, et al.
Pubblicazione: (2025)

Fisher Mask Nodes for Language Model Merging
di: K, Thennal D, et al.
Pubblicazione: (2024)

From Coefficients to Directions: Rethinking Model Merging with Directional Alignment
di: Chen, Zhikang, et al.
Pubblicazione: (2025)

Non-Uniform Parameter-Wise Model Merging
di: Camacho, Albert Manuel Orozco, et al.
Pubblicazione: (2024)

Merging by Matching Models in Task Parameter Subspaces
di: Tam, Derek, et al.
Pubblicazione: (2023)

FedMuon: Accelerating Federated Learning with Matrix Orthogonalization
di: Liu, Junkang, et al.
Pubblicazione: (2025)

Decouple and Orthogonalize: A Data-Free Framework for LoRA Merging
di: Zheng, Shenghe, et al.
Pubblicazione: (2025)

Improving General Text Embedding Model: Tackling Task Conflict and Data Imbalance through Model Merging
di: Li, Mingxin, et al.
Pubblicazione: (2024)

Orthogonalized Multimodal Contrastive Learning with Asymmetric Masking for Structured Representations
di: Cissee, Carolin, et al.
Pubblicazione: (2026)

Cross-attention Secretly Performs Orthogonal Alignment in Recommendation Models
di: Lee, Hyunin, et al.
Pubblicazione: (2025)

Extra-Merge: Tracing the Rank-1 Subspace of Model Merging in Language Model Pre-Training
di: Zhou, Wenjie, et al.
Pubblicazione: (2026)

Sparse Orthogonal Parameters Tuning for Continual Learning
di: Ning, Kun-Peng, et al.
Pubblicazione: (2024)

MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformer
di: Wang, Yuancheng, et al.
Pubblicazione: (2024)

SeMe: Training-Free Language Model Merging via Semantic Alignment
di: Gu, Jian, et al.
Pubblicazione: (2025)

MergeSFL: Split Federated Learning with Feature Merging and Batch Size Regulation
di: Liao, Yunming, et al.
Pubblicazione: (2023)

Modular Delta Merging with Orthogonal Constraints: A Scalable Framework for Continual and Reversible Model Composition
di: Khan, Haris, et al.
Pubblicazione: (2025)

FedSKD: Aggregation-free Model-heterogeneous Federated Learning via Multi-dimensional Similarity Knowledge Distillation for Medical Image Classification
di: Weng, Ziqiao, et al.
Pubblicazione: (2025)

Dynamic Task Vector Grouping for Efficient Multi-Task Prompt Tuning
di: Zhang, Pieyi, et al.
Pubblicazione: (2025)

Parameter Competition Balancing for Model Merging
di: Du, Guodong, et al.
Pubblicazione: (2024)

Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment
di: Lu, Keming, et al.
Pubblicazione: (2024)

Adaptive Tokenization: On the Hop-Overpriority Problem in Tokenized Graph Learning Models
di: Wang, Zhibiao, et al.
Pubblicazione: (2025)

Training-Free Self-Correction for Multimodal Masked Diffusion Models
di: Ouyang, Yidong, et al.
Pubblicazione: (2026)

COMPOT: Calibration-Optimized Matrix Procrustes Orthogonalization for Transformers Compression
di: Makhov, Denis, et al.
Pubblicazione: (2026)

T3: Test-Time Model Merging in VLMs for Zero-Shot Medical Imaging Analysis
di: Imam, Raza, et al.
Pubblicazione: (2025)

Rethinking Inter-LoRA Orthogonality in Adapter Merging: Insights from Orthogonal Monte Carlo Dropout
di: Zhang, Andi, et al.
Pubblicazione: (2025)

MergeBench: A Benchmark for Merging Domain-Specialized LLMs
di: He, Yifei, et al.
Pubblicazione: (2025)