Cover Image

COMPOT: Calibration-Optimized Matrix Procrustes Orthogonalization for Transformers Compression

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Makhov, Denis, Shopkhoev, Dmitriy, Zhussip, Magauiya, Ali, Ammar, Mohammad, Baher, Lefkimmiatis, Stamatios
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ROCKET: Rapid Optimization via Calibration-guided Knapsack Enhanced Truncation for Efficient Model Compression
by: Ali, Ammar, et al.
Published: (2026)

Share Your Attention: Transformer Weight Sharing via Matrix-based Dictionary Learning
by: Zhussip, Magauiya, et al.
Published: (2025)

CoSpaDi: Compressing LLMs via Calibration-Guided Sparse Dictionary Learning
by: Makhov, Denis, et al.
Published: (2025)

Speak, Edit, Repeat: High-Fidelity Voice Editing and Zero-Shot TTS with Cross-Attentive Mamba
by: Mohammad, Baher, et al.
Published: (2025)

ReplaceMe: Network Simplification via Depth Pruning and Transformer Block Linearization
by: Shopkhoev, Dmitriy, et al.
Published: (2025)

A Modular Conditional Diffusion Framework for Image Reconstruction
by: Zhussip, Magauiya, et al.
Published: (2024)

ProcrustesGPT: Compressing LLMs with Structured Matrices and Orthogonal Transformations
by: Grishina, Ekaterina, et al.
Published: (2025)

Generalized Orthogonal Procrustes Problem under Arbitrary Adversaries
by: Ling, Shuyang
Published: (2021)

Orthogonal Procrustes problem preserves correlations in synthetic data
by: Ounissi, Oussama, et al.
Published: (2025)

Optimizing Deep Neural Networks using Safety-Guided Self Compression
by: Zbeeb, Mohammad, et al.
Published: (2025)

Nora: Normalized Orthogonal Row Alignment for Scalable Matrix Optimizer
by: Yuan, Jinghui, et al.
Published: (2026)

An in depth look at the Procrustes-Wasserstein distance: properties and barycenters
by: Adamo, Davide, et al.
Published: (2025)

When Embedding Models Meet: Procrustes Bounds and Applications
by: Maystre, Lucas, et al.
Published: (2025)

Mitigating Partial Observability in Adaptive Traffic Signal Control with Transformers
by: Wang, Xiaoyu, et al.
Published: (2024)

DP-Muon: Differentially Private Optimization via Matrix-Orthogonalized Momentum
by: Kim, Jihwan, et al.
Published: (2026)

Orthogonal Causal Calibration
by: Whitehouse, Justin, et al.
Published: (2024)

Pion: A Spectrum-Preserving Optimizer via Orthogonal Equivalence Transformation
by: Shi, Kexuan, et al.
Published: (2026)

On Procrustes Contamination in Machine Learning Applications of Geometric Morphometrics
by: Courtenay, Lloyd Austin
Published: (2026)

Generalized infinite dimensional Alpha-Procrustes based geometries
by: Goomanee, Salvish, et al.
Published: (2025)

On a Novel Application of Wasserstein-Procrustes for Unsupervised Cross-Lingual Learning
by: Ramírez, Guillem, et al.
Published: (2020)

Orthogonal Calibration for Asynchronous Federated Learning
by: Zhang, Jiayun, et al.
Published: (2025)

Deep Orthogonal Hypersphere Compression for Anomaly Detection
by: Zhang, Yunhe, et al.
Published: (2023)

Continuous Orthogonal Mode Decomposition: Haptic Signal Prediction in Tactile Internet
by: Vahedifar, Mohammad Ali, et al.
Published: (2026)

Quantum RNNs and LSTMs Through Entangling and Disentangling Power of Unitary Transformations
by: Daskin, Ammar
Published: (2025)

Orthogonalized Policy Optimization:Policy Optimization as Orthogonal Projection in Hilbert Space
by: Zixian, Wang
Published: (2026)

FLoRG: Federated Fine-tuning with Low-rank Gram Matrices and Procrustes Alignment
by: Meng, Chuiyang, et al.
Published: (2026)

FedMuon: Accelerating Federated Learning with Matrix Orthogonalization
by: Liu, Junkang, et al.
Published: (2025)

Learning to Recall with Transformers Beyond Orthogonal Embeddings
by: Vural, Nuri Mert, et al.
Published: (2026)

MOMA: Masked Orthogonal Matrix Alignment for Zero-Additional-Parameter Model Merging
by: Kong, Fanshuang, et al.
Published: (2024)

SECRM-2D: RL-Based Efficient and Comfortable Route-Following Autonomous Driving with Analytic Safety Guarantees
by: Shi, Tianyu, et al.
Published: (2024)

Frequency-domain alignment of heterogeneous, multidimensional separations data through complex orthogonal Procrustes analysis
by: Armstrong, Michael Sorochan
Published: (2025)

Aligning Embeddings and Geometric Random Graphs: Informational Results and Computational Approaches for the Procrustes-Wasserstein Problem
by: Even, Mathieu, et al.
Published: (2024)

Transformers from Compressed Representations
by: Alcazar, Juan C. Leon, et al.
Published: (2025)

Group Orthogonalized Policy Optimization:Group Policy Optimization as Orthogonal Projection in Hilbert Space
by: Zixian, Wang
Published: (2026)

Strategic Fusion Optimizes Transformer Compression
by: Rahman, Md Shoaibur
Published: (2025)

Counterfactual Fairness through Transforming Data Orthogonal to Bias
by: Chen, Shuyi, et al.
Published: (2024)

FISMO: Fisher-Structured Momentum-Orthogonalized Optimizer
by: Xu, Chenrui, et al.
Published: (2026)

Random Forest Calibration
by: Shaker, Mohammad Hossein, et al.
Published: (2025)

Orthogonal Nonnegative Matrix Factorization with the Kullback-Leibler divergence
by: Nkurunziza, Jean Pacifique, et al.
Published: (2024)

Structured Matrix Scaling for Multi-Class Calibration
by: Berta, Eugène, et al.
Published: (2025)