Saved in:
| Main Authors: | Xiang, Jingyang, Zhang, Sai Qian |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.00648 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs
by: Ashkboos, Saleh, et al.
Published: (2024)
by: Ashkboos, Saleh, et al.
Published: (2024)
OptRot: Mitigating Weight Outliers via Data-Free Rotations for Post-Training Quantization
by: Gadhikar, Advait, et al.
Published: (2025)
by: Gadhikar, Advait, et al.
Published: (2025)
RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization
by: Huang, Xijie, et al.
Published: (2024)
by: Huang, Xijie, et al.
Published: (2024)
Getting Free Bits Back from Rotational Symmetries in LLMs
by: He, Jiajun, et al.
Published: (2024)
by: He, Jiajun, et al.
Published: (2024)
Rotated Runtime Smooth: Training-Free Activation Smoother for accurate INT4 inference
by: Yi, Ke, et al.
Published: (2024)
by: Yi, Ke, et al.
Published: (2024)
RotateKV: Accurate and Robust 2-Bit KV Cache Quantization for LLMs via Outlier-Aware Adaptive Rotations
by: Su, Zunhai, et al.
Published: (2025)
by: Su, Zunhai, et al.
Published: (2025)
Grouped Sequency-arranged Rotation: Optimizing Rotation Transformation for Quantization for Free
by: Choi, Euntae, et al.
Published: (2025)
by: Choi, Euntae, et al.
Published: (2025)
ConQuR: Corner Aligned Activation Quantization via Optimized Rotations for LLMs
by: Thrash, Chayne, et al.
Published: (2026)
by: Thrash, Chayne, et al.
Published: (2026)
Online Ensemble Learning for Sector Rotation: A Gradient-Free Framework
by: Miao, Jiaju, et al.
Published: (2023)
by: Miao, Jiaju, et al.
Published: (2023)
AdaHOP: Fast and Accurate Low-Precision Training via Outlier-Pattern-Aware Rotation
by: Kim, Seonggon, et al.
Published: (2026)
by: Kim, Seonggon, et al.
Published: (2026)
Rotation Control Unlearning: Quantifying and Controlling Continuous Unlearning for LLM with The Cognitive Rotation Space
by: Zhang, Xiang, et al.
Published: (2025)
by: Zhang, Xiang, et al.
Published: (2025)
Outlier Smoothing with Closed-Form Rotations for W4A4 Large Language Model Quantization
by: Xiao, Jinying, et al.
Published: (2025)
by: Xiao, Jinying, et al.
Published: (2025)
DenoiseRotator: Enhance Pruning Robustness for LLMs via Importance Concentration
by: Gu, Tianteng, et al.
Published: (2025)
by: Gu, Tianteng, et al.
Published: (2025)
Massive Spikes in LLMs are Bias Vectors: Mechanistic Uncovering and Spike-Free Quantization
by: Chen, Yung-Chin, et al.
Published: (2026)
by: Chen, Yung-Chin, et al.
Published: (2026)
AutoDFP: Automatic Data-Free Pruning via Channel Similarity Reconstruction
by: Li, Siqi, et al.
Published: (2024)
by: Li, Siqi, et al.
Published: (2024)
Don't Break the Boundary: Continual Unlearning for OOD Detection Based on Free Energy Repulsion
by: Peng, Ningkang, et al.
Published: (2026)
by: Peng, Ningkang, et al.
Published: (2026)
Angular Steering: Behavior Control via Rotation in Activation Space
by: Vu, Hieu M., et al.
Published: (2025)
by: Vu, Hieu M., et al.
Published: (2025)
Spherical Steering: Geometry-Aware Activation Rotation for Language Models
by: You, Zejia, et al.
Published: (2026)
by: You, Zejia, et al.
Published: (2026)
Advancing Diffusion Models: Alias-Free Resampling and Enhanced Rotational Equivariance
by: Anjum, Md Fahim
Published: (2024)
by: Anjum, Md Fahim
Published: (2024)
Pushing the Limits of Block Rotations in Post-Training Quantization
by: Sanjeet, Sai, et al.
Published: (2026)
by: Sanjeet, Sai, et al.
Published: (2026)
Training-Free Policy Violation Detection via Activation-Space Whitening in LLMs
by: Rachmil, Oren, et al.
Published: (2025)
by: Rachmil, Oren, et al.
Published: (2025)
Merging Beyond: Streaming LLM Updates via Activation-Guided Rotations
by: Yao, Yuxuan, et al.
Published: (2026)
by: Yao, Yuxuan, et al.
Published: (2026)
CodeQuant: Unified Clustering and Quantization for Enhanced Outlier Smoothing in Low-Precision Mixture-of-Experts
by: Yin, Xiangyang, et al.
Published: (2026)
by: Yin, Xiangyang, et al.
Published: (2026)
Data-Free Privacy-Preserving for LLMs via Model Inversion and Selective Unlearning
by: Zhou, Xinjie, et al.
Published: (2026)
by: Zhou, Xinjie, et al.
Published: (2026)
Lightweight Learning for Grant-Free Activity Detection in Cell-Free Massive MIMO Networks
by: Elkeshawy, Ali, et al.
Published: (2025)
by: Elkeshawy, Ali, et al.
Published: (2025)
Approximating Uniform Random Rotations by Two-Block Structured Hadamard Rotations in High Dimensions
by: Zilca, Tomer, et al.
Published: (2026)
by: Zilca, Tomer, et al.
Published: (2026)
Simple KNN-Based Outlier Detection Achieves Robust Clustering
by: Jiang, Tianle, et al.
Published: (2026)
by: Jiang, Tianle, et al.
Published: (2026)
The Uniformly Rotated Mondrian Kernel
by: Osborne, Calvin, et al.
Published: (2025)
by: Osborne, Calvin, et al.
Published: (2025)
Efficient Vocabulary-Free Fine-Grained Visual Recognition in the Age of Multimodal LLMs
by: Kuchibhotla, Hari Chandana, et al.
Published: (2025)
by: Kuchibhotla, Hari Chandana, et al.
Published: (2025)
Rotational Sampling: A Plug-and-Play Encoder for Rotation-Invariant 3D Molecular GNNs
by: Jin, Dian
Published: (2025)
by: Jin, Dian
Published: (2025)
On the Relationship Between Activation Outliers and Feature Death in Sparse Autoencoders
by: Simon, Elana, et al.
Published: (2026)
by: Simon, Elana, et al.
Published: (2026)
AnyRotate: Gravity-Invariant In-Hand Object Rotation with Sim-to-Real Touch
by: Yang, Max, et al.
Published: (2024)
by: Yang, Max, et al.
Published: (2024)
Refining Covariance Matrix Estimation in Stochastic Gradient Descent Through Bias Reduction
by: Wei, Ziyang, et al.
Published: (2026)
by: Wei, Ziyang, et al.
Published: (2026)
Deep Learning-Based Approach for User Activity Detection with Grant-Free Random Access in Cell-Free Massive MIMO
by: Elkeshawy, Ali, et al.
Published: (2024)
by: Elkeshawy, Ali, et al.
Published: (2024)
Deep-Unfolded Massive Grant-Free Transmission in Cell-Free Wireless Communication Systems
by: Sun, Gangle, et al.
Published: (2025)
by: Sun, Gangle, et al.
Published: (2025)
OVOR: OnePrompt with Virtual Outlier Regularization for Rehearsal-Free Class-Incremental Learning
by: Huang, Wei-Cheng, et al.
Published: (2024)
by: Huang, Wei-Cheng, et al.
Published: (2024)
ManifoldKV: Training-Free KV Cache Compression via Euclidean Outlier Detection
by: Datta, Debajyoti, et al.
Published: (2026)
by: Datta, Debajyoti, et al.
Published: (2026)
Semantic Outlier Removal with Embedding Models and LLMs
by: Akbiyik, Eren, et al.
Published: (2025)
by: Akbiyik, Eren, et al.
Published: (2025)
RadRotator: 3D Rotation of Radiographs with Diffusion Models
by: Rouzrokh, Pouria, et al.
Published: (2024)
by: Rouzrokh, Pouria, et al.
Published: (2024)
SmoothRot: Combining Channel-Wise Scaling and Rotation for Quantization-Friendly LLMs
by: Czakó, Patrik, et al.
Published: (2025)
by: Czakó, Patrik, et al.
Published: (2025)
Similar Items
-
QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs
by: Ashkboos, Saleh, et al.
Published: (2024) -
OptRot: Mitigating Weight Outliers via Data-Free Rotations for Post-Training Quantization
by: Gadhikar, Advait, et al.
Published: (2025) -
RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization
by: Huang, Xijie, et al.
Published: (2024) -
Getting Free Bits Back from Rotational Symmetries in LLMs
by: He, Jiajun, et al.
Published: (2024) -
Rotated Runtime Smooth: Training-Free Activation Smoother for accurate INT4 inference
by: Yi, Ke, et al.
Published: (2024)