:: Library Catalog

Copertina

Salvato in:

Dettagli Bibliografici
Autori principali:	Choi, Euntae, Song, Sumin, Lim, Woosang, Yoo, Sungjoo
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Artificial Intelligence Computation and Language
Accesso online:	https://arxiv.org/abs/2505.03810
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Rotate, Clip, and Partition: Towards W2A4KV4 Quantization by Integrating Rotation and Learnable Non-uniform Quantizer
di: Choi, Euntae, et al.
Pubblicazione: (2025)

NSNQuant: A Double Normalization Approach for Calibration-Free Low-Bit Vector Quantization of KV Cache
di: Son, Donghyun, et al.
Pubblicazione: (2025)

LAQuant: A Simple Overhead-free Large Reasoning Model Quantization by Layer-wise Lookahead Loss
di: Choi, Euntae, et al.
Pubblicazione: (2026)

OptRot: Mitigating Weight Outliers via Data-Free Rotations for Post-Training Quantization
di: Gadhikar, Advait, et al.
Pubblicazione: (2025)

RotateKV: Accurate and Robust 2-Bit KV Cache Quantization for LLMs via Outlier-Aware Adaptive Rotations
di: Su, Zunhai, et al.
Pubblicazione: (2025)

MambaQuant: Quantizing the Mamba Family with Variance Aligned Rotation Methods
di: Xu, Zukang, et al.
Pubblicazione: (2025)

SmoothRot: Combining Channel-Wise Scaling and Rotation for Quantization-Friendly LLMs
di: Czakó, Patrik, et al.
Pubblicazione: (2025)

BASE-Q: Bias and Asymmetric Scaling Enhanced Rotational Quantization for Large Language Models
di: He, Liulu, et al.
Pubblicazione: (2025)

Rethinking Layer Redundancy: Calibration Matters More Than Search in LLM Depth Pruning
di: Kim, Minkyu, et al.
Pubblicazione: (2026)

Group Sequence Policy Optimization
di: Zheng, Chujie, et al.
Pubblicazione: (2025)

RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization
di: Huang, Xijie, et al.
Pubblicazione: (2024)

Efficient and Scalable Estimation of Tool Representations in Vector Space
di: Moon, Suhong, et al.
Pubblicazione: (2024)

MacRAG: Compress, Slice, and Scale-up for Multi-Scale Adaptive Context RAG
di: Lim, Woosang, et al.
Pubblicazione: (2025)

ARGUS: Adaptive Rotation-Invariant Geometric Unsupervised System
di: Sharma, Anantha
Pubblicazione: (2026)

Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
di: Ma, Xinyu, et al.
Pubblicazione: (2024)

EntropyCache: Decoded Token Entropy Guided KV Caching for Diffusion Language Models
di: Cheong, Minsoo, et al.
Pubblicazione: (2026)

Phys3DGS: Physically-based 3D Gaussian Splatting for Inverse Rendering
di: Choi, Euntae, et al.
Pubblicazione: (2024)

Topic-VQ-VAE: Leveraging Latent Codebooks for Flexible Topic-Guided Document Generation
di: Yoo, YoungJoon, et al.
Pubblicazione: (2023)

Inducing Systematicity in Transformers by Attending to Structurally Quantized Embeddings
di: Jiang, Yichen, et al.
Pubblicazione: (2024)

Encoding Agent Trajectories as Representations with Sequence Transformers
di: Tsiligkaridis, Athanasios, et al.
Pubblicazione: (2024)

GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimization
di: Liu, Shih-Yang, et al.
Pubblicazione: (2026)

QJL: 1-Bit Quantized JL Transform for KV Cache Quantization with Zero Overhead
di: Zandieh, Amir, et al.
Pubblicazione: (2024)

Peri-LN: Revisiting Normalization Layer in the Transformer Architecture
di: Kim, Jeonghoon, et al.
Pubblicazione: (2025)

Cross-Architecture Transfer Learning for Linear-Cost Inference Transformers
di: Choi, Sehyun
Pubblicazione: (2024)

GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning
di: Zhou, Sifan, et al.
Pubblicazione: (2025)

Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
di: Cheng, Wenhua, et al.
Pubblicazione: (2023)

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
di: Kim, Taesu, et al.
Pubblicazione: (2024)

LLM4Delay: Flight Delay Prediction via Cross-Modality Adaptation of Large Language Models and Aircraft Trajectory Representation
di: Phisannupawong, Thaweerath, et al.
Pubblicazione: (2025)

ButterflyQuant: Ultra-low-bit LLM Quantization through Learnable Orthogonal Butterfly Transforms
di: Xu, Bingxin, et al.
Pubblicazione: (2025)

C$^2$GSPG: Confidence-calibrated Group Sequence Policy Gradient towards Self-aware Reasoning
di: Liu, Haotian, et al.
Pubblicazione: (2025)

Sequence-level Large Language Model Training with Contrastive Preference Optimization
di: Feng, Zhili, et al.
Pubblicazione: (2025)

DNAZEN: Enhanced Gene Sequence Representations via Mixed Granularities of Coding Units
di: Mao, Lei, et al.
Pubblicazione: (2025)

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
di: Xiao, Guangxuan, et al.
Pubblicazione: (2022)

AMAQ: Adaptive Mixed-bit Activation Quantization for Collaborative Parameter Efficient Fine-tuning
di: Song, Yurun, et al.
Pubblicazione: (2025)

Optimizing Large Language Models through Quantization: A Comparative Analysis of PTQ and QAT Techniques
di: Hasan, Jahid
Pubblicazione: (2024)

On the Geometric Structure of Layer Updates in Deep Language Models
di: Yoo, Jun-Sik
Pubblicazione: (2026)

Word-Sequence Entropy: Towards Uncertainty Estimation in Free-Form Medical Question Answering Applications and Beyond
di: Wang, Zhiyuan, et al.
Pubblicazione: (2024)

Strategic Fusion Optimizes Transformer Compression
di: Rahman, Md Shoaibur
Pubblicazione: (2025)

Momentum Streams for Optimizer-Inspired Transformers
di: Gai, Jingchu, et al.
Pubblicazione: (2026)

Personalized Group Relative Policy Optimization for Heterogenous Preference Alignment
di: Wang, Jialu, et al.
Pubblicazione: (2026)