Imagen de Portada

BoA: Attention-aware Post-training Quantization without Backpropagation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Kim, Junhan, Kim, Ho-young, Cho, Eulrang, Lee, Chungman, Kim, Joonyoung, Jeon, Yongkweon
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Towards Next-Level Post-Training Quantization of Hyper-Scale Transformers
por: Kim, Junhan, et al.
Publicado: (2024)

TurboBoA: Faster and Exact Attention-aware Quantization without Backpropagation
por: Kim, Junhan, et al.
Publicado: (2026)

Two-Stage Grid Optimization for Group-wise Quantization of LLMs
por: Kim, Junhan, et al.
Publicado: (2026)

LookaheadKV: Fast and Accurate KV Cache Eviction by Glimpsing into the Future without Generation
por: Ahn, Jinwoo, et al.
Publicado: (2026)

Preserve-Then-Quantize: Balancing Rank Budgets for Quantization Error Reconstruction in LLMs
por: Cho, Yoonjun, et al.
Publicado: (2026)

On the Importance of a Multi-Scale Calibration for Quantization
por: Son, Seungwoo, et al.
Publicado: (2026)

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
por: Kim, Taesu, et al.
Publicado: (2024)

Assigning Distinct Roles to Quantized and Low-Rank Matrices Toward Optimal Weight Decomposition
por: Cho, Yoonjun, et al.
Publicado: (2025)

TRACED: Transition-aware Regret Approximation with Co-learnability for Environment Design
por: Cho, Geonwoo, et al.
Publicado: (2025)

FlexRound: Learnable Rounding based on Element-wise Division for Post-Training Quantization
por: Lee, Jung Hyun, et al.
Publicado: (2023)

MUXQ: Mixed-to-Uniform Precision MatriX Quantization via Low-Rank Outlier Decomposition
por: Lee, Seoungsub, et al.
Publicado: (2026)

Column-wise Quantization of Weights and Partial Sums for Accurate and Efficient Compute-In-Memory Accelerators
por: Kim, Jiyoon, et al.
Publicado: (2025)

Are Self-Attentions Effective for Time Series Forecasting?
por: Kim, Dongbin, et al.
Publicado: (2024)

Thickness-aware E(3)-Equivariant 3D Mesh Neural Networks
por: Kim, Sungwon, et al.
Publicado: (2025)

Grouped Differential Attention
por: Lim, Junghwan, et al.
Publicado: (2025)

FedWSQ: Efficient Federated Learning with Weight Standardization and Distribution-Aware Non-Uniform Quantization
por: Kim, Seung-Wook, et al.
Publicado: (2025)

Generalized Gaussian Temporal Difference Error for Uncertainty-aware Reinforcement Learning
por: Kim, Seyeon, et al.
Publicado: (2024)

HKAN: Hierarchical Kolmogorov-Arnold Network without Backpropagation
por: Dudek, Grzegorz, et al.
Publicado: (2025)

APTQ: Attention-aware Post-Training Mixed-Precision Quantization for Large Language Models
por: Guan, Ziyi, et al.
Publicado: (2024)

Explicit Feature Interaction-aware Graph Neural Networks
por: Kim, Minkyu, et al.
Publicado: (2022)

DMQ: Dissecting Outliers of Diffusion Models for Post-Training Quantization
por: Lee, Dongyeun, et al.
Publicado: (2025)

Learning without Global Backpropagation via Synergistic Information Distillation
por: Ye, Chenhao, et al.
Publicado: (2025)

LittleBit: Ultra Low-Bit Quantization via Latent Factorization
por: Lee, Banseok, et al.
Publicado: (2025)

LRQ: Optimizing Post-Training Quantization for Large Language Models by Learning Low-Rank Weight-Scaling Matrices
por: Lee, Jung Hyun, et al.
Publicado: (2024)

FibQuant: Universal Vector Quantization for Random-Access KV-Cache Compression
por: Lee, Namyoon, et al.
Publicado: (2026)

CodeGEMM: A Codebook-Centric Approach to Efficient GEMM in Quantized LLMs
por: Park, Gunho, et al.
Publicado: (2025)

GraphT5: Unified Molecular Graph-Language Modeling via Multi-Modal Cross-Token Attention
por: Kim, Sangyeup, et al.
Publicado: (2025)

Lipschitz-aware Linearity Grafting for Certified Robustness
por: Han, Yongjin, et al.
Publicado: (2025)

Bridging the Gap Between Molecule and Textual Descriptions via Substructure-aware Alignment
por: Park, Hyuntae, et al.
Publicado: (2025)

Understanding and Mitigating Memorization in Generative Models via Sharpness of Probability Landscapes
por: Jeon, Dongjae, et al.
Publicado: (2024)

Learning to Continually Learn with the Bayesian Principle
por: Lee, Soochan, et al.
Publicado: (2024)

Geometry-Aware Attention Guidance for Diffusion Models via Modern Hopfield Dynamics
por: Kim, Kwanyoung
Publicado: (2026)

FlowerFormer: Empowering Neural Architecture Encoding using a Flow-aware Graph Transformer
por: Hwang, Dongyeong, et al.
Publicado: (2024)

LeanTTA: A Backpropagation-Free and Stateless Approach to Quantized Test-Time Adaptation on Edge Devices
por: Dong, Cynthia, et al.
Publicado: (2025)

Efficient Post-training Quantization with FP8 Formats
por: Shen, Haihao, et al.
Publicado: (2023)

Attention-Based Neural-Augmented Kalman Filter for Legged Robot State Estimation
por: Lee, Seokju, et al.
Publicado: (2026)

Causal-Paced Deep Reinforcement Learning
por: Cho, Geonwoo, et al.
Publicado: (2025)

From Patterns to Predictions: A Shapelet-Based Framework for Directional Forecasting in Noisy Financial Markets
por: Kim, Juwon, et al.
Publicado: (2025)

Self-Abstraction Learning for Effective and Stable Training of Deep Neural Networks
por: Cho, Wonyong, et al.
Publicado: (2026)

DiTTo-TTS: Diffusion Transformers for Scalable Text-to-Speech without Domain-Specific Factors
por: Lee, Keon, et al.
Publicado: (2024)