Saved in:
| Main Authors: | Lin, Ji, Tang, Jiaming, Tang, Haotian, Yang, Shang, Chen, Wei-Ming, Wang, Wei-Chen, Xiao, Guangxuan, Dang, Xingyu, Gan, Chuang, Han, Song |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2306.00978 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
by: Lin, Yujun, et al.
Published: (2024)
by: Lin, Yujun, et al.
Published: (2024)
DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
by: Xiao, Guangxuan, et al.
Published: (2024)
by: Xiao, Guangxuan, et al.
Published: (2024)
LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention
by: Yang, Shang, et al.
Published: (2025)
by: Yang, Shang, et al.
Published: (2025)
Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
by: Tang, Jiaming, et al.
Published: (2024)
by: Tang, Jiaming, et al.
Published: (2024)
MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning
by: Lin, Ji, et al.
Published: (2021)
by: Lin, Ji, et al.
Published: (2021)
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
by: Xiao, Guangxuan, et al.
Published: (2022)
by: Xiao, Guangxuan, et al.
Published: (2022)
On-Device Training Under 256KB Memory
by: Lin, Ji, et al.
Published: (2022)
by: Lin, Ji, et al.
Published: (2022)
DAQ: Delta-Aware Quantization for Post-Training LLM Weight Compression
by: Yu, Xiaoming, et al.
Published: (2026)
by: Yu, Xiaoming, et al.
Published: (2026)
Deep Compression Autoencoder for Efficient High-Resolution Diffusion Models
by: Chen, Junyu, et al.
Published: (2024)
by: Chen, Junyu, et al.
Published: (2024)
Transitive Array: An Efficient GEMM Accelerator with Result Reuse
by: Guo, Cong, et al.
Published: (2025)
by: Guo, Cong, et al.
Published: (2025)
Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding
by: Zhao, Yilong, et al.
Published: (2025)
by: Zhao, Yilong, et al.
Published: (2025)
ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking
by: Li, Wenshuo, et al.
Published: (2024)
by: Li, Wenshuo, et al.
Published: (2024)
Efficient Streaming Language Models with Attention Sinks
by: Xiao, Guangxuan, et al.
Published: (2023)
by: Xiao, Guangxuan, et al.
Published: (2023)
Neural Image Compression with Quantization Rectifier
by: Luo, Wei, et al.
Published: (2024)
by: Luo, Wei, et al.
Published: (2024)
FASQ: Flexible Accelerated Subspace Quantization for Calibration-Free LLM Compression
by: Qiao, Ye, et al.
Published: (2026)
by: Qiao, Ye, et al.
Published: (2026)
FGMP: Fine-Grained Mixed-Precision Weight and Activation Quantization for Hardware-Accelerated LLM Inference
by: Hooper, Coleman, et al.
Published: (2025)
by: Hooper, Coleman, et al.
Published: (2025)
Quantization Meets OOD: Generalizable Quantization-aware Training from a Flatness Perspective
by: Jiang, Jiacheng, et al.
Published: (2025)
by: Jiang, Jiacheng, et al.
Published: (2025)
Optimizing Mixture of Block Attention
by: Xiao, Guangxuan, et al.
Published: (2025)
by: Xiao, Guangxuan, et al.
Published: (2025)
ASVD: Activation-aware Singular Value Decomposition for Compressing Large Language Models
by: Yuan, Zhihang, et al.
Published: (2023)
by: Yuan, Zhihang, et al.
Published: (2023)
Tiny Machine Learning: Progress and Futures
by: Lin, Ji, et al.
Published: (2024)
by: Lin, Ji, et al.
Published: (2024)
StreamingVLM: Real-Time Understanding for Infinite Video Streams
by: Xu, Ruyi, et al.
Published: (2025)
by: Xu, Ruyi, et al.
Published: (2025)
Fine-tuning DeepSeek-OCR-2 for Molecular Structure Recognition
by: Tang, Haocheng, et al.
Published: (2026)
by: Tang, Haocheng, et al.
Published: (2026)
Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling
by: Cook, Jack, et al.
Published: (2025)
by: Cook, Jack, et al.
Published: (2025)
Binary Weight Multi-Bit Activation Quantization for Compute-in-Memory CNN Accelerators
by: Zhou, Wenyong, et al.
Published: (2025)
by: Zhou, Wenyong, et al.
Published: (2025)
XAttention: Block Sparse Attention with Antidiagonal Scoring
by: Xu, Ruyi, et al.
Published: (2025)
by: Xu, Ruyi, et al.
Published: (2025)
Investigation of Wheel‐Rail Adhesion Performance Under Water‐Contaminated Conditions Considering Interface Geometry
by: Congcong Fang, et al.
Published: (2026)
by: Congcong Fang, et al.
Published: (2026)
A three-term Polak-Ribière-Polyak conjugate gradient method for vector optimization
by: Lin, Guangxuan, et al.
Published: (2025)
by: Lin, Guangxuan, et al.
Published: (2025)
Optimal Quantized Compressed Sensing via Projected Gradient Descent
by: Chen, Junren, et al.
Published: (2024)
by: Chen, Junren, et al.
Published: (2024)
Entanglement Network Suppresses Toughness Deterioration in Polycarbonate at Superhigh Strain Rates
by: Peng Dong, et al.
Published: (2025)
by: Peng Dong, et al.
Published: (2025)
EVA: Accelerating LLM Decoding via an Efficient Vector Quantization Architecture
by: Duan, Bowen, et al.
Published: (2026)
by: Duan, Bowen, et al.
Published: (2026)
InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
by: Xiao, Chaojun, et al.
Published: (2024)
by: Xiao, Chaojun, et al.
Published: (2024)
Differentiable Vector Quantization for Rate-Distortion Optimization of Generative Image Compression
by: Jiang, Shiyin, et al.
Published: (2026)
by: Jiang, Shiyin, et al.
Published: (2026)
Weighted Nested Commutators for Scalable Counterdiabatic State Preparation
by: Tang, Jialiang, et al.
Published: (2026)
by: Tang, Jialiang, et al.
Published: (2026)
AMC: AutoML for Model Compression and Acceleration on Mobile Devices
by: He, Yihui, et al.
Published: (2018)
by: He, Yihui, et al.
Published: (2018)
Post-training Quantization for Text-to-Image Diffusion Models with Progressive Calibration and Activation Relaxing
by: Tang, Siao, et al.
Published: (2023)
by: Tang, Siao, et al.
Published: (2023)
AdaDecode: Accelerating LLM Decoding with Adaptive Layer Parallelism
by: Wei, Zhepei, et al.
Published: (2025)
by: Wei, Zhepei, et al.
Published: (2025)
Accelerating Parallel Diffusion Model Serving with Residual Compression
by: Luo, Jiajun, et al.
Published: (2025)
by: Luo, Jiajun, et al.
Published: (2025)
TL;DR: Too Long, Do Re-weighting for Efficient LLM Reasoning Compression
by: Li, Zhong-Zhi, et al.
Published: (2025)
by: Li, Zhong-Zhi, et al.
Published: (2025)
Quantization-aware Matrix Factorization for Low Bit Rate Image Compression
by: Ashtari, Pooya, et al.
Published: (2024)
by: Ashtari, Pooya, et al.
Published: (2024)
AAAC: Activation-Aware Adaptive Codebooks for 4-bit LLM Weight Quantization
by: IslamBouli, Beshr, et al.
Published: (2026)
by: IslamBouli, Beshr, et al.
Published: (2026)
Similar Items
-
QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
by: Lin, Yujun, et al.
Published: (2024) -
DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
by: Xiao, Guangxuan, et al.
Published: (2024) -
LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention
by: Yang, Shang, et al.
Published: (2025) -
Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
by: Tang, Jiaming, et al.
Published: (2024) -
MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning
by: Lin, Ji, et al.
Published: (2021)