Image de couverture de livre

BlockDialect: Block-wise Fine-grained Mixed Format Quantization for Energy-Efficient LLM Inference

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Jang, Wonsuk, Tambe, Thierry
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

SemanticDialect: Semantic-Aware Mixed-Format Quantization for Video Diffusion Transformers
par: Jang, Wonsuk, et autres
Publié: (2026)

RaZeR: Pushing the Limits of NVFP4 Quantization with Redundant Zero Remapping
par: Chen, Yuzong, et autres
Publié: (2025)

Improving Block-Wise LLM Quantization by 4-bit Block-Wise Optimal Float (BOF4): Analysis and Variations
par: Blumenberg, Patrick, et autres
Publié: (2025)

CBQ: Cross-Block Quantization for Large Language Models
par: Ding, Xin, et autres
Publié: (2023)

Block Rotation is All You Need for MXFP4 Quantization
par: Shao, Yuantian, et autres
Publié: (2025)

Progressive Mixed-Precision Decoding for Efficient LLM Inference
par: Chen, Hao Mark, et autres
Publié: (2024)

Block-Attention for Efficient Prefilling
par: Ma, Dongyang, et autres
Publié: (2024)

Four Over Six: More Accurate NVFP4 Quantization with Adaptive Block Scaling
par: Cook, Jack, et autres
Publié: (2025)

Fast KVzip: Efficient and Accurate LLM Inference with Gated KV Eviction
par: Kim, Jang-Hyun, et autres
Publié: (2026)

Saudi-Dialect-ALLaM: LoRA Fine-Tuning for Dialectal Arabic Generation
par: Barmandah, Hassan
Publié: (2025)

Interactions Across Blocks in Post-Training Quantization of Large Language Models
par: Shabanovi, Khasmamad, et autres
Publié: (2024)

On the Role of Temperature Sampling in Test-Time Scaling
par: Wu, Yuheng, et autres
Publié: (2025)

AgenticCache: Cache-Driven Asynchronous Planning for Embodied AI Agents
par: Kim, Hojoon, et autres
Publié: (2026)

KVTuner: Sensitivity-Aware Layer-Wise Mixed-Precision KV Cache Quantization for Efficient and Nearly Lossless LLM Inference
par: Li, Xing, et autres
Publié: (2025)

QEFT: Quantization for Efficient Fine-Tuning of LLMs
par: Lee, Changhun, et autres
Publié: (2024)

EBFT: Effective and Block-Wise Fine-Tuning for Sparse LLMs
par: Guo, Song, et autres
Publié: (2024)

GeoBlock: Inferring Block Granularity from Dependency Geometry in Diffusion Language Models
par: Wan, Lipeng, et autres
Publié: (2026)

MF-QAT: Multi-Format Quantization-Aware Training for Elastic Inference
par: Xu, Zifei, et autres
Publié: (2026)

AMAQ: Adaptive Mixed-bit Activation Quantization for Collaborative Parameter Efficient Fine-tuning
par: Song, Yurun, et autres
Publié: (2025)

Block Transformer: Global-to-Local Language Modeling for Fast Inference
par: Ho, Namgyu, et autres
Publié: (2024)

MAGE: All-[MASK] Block Already Knows Where to Look in Diffusion LLM
par: Kwon, Omin, et autres
Publié: (2026)

Optimizing Mixture of Block Attention
par: Xiao, Guangxuan, et autres
Publié: (2025)

APB: Accelerating Distributed Long-Context Inference by Passing Compressed Context Blocks across GPUs
par: Huang, Yuxiang, et autres
Publié: (2025)

Beyond Outliers: A Data-Free Layer-wise Mixed-Precision Quantization Approach Driven by Numerical and Structural Dual-Sensitivity
par: Zhang, Hengyuan, et autres
Publié: (2026)

Dialectical Behavior Therapy Approach to LLM Prompting
par: Vitman, Oxana, et autres
Publié: (2024)

One-Pass to Reason: Token Duplication and Block-Sparse Mask for Efficient Fine-Tuning on Multi-Turn Reasoning
par: Goru, Ritesh, et autres
Publié: (2025)

Athena: Efficient Block-Wise Post-Training Quantization for Large Language Models Using Second-Order Matrix Derivative Information
par: Wang, Yanshu, et autres
Publié: (2024)

Thanos: A Block-wise Pruning Algorithm for Efficient Large Language Model Compression
par: Ilin, Ivan, et autres
Publié: (2025)

Transparent Screening for LLM Inference and Training Impacts
par: Pachot, Arnault, et autres
Publié: (2026)

LEGO: Language Model Building Blocks
par: Bhansali, Shrenik, et autres
Publié: (2024)

On the Effect of Uncertainty on Layer-wise Inference Dynamics
par: Kim, Sunwoo, et autres
Publié: (2025)

Block Sparse Flash Attention
par: Ohayon, Daniel, et autres
Publié: (2025)

Sustainable LLM Inference for Edge AI: Evaluating Quantized LLMs for Energy Efficiency, Output Accuracy, and Inference Latency
par: Husom, Erik Johannes, et autres
Publié: (2025)

Prometheus: Inducing Fine-grained Evaluation Capability in Language Models
par: Kim, Seungone, et autres
Publié: (2023)

Block Circulant Adapter for Large Language Models
par: Ding, Xinyu, et autres
Publié: (2025)

Scaling Laws For Mixed Quantization
par: Cao, Zeyu, et autres
Publié: (2024)

SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models
par: Huang, Wei, et autres
Publié: (2024)

LEAP: Layer-wise Exit-Aware Pretraining for Efficient Transformer Inference
par: Kapadia, Shashank, et autres
Publié: (2026)

SqueezeAttention: 2D Management of KV-Cache in LLM Inference via Layer-wise Optimal Budget
par: Wang, Zihao, et autres
Publié: (2024)

DartQuant: Efficient Rotational Distribution Calibration for LLM Quantization
par: Shao, Yuantian, et autres
Publié: (2025)