Image de couverture de livre

Mapping the Schedule x Bit-Width Boundary in Sub-100M Quantisation-Aware Training

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Thomassen, Christian Brandt
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Low-Bit Quantization Favors Undertrained LLMs: Scaling Laws for Quantized LLMs with 100T Training Tokens
par: Ouyang, Xu, et autres
Publié: (2024)

pQuant: Towards Effective Low-Bit Language Models via Decoupled Linear Quantization-Aware Training
par: Zhang, Wenzheng, et autres
Publié: (2026)

Beyond the Training Distribution: Mapping Generalization Boundaries in Neural Program Synthesis
par: Voigt, Henrik, et autres
Publié: (2026)

What Makes Low-Bit Quantization-Aware Training Work for Reasoning LLMs? A Systematic Study
par: Lv, Keyu, et autres
Publié: (2026)

$100K or 100 Days: Trade-offs when Pre-Training with Academic Resources
par: Khandelwal, Apoorv, et autres
Publié: (2024)

AdaQAT: Adaptive Bit-Width Quantization-Aware Training
par: Gernigon, Cédric, et autres
Publié: (2024)

BitNet Distillation
par: Wu, Xun, et autres
Publié: (2025)

ApiQ: Finetuning of 2-Bit Quantized Large Language Model
par: Liao, Baohao, et autres
Publié: (2024)

From Style to Facts: Mapping the Boundaries of Knowledge Injection with Finetuning
par: Zhao, Eric, et autres
Publié: (2025)

BitDelta: Your Fine-Tune May Only Be Worth One Bit
par: Liu, James, et autres
Publié: (2024)

Mixture of Universal Experts: Scaling Virtual Width via Depth-Width Transformation
par: Chen, Yilong, et autres
Publié: (2026)

xRouter: Training Cost-Aware LLMs Orchestration System via Reinforcement Learning
par: Qian, Cheng, et autres
Publié: (2025)

SPARKLING: Balancing Signal Preservation and Symmetry Breaking for Width-Progressive Learning
par: Yu, Qifan, et autres
Publié: (2026)

LLM-Upgraded Graph Reinforcement Learning for Carbon-Aware Job Scheduling in Smart Manufacturing
par: Yang, Zhiying, et autres
Publié: (2025)

Cascade-Aware Training of Language Models
par: Wang, Congchao, et autres
Publié: (2024)

Scaling Law for Quantization-Aware Training
par: Chen, Mengzhao, et autres
Publié: (2025)

Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models
par: Park, Jungwoo, et autres
Publié: (2025)

FrameQuant: Flexible Low-Bit Quantization for Transformers
par: Adepu, Harshavardhan, et autres
Publié: (2024)

DOTResize: Reducing LLM Width via Discrete Optimal Transport-based Neuron Merging
par: Verma, Neha, et autres
Publié: (2025)

LittleBit: Ultra Low-Bit Quantization via Latent Factorization
par: Lee, Banseok, et autres
Publié: (2025)

Sign Lock-In: Randomly Initialized Weight Signs Persist and Bottleneck Sub-Bit Model Compression
par: Sakai, Akira, et autres
Publié: (2026)

BAQ: Efficient Bit Allocation Quantization for Large Language Models
par: Zhang, Chao, et autres
Publié: (2025)

STBLLM: Breaking the 1-Bit Barrier with Structured Binary LLMs
par: Dong, Peijie, et autres
Publié: (2024)

Multi-Bit Distortion-Free Watermarking for Large Language Models
par: Boroujeny, Massieh Kordi, et autres
Publié: (2024)

BARREL: Boundary-Aware Reasoning for Factual and Reliable LRMs
par: Yang, Junxiao, et autres
Publié: (2025)

Confidence-Aware Sub-Structure Beam Search (CABS): Mitigating Hallucination in Structured Data Generation with Large Language Models
par: Wei, Chengwei, et autres
Publié: (2024)

QuIP: 2-Bit Quantization of Large Language Models With Guarantees
par: Chee, Jerry, et autres
Publié: (2023)

MF-QAT: Multi-Format Quantization-Aware Training for Elastic Inference
par: Xu, Zifei, et autres
Publié: (2026)

BitNet b1.58 2B4T Technical Report
par: Ma, Shuming, et autres
Publié: (2025)

Depth-Width tradeoffs in Algorithmic Reasoning of Graph Tasks with Transformers
par: Yehudai, Gilad, et autres
Publié: (2025)

Noise-Aware Training of Layout-Aware Language Models
par: Sarkhel, Ritesh, et autres
Publié: (2024)

RotateKV: Accurate and Robust 2-Bit KV Cache Quantization for LLMs via Outlier-Aware Adaptive Rotations
par: Su, Zunhai, et autres
Publié: (2025)

FLOP-Efficient Training: Early Stopping Based on Test-Time Compute Awareness
par: Amer, Hossam, et autres
Publié: (2026)

BitNet a4.8: 4-bit Activations for 1-bit LLMs
par: Wang, Hongyu, et autres
Publié: (2024)

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
par: Ma, Shuming, et autres
Publié: (2024)

To be Continuous, or to be Discrete, Those are Bits of Questions
par: Wang, Yiran, et autres
Publié: (2024)

Training a Bilingual Language Model by Mapping Tokens onto a Shared Character Space
par: Rom, Aviad, et autres
Publié: (2024)

BANER: Boundary-Aware LLMs for Few-Shot Named Entity Recognition
par: Guo, Quanjiang, et autres
Publié: (2024)

Pointer-Guided Pre-Training: Infusing Large Language Models with Paragraph-Level Contextual Awareness
par: Hillebrand, Lars, et autres
Publié: (2024)

Towards Accurate and Efficient Sub-8-Bit Integer Training
par: Guo, Wenjin, et autres
Publié: (2024)