Imagen de Portada

A Metric Driven Approach to Mixed Precision Training

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Rasquinha, Mitchelle, Tabak, Gil
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

MoR: Mixture Of Representations For Mixed-Precision Training
por: Su, Bor-Yiing, et al.
Publicado: (2025)

Scale When Needed: Adaptive Neuron-level Mixed Precision Quantization Aware Training
por: Varshney, Ayush K., et al.
Publicado: (2026)

From Noise to Precision: A Diffusion-Driven Approach to Zero-Inflated Precipitation Prediction
por: Gao, Wentao, et al.
Publicado: (2025)

Mixed-Precision Federated Learning via Multi-Precision Over-The-Air Aggregation
por: Yuan, Jinsheng, et al.
Publicado: (2024)

STaMP: Sequence Transformation and Mixed Precision for Low-Precision Activation Quantization
por: Federici, Marco, et al.
Publicado: (2025)

AMPLE: Event-Driven Accelerator for Mixed-Precision Inference of Graph Neural Networks
por: Gimenes, Pedro, et al.
Publicado: (2025)

Identifying Backdoored Graphs in Graph Neural Network Training: An Explanation-Based Approach with Novel Metrics
por: Downer, Jane, et al.
Publicado: (2024)

Training Time Prediction for Mixed Precision-based Distributed Training
por: Kang, Minchul, et al.
Publicado: (2026)

MicroMix: Efficient Mixed-Precision Quantization with Microscaling Formats for Large Language Models
por: Liu, Wenyuan, et al.
Publicado: (2025)

Mixed-Precision Quantization for Language Models: Techniques and Prospects
por: Rakka, Mariam, et al.
Publicado: (2025)

APTQ: Attention-aware Post-Training Mixed-Precision Quantization for Large Language Models
por: Guan, Ziyi, et al.
Publicado: (2024)

MixKVQ: Query-Aware Mixed-Precision KV Cache Quantization for Long-Context Reasoning
por: Zhang, Tao, et al.
Publicado: (2025)

APreQEL: Adaptive Mixed Precision Quantization For Edge LLMs
por: Bouzouad, Meriem, et al.
Publicado: (2026)

A Riemannian Approach to Ground Metric Learning for Optimal Transport
por: Jawanpuria, Pratik, et al.
Publicado: (2024)

Random Cloud: Finding Minimal Neural Architectures Without Training
por: Blázquez, Javier Gil
Publicado: (2026)

PAHQ: Accelerating Automated Circuit Discovery through Mixed-Precision Inference Optimization
por: Wang, Xinhai, et al.
Publicado: (2025)

RAMP: Reinforcement Adaptive Mixed Precision Quantization for Efficient On Device LLM Inference
por: Gautam, Arpit Singh, et al.
Publicado: (2026)

Balancing Fidelity and Plasticity: Aligning Mixed-Precision Fine-Tuning with Linguistic Hierarchies
por: Zhou, Changhai, et al.
Publicado: (2025)

ScaleBITS: Scalable Bitwidth Search for Hardware-Aligned Mixed-Precision LLMs
por: Li, Xinlin, et al.
Publicado: (2026)

GAMMA: Global Bit Allocation for Mixed-Precision Models under Arbitrary Budgets
por: Yao, Zhangyang, et al.
Publicado: (2026)

Diagonal-Tiled Mixed-Precision Attention for Efficient Low-Bit MXFP Inference
por: Ding, Yifu, et al.
Publicado: (2026)

Predict Training Data Quality via Its Geometry in Metric Space
por: Ba, Yang, et al.
Publicado: (2025)

A KL Lens on Quantization: Fast, Forward-Only Sensitivity for Mixed-Precision SSM-Transformer Models
por: Kong, Jason, et al.
Publicado: (2026)

Low-Precision Training of Large Language Models: Methods, Challenges, and Opportunities
por: Hao, Zhiwei, et al.
Publicado: (2025)

Why Low-Precision Transformer Training Fails: An Analysis on Flash Attention
por: Qiu, Haiquan, et al.
Publicado: (2025)

EdgeRazor: A Lightweight Framework for Large Language Models via Mixed-Precision Quantization-Aware Distillation
por: Zhang, Shu-Hao, et al.
Publicado: (2026)

MUXQ: Mixed-to-Uniform Precision MatriX Quantization via Low-Rank Outlier Decomposition
por: Lee, Seoungsub, et al.
Publicado: (2026)

MP-ISMoE: Mixed-Precision Interactive Side Mixture-of-Experts for Efficient Transfer Learning
por: Zhang, Yutong, et al.
Publicado: (2026)

Rank-Aware Spectral Bounds on Attention Logits for Stable Low-Precision Training
por: Emadi, Seyed Morteza
Publicado: (2026)

No Token Left Behind: Reliable KV Cache Compression via Importance-Aware Mixed Precision Quantization
por: Yang, June Yong, et al.
Publicado: (2024)

CONF-KV: Confidence-Aware KV Cache Eviction with Mixed-Precision Storage for Long-Horizon LLM
por: Li, Yubo, et al.
Publicado: (2026)

Synthetic Mixed Training: Scaling Parametric Knowledge Acquisition Beyond RAG
por: Han, Seungju, et al.
Publicado: (2026)

MixGCN: Scalable GCN Training by Mixture of Parallelism and Mixture of Accelerators
por: Wan, Cheng, et al.
Publicado: (2025)

To FP8 and Back Again: Quantifying Reduced Precision Effects on LLM Training Stability
por: Lee, Joonhyung, et al.
Publicado: (2024)

Beyond Precision: Training-Inference Mismatch is an Optimization Problem and Simple LR Scheduling Fixes It
por: Zhang, Yaxiang, et al.
Publicado: (2026)

On-Chip Hardware-Aware Quantization for Mixed Precision Neural Networks
por: Huang, Wei, et al.
Publicado: (2023)

MDGMIX: Boundary-Aware Subgraph Mixing for Multi-Domain Graph Pre-Training
por: Zheng, Ziyu, et al.
Publicado: (2026)

GAC: Noise-Aware Adaptive Mixing for Hybrid SFT-RL Post-Training
por: Hu, Yuelin, et al.
Publicado: (2026)

Actor-Critic based Online Data Mixing For Language Model Pre-Training
por: Ma, Jing, et al.
Publicado: (2025)

Bootstrapped Mixed Rewards for RL Post-Training: Injecting Canonical Action Order
por: Gupta, Prakhar, et al.
Publicado: (2025)