Image de couverture de livre

Bitwidth-Specific Logarithmic Arithmetic for Future Hardware-Accelerated Training

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Hamad, Hassan, Qiu, Yuou, Beerel, Peter A., Chugg, Keith M.
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Neural Network Training with Approximate Logarithmic Computations
par: Sanyal, Arnab, et autres
Publié: (2019)

Pre-Defined Sparse Neural Networks with Hardware Acceleration
par: Dey, Sourya, et autres
Publié: (2018)

ScaleBITS: Scalable Bitwidth Search for Hardware-Aligned Mixed-Precision LLMs
par: Li, Xinlin, et autres
Publié: (2026)

StableQAT: Stable Quantization-Aware Training at Ultra-Low Bitwidths
par: Chen, Tianyi, et autres
Publié: (2026)

PQS (Prune, Quantize, and Sort): Low-Bitwidth Accumulation of Dot Products in Neural Network Computations
par: Natesh, Vikas, et autres
Publié: (2025)

Enhancing Biologically Inspired Hierarchical Temporal Memory with Hardware-Accelerated Reflex Memory
par: Bera, Pavia, et autres
Publié: (2025)

Linearizing Models for Efficient yet Robust Private Inference
par: Sarkar, Sreetama, et autres
Publié: (2024)

QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models
par: Liu, Jing, et autres
Publié: (2023)

Acceleration of Grokking in Learning Arithmetic Operations via Kolmogorov-Arnold Representation
par: Park, Yeachan, et autres
Publié: (2024)

Pgx: Hardware-Accelerated Parallel Game Simulators for Reinforcement Learning
par: Koyamada, Sotetsu, et autres
Publié: (2023)

FALQON: Accelerating LoRA Fine-tuning with Low-Bit Floating-Point Arithmetic
par: Choi, Kanghyun, et autres
Publié: (2025)

Preserving Seasonal and Trend Information: A Variational Autoencoder-Latent Space Arithmetic Based Approach for Non-stationary Learning
par: Wasswa, Hassan, et autres
Publié: (2025)

DQT: Dynamic Quantization Training via Dequantization-Free Nested Integer Arithmetic
par: Shalby, Hazem Hesham Yousef, et autres
Publié: (2025)

Mathematical Reasoning in Large Language Models: Assessing Logical and Arithmetic Errors across Wide Numerical Ranges
par: Shrestha, Safal, et autres
Publié: (2025)

Perturbation-efficient Zeroth-order Optimization for Hardware-friendly On-device Training
par: Tan, Qitao, et autres
Publié: (2025)

Co-Designing Binarized Transformer and Hardware Accelerator for Efficient End-to-End Edge Deployment
par: Ji, Yuhao, et autres
Publié: (2024)

HASTE: Hardware-Aware Dynamic Sparse Training for Large Output Spaces
par: Ullah, Nasib, et autres
Publié: (2026)

Assistax: A Hardware-Accelerated Reinforcement Learning Benchmark for Assistive Robotics
par: Hinckeldey, Leonard, et autres
Publié: (2025)

Task Arithmetic in Trust Region: A Training-Free Model Merging Approach to Navigate Knowledge Conflicts
par: Sun, Wenju, et autres
Publié: (2025)

SortedRL: Accelerating RL Training for LLMs through Online Length-Aware Scheduling
par: Zhang, Yiqi, et autres
Publié: (2026)

Arithmetic-Intensity-Aware Quantization
par: Singh, Taig, et autres
Publié: (2025)

Optimistic Verifiable Training by Controlling Hardware Nondeterminism
par: Srivastava, Megha, et autres
Publié: (2024)

Auditing Fairness by Betting
par: Chugg, Ben, et autres
Publié: (2023)

Accelerating Training with Neuron Interaction and Nowcasting Networks
par: Knyazev, Boris, et autres
Publié: (2024)

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models
par: Liu, Zeyu, et autres
Publié: (2024)

A Quantized VAE-MLP Botnet Detection Model: A Systematic Evaluation of Quantization-Aware Training and Post-Training Quantization Strategies
par: Wasswa, Hassan, et autres
Publié: (2025)

Exact Learning of Arithmetic with Differentiable Agents
par: Papazov, Hristo, et autres
Publié: (2025)

AIMI: Leveraging Future Knowledge and Personalization in Sparse Event Forecasting for Treatment Adherence
par: Mamun, Abdullah, et autres
Publié: (2025)

Logarithmic Memory Networks (LMNs): Efficient Long-Range Sequence Modeling for Resource-Constrained Environments
par: Taha, Mohamed A.
Publié: (2025)

Enabling Physical AI at the Edge: Hardware-Accelerated Recovery of System Dynamics
par: Xu, Bin, et autres
Publié: (2025)

APAR: Modeling Irregular Target Functions in Tabular Regression via Arithmetic-Aware Pre-Training and Adaptive-Regularized Fine-Tuning
par: Wu, Hong-Wei, et autres
Publié: (2024)

Mirror Descent Using the Tempesta Generalized Multi-parametric Logarithms
par: Cichocki, Andrzej
Publié: (2025)

Algorithm-Hardware Co-Design of Distribution-Aware Logarithmic-Posit Encodings for Efficient DNN Inference
par: Ramachandran, Akshat, et autres
Publié: (2024)

Error-Driven Prompt Optimization for Arithmetic Reasoning
par: Pándy, Árpád, et autres
Publié: (2025)

Transformers Can Do Arithmetic with the Right Embeddings
par: McLeish, Sean, et autres
Publié: (2024)

Layer Importance for Mathematical Reasoning is Forged in Pre-Training and Invariant after Post-Training
par: Nepal, Aadim, et autres
Publié: (2025)

Why Low-Precision Transformer Training Fails: An Analysis on Flash Attention
par: Qiu, Haiquan, et autres
Publié: (2025)

Part II: ROLL Flash -- Accelerating RLVR and Agentic Training with Asynchrony
par: Lu, Han, et autres
Publié: (2025)

MixGCN: Scalable GCN Training by Mixture of Parallelism and Mixture of Accelerators
par: Wan, Cheng, et autres
Publié: (2025)

Predictive Feature Caching for Training-free Acceleration of Molecular Geometry Generation
par: Sommer, Johanna, et autres
Publié: (2025)