Saved in:
Bibliographic Details
Main Author: Chen, Xinye
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2504.14268
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910991231483904
author Chen, Xinye
author_facet Chen, Xinye
contents This paper presents a novel reinforcement learning (RL) framework for dynamically optimizing numerical precision in the preconditioned conjugate gradient (CG) method. By modeling precision selection as a Markov Decision Process (MDP), we employ Q-learning to adaptively assign precision levels to key operations, striking an optimal balance between computational efficiency and numerical accuracy, while ensuring stability through double-precision scalar computations and residual computing. In practice, the algorithm is trained on a set of data and subsequently performs inference for precision selection on out-of-sample data, without requiring re-analysis or retraining for new datasets. This enables the method to adapt seamlessly to new problem instances without the computational overhead of recalibration. Our results demonstrate the effectiveness of RL in enhancing solver's performance, marking the first application of RL to mixed-precision numerical methods. The findings highlight the approach's practical advantages, robustness, and scalability, providing valuable insights into its integration with iterative solvers and paving the way for AI-driven advancements in scientific computing.
format Preprint
id arxiv_https___arxiv_org_abs_2504_14268
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Mixed-Precision Conjugate Gradient Solvers with RL-Driven Precision Tuning
Chen, Xinye
Machine Learning
This paper presents a novel reinforcement learning (RL) framework for dynamically optimizing numerical precision in the preconditioned conjugate gradient (CG) method. By modeling precision selection as a Markov Decision Process (MDP), we employ Q-learning to adaptively assign precision levels to key operations, striking an optimal balance between computational efficiency and numerical accuracy, while ensuring stability through double-precision scalar computations and residual computing. In practice, the algorithm is trained on a set of data and subsequently performs inference for precision selection on out-of-sample data, without requiring re-analysis or retraining for new datasets. This enables the method to adapt seamlessly to new problem instances without the computational overhead of recalibration. Our results demonstrate the effectiveness of RL in enhancing solver's performance, marking the first application of RL to mixed-precision numerical methods. The findings highlight the approach's practical advantages, robustness, and scalability, providing valuable insights into its integration with iterative solvers and paving the way for AI-driven advancements in scientific computing.
title Mixed-Precision Conjugate Gradient Solvers with RL-Driven Precision Tuning
topic Machine Learning
url https://arxiv.org/abs/2504.14268