An Enhanced ADMM-based Interior Point Method for Linear and Conic Optimization

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Deng, Qi, Feng, Qing, Gao, Wenzhi, Ge, Dongdong, Jiang, Bo, Jiang, Yuntian, Liu, Jingsong, Liu, Tianhao, Xue, Chenyu, Ye, Yinyu, Zhang, Chuwen
Format: Preprint
Publié: 2022
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909162098655232
author Deng, Qi
Feng, Qing
Gao, Wenzhi
Ge, Dongdong
Jiang, Bo
Jiang, Yuntian
Liu, Jingsong
Liu, Tianhao
Xue, Chenyu
Ye, Yinyu
Zhang, Chuwen
author_facet Deng, Qi
Feng, Qing
Gao, Wenzhi
Ge, Dongdong
Jiang, Bo
Jiang, Yuntian
Liu, Jingsong
Liu, Tianhao
Xue, Chenyu
Ye, Yinyu
Zhang, Chuwen
contents The ADMM-based interior point (ABIP, Lin et al. 2021) method is a hybrid algorithm that effectively combines interior point method (IPM) and first-order methods to achieve a performance boost in large-scale linear optimization. Different from traditional IPM that relies on computationally intensive Newton steps, the ABIP method applies the alternating direction method of multipliers (ADMM) to approximately solve the barrier penalized problem. However, similar to other first-order methods, this technique remains sensitive to condition number and inverse precision. In this paper, we provide an enhanced ABIP method with multiple improvements. Firstly, we develop an ABIP method to solve the general linear conic optimization and establish the associated iteration complexity. Secondly, inspired by some existing methods, we develop different implementation strategies for ABIP method, which substantially improve its performance in linear optimization. Finally, we conduct extensive numerical experiments in both synthetic and real-world datasets to demonstrate the empirical advantage of our developments. In particular, the enhanced ABIP method achieves a 5.8x reduction in the geometric mean of run time on $105$ selected LP instances from Netlib, and it exhibits advantages in certain structured problems such as SVM and PageRank. However, the enhanced ABIP method still falls behind commercial solvers in many benchmarks, especially when high accuracy is desired. We posit that it can serve as a complementary tool alongside well-established solvers.
format Preprint
id arxiv_https___arxiv_org_abs_2209_01793
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle An Enhanced ADMM-based Interior Point Method for Linear and Conic Optimization
Deng, Qi
Feng, Qing
Gao, Wenzhi
Ge, Dongdong
Jiang, Bo
Jiang, Yuntian
Liu, Jingsong
Liu, Tianhao
Xue, Chenyu
Ye, Yinyu
Zhang, Chuwen
Optimization and Control
The ADMM-based interior point (ABIP, Lin et al. 2021) method is a hybrid algorithm that effectively combines interior point method (IPM) and first-order methods to achieve a performance boost in large-scale linear optimization. Different from traditional IPM that relies on computationally intensive Newton steps, the ABIP method applies the alternating direction method of multipliers (ADMM) to approximately solve the barrier penalized problem. However, similar to other first-order methods, this technique remains sensitive to condition number and inverse precision. In this paper, we provide an enhanced ABIP method with multiple improvements. Firstly, we develop an ABIP method to solve the general linear conic optimization and establish the associated iteration complexity. Secondly, inspired by some existing methods, we develop different implementation strategies for ABIP method, which substantially improve its performance in linear optimization. Finally, we conduct extensive numerical experiments in both synthetic and real-world datasets to demonstrate the empirical advantage of our developments. In particular, the enhanced ABIP method achieves a 5.8x reduction in the geometric mean of run time on $105$ selected LP instances from Netlib, and it exhibits advantages in certain structured problems such as SVM and PageRank. However, the enhanced ABIP method still falls behind commercial solvers in many benchmarks, especially when high accuracy is desired. We posit that it can serve as a complementary tool alongside well-established solvers.
title An Enhanced ADMM-based Interior Point Method for Linear and Conic Optimization
topic Optimization and Control
url https://arxiv.org/abs/2209.01793