Saved in:
Bibliographic Details
Main Authors: Li, Ziwei, Yuan, Tao, Liu, Fangfang, Niu, Shuzi, Li, Huiyuan, Wu, Wenjia
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2605.17403
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909052439625728
author Li, Ziwei
Yuan, Tao
Liu, Fangfang
Niu, Shuzi
Li, Huiyuan
Wu, Wenjia
author_facet Li, Ziwei
Yuan, Tao
Liu, Fangfang
Niu, Shuzi
Li, Huiyuan
Wu, Wenjia
contents Rearranging the rows or columns of a sparse matrix using an appropriate ordering can significantly reduce fill-ins, i.e., new nonzeros introduced during matrix factorization, decreasing memory usage and runtime. However, finding an ordering that minimizes fill-ins is NP-complete. Existing approaches, including graph-theoretic and deep learning methods, rely on surrogate objectives without theoretical guarantees. The Fill-Path Theorem reveals a direct and intrinsic relationship between fill-in generation and the sparse structure of the matrix as path triplet inequalities. Here we first employ a multigrid graph network to capture structural information for each vertex. We then derive a triplet sampling strategy based on inequalities. Finally, we introduce an end-max chain loss function to reduce the number of triplets whose predicted scores satisfy these inequalities. Experimental evaluations on the publicly available SuiteSparse matrix collection demonstrate the superiority of the proposed method in terms of both fill-in reduction and speedup in LU factorization time.
format Preprint
id arxiv_https___arxiv_org_abs_2605_17403
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Self-Supervised Learning for Sparse Matrix Reordering
Li, Ziwei
Yuan, Tao
Liu, Fangfang
Niu, Shuzi
Li, Huiyuan
Wu, Wenjia
Machine Learning
Rearranging the rows or columns of a sparse matrix using an appropriate ordering can significantly reduce fill-ins, i.e., new nonzeros introduced during matrix factorization, decreasing memory usage and runtime. However, finding an ordering that minimizes fill-ins is NP-complete. Existing approaches, including graph-theoretic and deep learning methods, rely on surrogate objectives without theoretical guarantees. The Fill-Path Theorem reveals a direct and intrinsic relationship between fill-in generation and the sparse structure of the matrix as path triplet inequalities. Here we first employ a multigrid graph network to capture structural information for each vertex. We then derive a triplet sampling strategy based on inequalities. Finally, we introduce an end-max chain loss function to reduce the number of triplets whose predicted scores satisfy these inequalities. Experimental evaluations on the publicly available SuiteSparse matrix collection demonstrate the superiority of the proposed method in terms of both fill-in reduction and speedup in LU factorization time.
title Self-Supervised Learning for Sparse Matrix Reordering
topic Machine Learning
url https://arxiv.org/abs/2605.17403