Fast and Simple Multiclass Data Segmentation: An Eigendecomposition and Projection-Free Approach

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Faccio, Chiara, Porcelli, Margherita, Rinaldi, Francesco, Stoll, Martin
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917161877897216
author Faccio, Chiara
Porcelli, Margherita
Rinaldi, Francesco
Stoll, Martin
author_facet Faccio, Chiara
Porcelli, Margherita
Rinaldi, Francesco
Stoll, Martin
contents Graph-based machine learning has seen an increased interest over the last decade with many connections to other fields of applied mathematics. Learning based on partial differential equations, such as the phase-field Allen-Cahn equation, allows efficient handling of semi-supervised learning approaches on graphs. The numerical solution of the graph Allen-Cahn equation via a convexity splitting or the Merriman-Bence-Osher (MBO) scheme, albeit being a widely used approach, requires the calculation of a graph Laplacian eigendecomposition and repeated projections over the unit simplex to maintain valid partitions. The computational efficiency of those methods is hence limited by those two bottlenecks in practice, especially when dealing with large-scale instances. In order to overcome these limitations, we propose a new framework combining a novel penalty-based reformulation of the segmentation problem, which ensures valid partitions (i.e., binary solutions) for appropriate parameter choices, with an eigendecomposition and projection-free optimization scheme, which has a small per-iteration complexity (by relying primarily on sparse matrix-vector products) and guarantees good convergence properties. Experiments on synthetic and real-world datasets related to data segmentation in networks and images demonstrate that the proposed framework achieves comparable or better accuracy than the CS and MBO methods while being significantly faster, particularly for large-scale problems.
format Preprint
id arxiv_https___arxiv_org_abs_2508_09738
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Fast and Simple Multiclass Data Segmentation: An Eigendecomposition and Projection-Free Approach
Faccio, Chiara
Porcelli, Margherita
Rinaldi, Francesco
Stoll, Martin
Numerical Analysis
Graph-based machine learning has seen an increased interest over the last decade with many connections to other fields of applied mathematics. Learning based on partial differential equations, such as the phase-field Allen-Cahn equation, allows efficient handling of semi-supervised learning approaches on graphs. The numerical solution of the graph Allen-Cahn equation via a convexity splitting or the Merriman-Bence-Osher (MBO) scheme, albeit being a widely used approach, requires the calculation of a graph Laplacian eigendecomposition and repeated projections over the unit simplex to maintain valid partitions. The computational efficiency of those methods is hence limited by those two bottlenecks in practice, especially when dealing with large-scale instances. In order to overcome these limitations, we propose a new framework combining a novel penalty-based reformulation of the segmentation problem, which ensures valid partitions (i.e., binary solutions) for appropriate parameter choices, with an eigendecomposition and projection-free optimization scheme, which has a small per-iteration complexity (by relying primarily on sparse matrix-vector products) and guarantees good convergence properties. Experiments on synthetic and real-world datasets related to data segmentation in networks and images demonstrate that the proposed framework achieves comparable or better accuracy than the CS and MBO methods while being significantly faster, particularly for large-scale problems.
title Fast and Simple Multiclass Data Segmentation: An Eigendecomposition and Projection-Free Approach
topic Numerical Analysis
url https://arxiv.org/abs/2508.09738