Sparse Tensor CCA via Manifold Optimization for Multi-View Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhu, Yanjiao, Liu, Wanquan, Xiu, Xianchao, Sun, Jianqin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909949983981568
author Zhu, Yanjiao
Liu, Wanquan
Xiu, Xianchao
Sun, Jianqin
author_facet Zhu, Yanjiao
Liu, Wanquan
Xiu, Xianchao
Sun, Jianqin
contents Tensor canonical correlation analysis (TCCA) has garnered significant attention due to its effectiveness in capturing high-order correlations in multi-view learning. However, existing TCCA methods often underemphasize the characterization of individual structures and lack algorithmic convergence guarantees. In order to deal with these challenges, we propose a novel sparse TCCA model called STCCA-L, which integrates sparse regularization of canonical matrices and Laplacian regularization of multi-order graphs into the TCCA framework, thereby effectively exploiting the geometric structure of individual views. To solve this non-convex model, we develop an efficient alternating manifold proximal gradient algorithm based on manifold optimization, which avoids computationally expensive full tensor decomposition and leverages a semi-smooth Newton method for resolving the subproblem. Furthermore, we rigorously prove the convergence of the algorithm and analyze its complexity. Experimental results on eight benchmark datasets demonstrate the superior classification performance of the proposed method. Notably, on the 3Sources dataset, it achieves improvements of at least 4.50\% in accuracy and 6.77\% in F1 score over competitors. Our code is available at https://github.com/zhudafa/STCCA-L.
format Preprint
id arxiv_https___arxiv_org_abs_2504_02339
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Sparse Tensor CCA via Manifold Optimization for Multi-View Learning
Zhu, Yanjiao
Liu, Wanquan
Xiu, Xianchao
Sun, Jianqin
Optimization and Control
Tensor canonical correlation analysis (TCCA) has garnered significant attention due to its effectiveness in capturing high-order correlations in multi-view learning. However, existing TCCA methods often underemphasize the characterization of individual structures and lack algorithmic convergence guarantees. In order to deal with these challenges, we propose a novel sparse TCCA model called STCCA-L, which integrates sparse regularization of canonical matrices and Laplacian regularization of multi-order graphs into the TCCA framework, thereby effectively exploiting the geometric structure of individual views. To solve this non-convex model, we develop an efficient alternating manifold proximal gradient algorithm based on manifold optimization, which avoids computationally expensive full tensor decomposition and leverages a semi-smooth Newton method for resolving the subproblem. Furthermore, we rigorously prove the convergence of the algorithm and analyze its complexity. Experimental results on eight benchmark datasets demonstrate the superior classification performance of the proposed method. Notably, on the 3Sources dataset, it achieves improvements of at least 4.50\% in accuracy and 6.77\% in F1 score over competitors. Our code is available at https://github.com/zhudafa/STCCA-L.
title Sparse Tensor CCA via Manifold Optimization for Multi-View Learning
topic Optimization and Control
url https://arxiv.org/abs/2504.02339