Preventing Dimensional Collapse in Self-Supervised Learning via Orthogonality Regularization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	He, Junlin, Du, Jinxiao, Ma, Wei
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Preventing Model Collapse in Deep Canonical Correlation Analysis by Noise Regularization
by: He, Junlin, et al.
Published: (2024)

LDReg: Local Dimensionality Regularized Self-Supervised Learning
by: Huang, Hanxun, et al.
Published: (2024)

Preventing Curriculum Collapse in Self-Evolving Reasoning Systems
by: Mishra, Vaibhav
Published: (2026)

Preventing Model Collapse via Contraction-Conditioned Neural Filters
by: Han, Zongjian, et al.
Published: (2025)

PFML: Self-Supervised Learning of Time-Series Data Without Representation Collapse
by: Vaaras, Einari, et al.
Published: (2024)

Directional Neural Collapse Explains Few-Shot Transfer in Self-Supervised Learning
by: Luthra, Achleshwar, et al.
Published: (2026)

Preventing Collapse in Contrastive Learning with Orthonormal Prototypes (CLOP)
by: Li, Huanran, et al.
Published: (2024)

A Survey on Self-Supervised Learning for Non-Sequential Tabular Data
by: Wang, Wei-Yao, et al.
Published: (2024)

LaDi-RL: Latent Diffusion Reasoning Prevents Entropy Collapse in Reinforcement Learning
by: Kang, Haoqiang, et al.
Published: (2026)

A Theoretical Perspective: How to Prevent Model Collapse in Self-consuming Training Loops
by: Fu, Shi, et al.
Published: (2025)

Uncertain Multi-Objective Recommendation via Orthogonal Meta-Learning Enhanced Bayesian Optimization
by: Wang, Hongxu, et al.
Published: (2025)

Understanding and Mitigating Hyperbolic Dimensional Collapse in Graph Contrastive Learning
by: Zhang, Yifei, et al.
Published: (2023)

Expandable and Differentiable Dual Memories with Orthogonal Regularization for Exemplar-free Continual Learning
by: Moon, Hyung-Jun, et al.
Published: (2025)

Clustering Properties of Self-Supervised Learning
by: Weng, Xi, et al.
Published: (2025)

Identifying Intervenable and Interpretable Features via Orthogonality Regularization
by: Miller, Moritz, et al.
Published: (2026)

Evaluating Self-Supervised Learning via Risk Decomposition
by: Dubois, Yann, et al.
Published: (2023)

PyG-SSL: A Graph Self-Supervised Learning Toolkit
by: Zheng, Lecheng, et al.
Published: (2024)

TQL: Scaling Q-Functions with Transformers by Preventing Attention Collapse
by: Dong, Perry, et al.
Published: (2026)

Exploring Correlations of Self-Supervised Tasks for Graphs
by: Fang, Taoran, et al.
Published: (2024)

Contrastive and Variational Approaches in Self-Supervised Learning for Complex Data Mining
by: Liang, Yingbin, et al.
Published: (2025)

Understanding and Preventing Entropy Collapse in RLVR with On-Policy Entropy Flow Optimization
by: Xu, Huimin, et al.
Published: (2026)

CURE: Critical-Token-Guided Re-Concatenation for Entropy-Collapse Prevention
by: Li, Qingbin, et al.
Published: (2025)

Scalable Heterogeneous Graph Learning via Heterogeneous-aware Orthogonal Prototype Experts
by: Zhou, Wei, et al.
Published: (2026)

Do Neural Scaling Laws Exist on Graph Self-Supervised Learning?
by: Ma, Qian, et al.
Published: (2024)

Enhancing Graph Self-Supervised Learning with Graph Interplay
by: Zhao, Xinjian, et al.
Published: (2024)

On the Universality of Self-Supervised Learning
by: Qiang, Wenwen, et al.
Published: (2024)

Distribution Matching for Self-Supervised Transfer Learning
by: Jiao, Yuling, et al.
Published: (2025)

Avoiding Premature Collapse: Adaptive Annealing for Entropy-Regularized Structural Inference
by: Liu, Yizhi
Published: (2026)

Neural Collapse is Globally Optimal in Deep Regularized ResNets and Transformers
by: Súkeník, Peter, et al.
Published: (2025)

High-Dimensional Bayesian Optimization via Semi-Supervised Learning with Optimized Unlabeled Data Sampling
by: Yin, Yuxuan, et al.
Published: (2023)

Self-Supervised Learning of Disentangled Representations for Multivariate Time-Series
by: Chang, Ching, et al.
Published: (2024)

Scalable Graph Self-Supervised Learning
by: Pasand, Ali Saheb, et al.
Published: (2024)

Martingale-Consistent Self-Supervised Learning
by: Gögl, Moritz, et al.
Published: (2026)

On Partial Prototype Collapse in the DINO Family of Self-Supervised Methods
by: Govindarajan, Hariprasath, et al.
Published: (2024)

Efficient Modular Learning through Naive LoRA Summation: Leveraging Orthogonality in High-Dimensional Models
by: Cao, Zhanhao, et al.
Published: (2025)

Multimodal Cardiovascular Risk Profiling Using Self-Supervised Learning of Polysomnography
by: He, Zhengxiao, et al.
Published: (2025)

HingeRLC-GAN: Combating Mode Collapse with Hinge Loss and RLC Regularization
by: Goni, Osman, et al.
Published: (2025)

Rethinking Spectral Augmentation for Contrast-based Graph Self-Supervised Learning
by: Jian, Xiangru, et al.
Published: (2024)

DeepCell: Self-Supervised Multiview Fusion for Circuit Representation Learning
by: Shi, Zhengyuan, et al.
Published: (2025)

Adaptive Budget Allocation for Orthogonal-Subspace Adapter Tuning in LLMs Continual Learning
by: Wan, Zhiyi, et al.
Published: (2025)