Image de couverture de livre

WERank: Towards Rank Degradation Prevention for Self-Supervised Learning Using Weight Regularization

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Pasand, Ali Saheb, Moravej, Reza, Biparva, Mahdi, Ghodsi, Ali
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Scalable Graph Self-Supervised Learning
par: Pasand, Ali Saheb, et autres
Publié: (2024)

Egalitarian Gradient Descent: A Simple Approach to Accelerated Grokking
par: Pasand, Ali Saheb, et autres
Publié: (2025)

ExGRG: Explicitly-Generated Relation Graph for Self-Supervised Representation Learning
par: Naseri, Mahdi, et autres
Publié: (2024)

Orchid: Flexible and Data-Dependent Convolution for Sequence Modeling
par: Karami, Mahdi, et autres
Publié: (2024)

Auto-Regressive Masked Diffusion Models
par: Karami, Mahdi, et autres
Publié: (2026)

Stable Deep Reinforcement Learning via Isotropic Gaussian Representations
par: Pasand, Ali Saheb, et autres
Publié: (2026)

REAM: Merging Improves Pruning of Experts in LLMs
par: Jha, Saurav, et autres
Publié: (2026)

How Many Heads Make an SSM? A Unified Framework for Attention and State Space Models
par: Ghodsi, Ali
Publié: (2025)

DyG2Vec: Efficient Representation Learning for Dynamic Graphs
par: Alomrani, Mohammad Ali, et autres
Publié: (2022)

Todyformer: Towards Holistic Dynamic Graph Transformers with Structure-Aware Tokenization
par: Biparva, Mahdi, et autres
Publié: (2024)

TExplain: Explaining Learned Visual Features via Pre-trained (Frozen) Language Models
par: Taghanaki, Saeid Asgari, et autres
Publié: (2023)

Logic Synthesis Optimization with Predictive Self-Supervision via Causal Transformers
par: Karimi, Raika, et autres
Publié: (2024)

When Engineering Outruns Intelligence: Rethinking Instruction-Guided Navigation
par: Aghaei, Matin, et autres
Publié: (2025)

Preventing Dimensional Collapse in Self-Supervised Learning via Orthogonality Regularization
par: He, Junlin, et autres
Publié: (2024)

Using Self-Supervised Auxiliary Tasks to Improve Fine-Grained Facial Representation
par: Pourmirzaei, Mahdi, et autres
Publié: (2021)

Revisiting Weight Regularization for Low-Rank Continual Learning
par: Zheng, Yaoyue, et autres
Publié: (2026)

Learning Chemotherapy Drug Action via Universal Physics-Informed Neural Networks
par: Podina, Lena, et autres
Publié: (2024)

JEPAMatch: Geometric Representation Shaping for Semi-Supervised Learning
par: Aghababaei-Harandi, Ali, et autres
Publié: (2026)

GraphPI: Efficient Protein Inference with Graph Neural Networks
par: Ma, Zheng, et autres
Publié: (2026)

Understanding Self-Supervised Learning via Gaussian Mixture Models
par: Bansal, Parikshit, et autres
Publié: (2024)

Towards Cohesion-Fairness Harmony: Contrastive Regularization in Individual Fair Graph Clustering
par: Ghodsi, Siamak, et autres
Publié: (2024)

Regularizing with Pseudo-Negatives for Continual Self-Supervised Learning
par: Cha, Sungmin, et autres
Publié: (2023)

Low-Rank Approximation of Structural Redundancy for Self-Supervised Learning
par: Du, Kang, et autres
Publié: (2024)

MTLSO: A Multi-Task Learning Approach for Logic Synthesis Optimization
par: Faez, Faezeh, et autres
Publié: (2024)

Only Large Weights (And Not Skip Connections) Can Prevent the Perils of Rank Collapse
par: Alman, Josh, et autres
Publié: (2025)

Fairness Regularization in Federated Learning
par: Kharaghani, Zahra, et autres
Publié: (2025)

Fair Graph Neural Network with Supervised Contrastive Regularization
par: Kejani, Mahdi Tavassoli, et autres
Publié: (2024)

Optimizing Portfolio with Two-Sided Transactions and Lending: A Reinforcement Learning Framework
par: Habibnia, Ali, et autres
Publié: (2024)

DWFL: Enhancing Federated Learning through Dynamic Weighted Averaging
par: Chourasia, Prakash, et autres
Publié: (2024)

QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning
par: Rajabzadeh, Hossein, et autres
Publié: (2024)

SPINN: An Optimal Self-Supervised Physics-Informed Neural Network Framework
par: Pirayeshshirazinezhad, Reza
Publié: (2025)

GraSSRep: Graph-Based Self-Supervised Learning for Repeat Detection in Metagenomic Assembly
par: Azizpour, Ali, et autres
Publié: (2024)

Degradation Self-Supervised Learning for Lithium-ion Battery Health Diagnostics
par: Chen, J. C.
Publié: (2025)

Soft Equivariance Regularization for Invariant Self-Supervised Learning
par: Lee, Joohyung, et autres
Publié: (2026)

Implicit Regularization Towards Rank Minimization in ReLU Networks
par: Timor, Nadav, et autres
Publié: (2022)

Unified Framework for Pre-trained Neural Network Compression via Decomposition and Optimized Rank Selection
par: Aghababaei-Harandi, Ali, et autres
Publié: (2024)

Zero-shot Active Learning Using Self Supervised Learning
par: Sinha, Abhishek, et autres
Publié: (2024)

Survival Reinforcement Learning: Toward Scalable Self-Supervised RL
par: Nguimatsia-Tiofack, Franki, et autres
Publié: (2026)

Pose-Aware Self-Supervised Learning with Viewpoint Trajectory Regularization
par: Wang, Jiayun, et autres
Publié: (2024)

Integration of Self-Supervised BYOL in Semi-Supervised Medical Image Recognition
par: Feng, Hao, et autres
Publié: (2024)