Copertina

Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Mialon, Grégoire, Balestriero, Randall, LeCun, Yann
Natura:	Preprint
Pubblicazione:	2022
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics
di: Balestriero, Randall, et al.
Pubblicazione: (2025)

Fast and Exact Enumeration of Deep Networks Partitions Regions
di: Balestriero, Randall, et al.
Pubblicazione: (2024)

Learning by Reconstruction Produces Uninformative Features For Perception
di: Balestriero, Randall, et al.
Pubblicazione: (2024)

Semantic Tube Prediction: Beating LLM Data Efficiency with JEPA
di: Huang, Hai, et al.
Pubblicazione: (2026)

Self-Supervised Learning with Lie Symmetries for Partial Differential Equations
di: Mialon, Grégoire, et al.
Pubblicazione: (2023)

Variance-Covariance Regularization Improves Representation Learning
di: Zhu, Jiachen, et al.
Pubblicazione: (2023)

Gaussian Embeddings: How JEPAs Secretly Learn Your Data Density
di: Balestriero, Randall, et al.
Pubblicazione: (2025)

An Information-Theoretic Perspective on Variance-Invariance-Covariance Regularization
di: Shwartz-Ziv, Ravid, et al.
Pubblicazione: (2023)

LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels
di: Maes, Lucas, et al.
Pubblicazione: (2026)

Rectified LpJEPA: Joint-Embedding Predictive Architectures with Sparse and Maximum-Entropy Representations
di: Kuang, Yilun, et al.
Pubblicazione: (2026)

Radial-VCReg: More Informative Representation Learning Through Radial Gaussianization
di: Kuang, Yilun, et al.
Pubblicazione: (2026)

Learning from Reward-Free Offline Data: A Case for Planning with Latent Dynamics Models
di: Sobal, Vlad, et al.
Pubblicazione: (2025)

LLM-JEPA: Large Language Models Meet Joint Embedding Predictive Architectures
di: Huang, Hai, et al.
Pubblicazione: (2025)

Blockwise Self-Supervised Learning at Scale
di: Siddiqui, Shoaib Ahmed, et al.
Pubblicazione: (2023)

Introduction to Latent Variable Energy-Based Models: A Path Towards Autonomous Machine Intelligence
di: Dawid, Anna, et al.
Pubblicazione: (2023)

Temporal Straightening for Latent Planning
di: Wang, Ying, et al.
Pubblicazione: (2026)

Occam's Razor for Self Supervised Learning: What is Sufficient to Learn Good Representations?
di: Ibrahim, Mark, et al.
Pubblicazione: (2024)

URLOST: Unsupervised Representation Learning without Stationarity or Topology
di: Yun, Zeyu, et al.
Pubblicazione: (2023)

$\mathbb{X}$-Sample Contrastive Loss: Improving Contrastive Learning with Sample Similarity Graphs
di: Sobal, Vlad, et al.
Pubblicazione: (2024)

Improving Pre-trained Self-Supervised Embeddings Through Effective Entropy Maximization
di: Chakraborty, Deep, et al.
Pubblicazione: (2024)

A hierarchical loss and its problems when classifying non-hierarchically
di: Wu, Cinna, et al.
Pubblicazione: (2017)

Does Representation Matter? Exploring Intermediate Layers in Large Language Models
di: Skean, Oscar, et al.
Pubblicazione: (2024)

Soft Clustering Anchors for Self-Supervised Speech Representation Learning in Joint Embedding Prediction Architectures
di: Ioannides, Georgios, et al.
Pubblicazione: (2026)

Self-Supervised Learning for Neural Topic Models with Variance-Invariance-Covariance Regularization
di: Xu, Weiran, et al.
Pubblicazione: (2025)

Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation Learning
di: He, Xiaoxin, et al.
Pubblicazione: (2023)

Hierarchical Planning with Latent World Models
di: Zhang, Wancong, et al.
Pubblicazione: (2026)

No Location Left Behind: Measuring and Improving the Fairness of Implicit Representations for Earth Data
di: Cai, Daniel, et al.
Pubblicazione: (2025)

Self-Supervised Anomaly Detection in the Wild: Favor Joint Embeddings Methods
di: Otero, Daniel, et al.
Pubblicazione: (2024)

Position: An Empirically Grounded Identifiability Theory Will Accelerate Self-Supervised Learning Research
di: Reizinger, Patrik, et al.
Pubblicazione: (2025)

stable-worldmodel: A Platform for Reproducible World Modeling Research and Evaluation
di: Maes, Lucas, et al.
Pubblicazione: (2026)

Parallel Stochastic Gradient-Based Planning for World Models
di: Psenka, Michael, et al.
Pubblicazione: (2026)

Learning and Leveraging World Models in Visual Representation Learning
di: Garrido, Quentin, et al.
Pubblicazione: (2024)

On Training in Imagination
di: Timor, Nadav, et al.
Pubblicazione: (2026)

Causal-JEPA: Learning World Models through Object-Level Latent Masking
di: Nam, Heejeong, et al.
Pubblicazione: (2026)

Value-guided action planning with JEPA world models
di: Destrade, Matthieu, et al.
Pubblicazione: (2025)

Eidetic Learning: an Efficient and Provable Solution to Catastrophic Forgetting
di: Dronen, Nicholas, et al.
Pubblicazione: (2025)

Representation Learning for Spatiotemporal Physical Systems
di: Qu, Helen, et al.
Pubblicazione: (2026)

Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation
di: Denton, Remi, et al.
Pubblicazione: (2014)

Light-weight probing of unsupervised representations for Reinforcement Learning
di: Zhang, Wancong, et al.
Pubblicazione: (2022)

Seq-VCR: Preventing Collapse in Intermediate Transformer Representations for Enhanced Reasoning
di: Arefin, Md Rifat, et al.
Pubblicazione: (2024)