Cover Image

Improving Pre-trained Self-Supervised Embeddings Through Effective Entropy Maximization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chakraborty, Deep, LeCun, Yann, Rudner, Tim G. J., Learned-Miller, Erik
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computer Vision and Pattern Recognition Information Theory Applications
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Radial-VCReg: More Informative Representation Learning Through Radial Gaussianization
by: Kuang, Yilun, et al.
Published: (2026)

Rectified LpJEPA: Joint-Embedding Predictive Architectures with Sparse and Maximum-Entropy Representations
by: Kuang, Yilun, et al.
Published: (2026)

LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics
by: Balestriero, Randall, et al.
Published: (2025)

An Information-Theoretic Perspective on Variance-Invariance-Covariance Regularization
by: Shwartz-Ziv, Ravid, et al.
Published: (2023)

Blockwise Self-Supervised Learning at Scale
by: Siddiqui, Shoaib Ahmed, et al.
Published: (2023)

RoboPEPP: Vision-Based Robot Pose and Joint Angle Estimation through Embedding Predictive Pre-Training
by: Goswami, Raktim Gautam, et al.
Published: (2024)

The Entropy Enigma: Success and Failure of Entropy Minimization
by: Press, Ori, et al.
Published: (2024)

Video Representation Learning with Joint-Embedding Predictive Architectures
by: Drozdov, Katrina, et al.
Published: (2024)

Learning by Reconstruction Produces Uninformative Features For Perception
by: Balestriero, Randall, et al.
Published: (2024)

Gaussian Embeddings: How JEPAs Secretly Learn Your Data Density
by: Balestriero, Randall, et al.
Published: (2025)

Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations
by: Mialon, Grégoire, et al.
Published: (2022)

A hierarchical loss and its problems when classifying non-hierarchically
by: Wu, Cinna, et al.
Published: (2017)

Independent fact-checking organizations exhibit a departure from political neutrality
by: Singh, Sahajpreet, et al.
Published: (2024)

Meta-experiments: Improving experimentation through experimentation
by: Müller, Melanie J. I.
Published: (2024)

GRAMEP: an alignment-free method based on the Maximum Entropy Principle for identifying SNPs
by: Pimenta-Zanon, Matheus Henrique, et al.
Published: (2024)

Edge‐AI Driven Gamification in Engineering Education for Improving Student Engagement
by: Kiran Deep Singh, et al.
Published: (2025)

DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning
by: Zhou, Gaoyue, et al.
Published: (2024)

Who is driving the conversation? Analysing the nodality of British MPs and journalists on social media
by: Chakraborty, Sukankana, et al.
Published: (2024)

Variance-Covariance Regularization Improves Representation Learning
by: Zhu, Jiachen, et al.
Published: (2023)

URLOST: Unsupervised Representation Learning without Stationarity or Topology
by: Yun, Zeyu, et al.
Published: (2023)

Ego Group Partition: A Novel Framework for Improving Ego Experiments in Social Networks
by: Deng, Lu, et al.
Published: (2024)

Statistical two-round search for one excellent element
by: G, Nagananda K, et al.
Published: (2026)

LLM-JEPA: Large Language Models Meet Joint Embedding Predictive Architectures
by: Huang, Hai, et al.
Published: (2025)

Mean Estimation with User-Level Privacy for Spatio-Temporal IoT Datasets
by: Rameshwar, V. Arvind, et al.
Published: (2024)

Compressing then Matching: An Efficient Pre-training Paradigm for Multimodal Embedding
by: Li, Da, et al.
Published: (2025)

V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learning
by: Mur-Labadia, Lorenzo, et al.
Published: (2026)

Fast and Exact Enumeration of Deep Networks Partitions Regions
by: Balestriero, Randall, et al.
Published: (2024)

Introduction to Latent Variable Energy-Based Models: A Path Towards Autonomous Machine Intelligence
by: Dawid, Anna, et al.
Published: (2023)

GARG-AML against Smurfing: A Scalable and Interpretable Graph-Based Framework for Anti-Money Laundering
by: Deprez, Bruno, et al.
Published: (2025)

From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaning
by: Shani, Chen, et al.
Published: (2025)

Learning from Reward-Free Offline Data: A Case for Planning with Latent Dynamics Models
by: Sobal, Vlad, et al.
Published: (2025)

An information metric for comparing and assessing informative interim decisions in sequential clinical trials
by: Caruso, G., et al.
Published: (2025)

Rate-In: Information-Driven Adaptive Dropout Rates for Improved Inference-Time Uncertainty Estimation
by: Zeevi, Tal, et al.
Published: (2024)

Transnational Network Dynamics of Problematic Information Diffusion
by: Villa-Turek, Esteban, et al.
Published: (2024)

An Information-Theoretic Intersectional Data Valuation Theory
by: Garrido-Merchán, Eduardo C.
Published: (2025)

Comparing how Large Language Models perform against keyword-based searches for social science research data discovery
by: Green, Mark, et al.
Published: (2026)

On Correlating Factors for Domain Adaptation Performance
by: Yuksel, Goksenin, et al.
Published: (2025)

The Causal Uncertainty Principle
by: Reidpath, Daniel D.
Published: (2025)

Active Redundancy Allocation Strategy at Component and System Level
by: Modok, Bidhan, et al.
Published: (2026)

Statistical characterization of kappa-mu shadowed fading
by: Paris, J. F.
Published: (2013)