Cover Image

Self-Supervised Representation Learning as Mutual Information Maximization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sabby, Akhlaqur Rahman, Sui, Yi, Wu, Tongzi, Cresswell, Jesse C., Wu, Ga
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

DRESS: Disentangled Representation-based Self-Supervised Meta-Learning for Diverse Tasks
by: Cui, Wei, et al.
Published: (2025)

Self-supervised Representation Learning From Random Data Projectors
by: Sui, Yi, et al.
Published: (2023)

Conformal Agent Error Attribution
by: Feng, Naihe, et al.
Published: (2026)

Explicit Mutual Information Maximization for Self-Supervised Learning
by: Chang, Lele, et al.
Published: (2024)

Conformal Prediction Sets Can Cause Disparate Impact
by: Cresswell, Jesse C., et al.
Published: (2024)

Conformal Prediction Sets Improve Human Decision Making
by: Cresswell, Jesse C., et al.
Published: (2024)

Trustworthy AI Must Account for Interactions
by: Cresswell, Jesse C.
Published: (2025)

Tabular Data Contrastive Learning via Class-Conditioned and Feature-Correlation Based Augmentation
by: Cui, Wei, et al.
Published: (2024)

A Geometric Framework for Understanding Memorization in Generative Models
by: Ross, Brendan Leigh, et al.
Published: (2024)

Scaling Up Diffusion and Flow-based XGBoost Models
by: Cresswell, Jesse C., et al.
Published: (2024)

Response Quality Assessment for Retrieval-Augmented Generation via Conditional Conformal Factuality
by: Feng, Naihe, et al.
Published: (2025)

Self-Supervised Graph Representation Learning via Global Context Prediction
by: Peng, Zhen, et al.
Published: (2020)

MIO : Mutual Information Optimization using Self-Supervised Binary Contrastive Learning
by: Manna, Siladittya, et al.
Published: (2021)

MOLE: MOdular Learning FramEwork via Mutual Information Maximization
by: Li, Tianchao, et al.
Published: (2023)

Classifying and Addressing the Diversity of Errors in Retrieval-Augmented Generation Systems
by: Leung, Kin Kwan, et al.
Published: (2025)

InfoPO: On Mutual Information Maximization for Large Language Model Alignment
by: Xiao, Teng, et al.
Published: (2025)

Label-Efficient Self-Supervised Speaker Verification With Information Maximization and Contrastive Learning
by: Lepage, Théo, et al.
Published: (2022)

Representation Learning with Conditional Information Flow Maximization
by: Hu, Dou, et al.
Published: (2024)

On the Burden of Achieving Fairness in Conformal Prediction
by: Gao, Ziang, et al.
Published: (2026)

Gaussian Joint Embeddings For Self-Supervised Representation Learning
by: Huang, Yongchao
Published: (2026)

On Discriminative Probabilistic Modeling for Self-Supervised Representation Learning
by: Wang, Bokun, et al.
Published: (2024)

Gaussian Joint Embeddings For Self-Supervised Representation Learning
by: Huang, Yongchao
Published: (2026)

Augment then Smooth: Reconciling Differential Privacy with Certified Robustness
by: Wu, Jiapeng, et al.
Published: (2023)

Explaining Representation by Mutual Information
by: Gu, Lifeng
Published: (2021)

Maximizing Incremental Information Entropy for Contrastive Learning
by: Zhang, Jiansong, et al.
Published: (2026)

End-to-End Learning of Geometrical Shaping Maximizing Generalized Mutual Information
by: Gümüs, Kadir, et al.
Published: (2019)

MIST: Mutual Information Estimation Via Supervised Training
by: Gritsai, German, et al.
Published: (2025)

Supervised Contrastive Frame Aggregation for Video Representation Learning
by: Chowdhury, Shaif, et al.
Published: (2025)

Self-Distillation of Hidden Layers for Self-Supervised Representation Learning
by: Lowe, Scott C., et al.
Published: (2026)

Causal Foundation Models with Continuous Treatments
by: Stith, Christopher, et al.
Published: (2026)

Maximizing Data Efficiency for Cross-Lingual TTS Adaptation by Self-Supervised Representation Mixing and Embedding Initialization
by: Huang, Wei-Ping, et al.
Published: (2024)

HypeBoy: Generative Self-Supervised Representation Learning on Hypergraphs
by: Kim, Sunwoo, et al.
Published: (2024)

Can Local Learning Match Self-Supervised Backpropagation?
by: Zihan, Wu S., et al.
Published: (2026)

CausalPFN: Amortized Causal Effect Estimation via In-Context Learning
by: Balazadeh, Vahid, et al.
Published: (2025)

TAGA: Text-Attributed Graph Self-Supervised Learning by Synergizing Graph and Text Mutual Transformations
by: Zhang, Zheng, et al.
Published: (2024)

Self-Supervised Learning for Sparse Matrix Reordering
by: Li, Ziwei, et al.
Published: (2026)

STENCIL: Submodular Mutual Information Based Weak Supervision for Cold-Start Active Learning
by: Beck, Nathan, et al.
Published: (2024)

Spectral Ghost in Representation Learning: from Component Analysis to Self-Supervised Learning
by: Dai, Bo, et al.
Published: (2026)

Beyond Procedure: Substantive Fairness in Conformal Prediction
by: Liu, Pengqi, et al.
Published: (2026)

The Impact of Semantic Pairs on Self-Supervised Representation Learning
by: Alkhalefi, Mohammad, et al.
Published: (2025)