Towards understanding neural collapse in supervised contrastive learning with the information bottleneck method

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Siwei, Palmer, Stephanie E
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Partial information decomposition: redundancy as information bottleneck
by: Kolchinsky, Artemy
Published: (2024)

Machine-learning optimized measurements of chaotic dynamical systems via the information bottleneck
by: Murphy, Kieran A., et al.
Published: (2023)

Which bits went where? Past and future transfer entropy decomposition with the information bottleneck
by: Murphy, Kieran A., et al.
Published: (2024)

Data efficiency, dimensionality reduction, and the generalized symmetric information bottleneck
by: Martini, K. Michael, et al.
Published: (2023)

Information theoretic underpinning of self-supervised learning by clustering
by: Kittler, Josef, et al.
Published: (2026)

Self-supervised Latent Space Optimization with Nebula Variational Coding
by: Wang, Yida, et al.
Published: (2025)

Neural collapse in the orthoplex regime
by: Alcala, James, et al.
Published: (2026)

Large Generative Model-assisted Talking-face Semantic Communication System
by: Jiang, Feibo, et al.
Published: (2024)

XAI for Self-supervised Clustering of Wireless Spectrum Activity
by: Milosheski, Ljupcho, et al.
Published: (2023)

Category learning in deep neural networks: Information content and geometry of internal representations
by: Bonnasse-Gahot, Laurent, et al.
Published: (2025)

Robust Semi-supervised Learning via $f$-Divergence and $α$-Rényi Divergence
by: Aminian, Gholamali, et al.
Published: (2024)

Approximating mutual information of high-dimensional variables using learned representations
by: Gowri, Gokul, et al.
Published: (2024)

Physics-informed deep learning and compressive collocation for high-dimensional diffusion-reaction equations: practical existence theory and numerics
by: Brugiapaglia, Simone, et al.
Published: (2024)

Some theoretical improvements on the tightness of PAC-Bayes risk certificates for neural networks
by: García-Pérez, Diego, et al.
Published: (2025)

A physics-informed neural network framework for modeling obstacle-related equations
by: Bahja, Hamid El, et al.
Published: (2023)

GTC: GNN-Transformer Co-contrastive Learning for Self-supervised Heterogeneous Graph Representation
by: Sun, Yundong, et al.
Published: (2024)

Semi-supervised Batch Learning From Logged Data
by: Aminian, Gholamali, et al.
Published: (2022)

WaterSIC: information-theoretically (near) optimal linear layer quantization
by: Lifar, Egor, et al.
Published: (2026)

Emergent musical properties of a transformer under contrastive self-supervised learning
by: Kong, Yuexuan, et al.
Published: (2025)

Asymptotic Analysis of Sample-averaged Q-learning
by: Panda, Saunak Kumar, et al.
Published: (2024)

Sample efficient inductive matrix completion with noise and inexact side information
by: Yang, Yuepeng, et al.
Published: (2026)

A representation-learning game for classes of prediction tasks
by: Uzan, Neria, et al.
Published: (2024)

Generalizing Supervised Contrastive learning: A Projection Perspective
by: Jeong, Minoh, et al.
Published: (2025)

A unified framework for learning with nonlinear model classes from arbitrary linear samples
by: Adcock, Ben, et al.
Published: (2023)

Towards A Unified PAC-Bayesian Framework for Norm-based Generalization Bounds
by: Yi, Xinping, et al.
Published: (2026)

Towards a mathematical theory for consistency training in diffusion models
by: Li, Gen, et al.
Published: (2024)

Self-supervised learning for phase retrieval
by: Sechaud, Victor, et al.
Published: (2025)

Intuitive dissection of the Gaussian information bottleneck method with an application to optimal prediction
by: Galstyan, Vahe, et al.
Published: (2025)

Adversarial attacks on neural networks through canonical Riemannian foliations
by: Tron, Eliot, et al.
Published: (2022)

An efficient search-and-score algorithm for ancestral graphs using multivariate information scores
by: Lagrange, Nikita, et al.
Published: (2024)

Training deep physical neural networks with local physical information bottleneck
by: Wang, Hao, et al.
Published: (2026)

Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models
by: Li, Gen, et al.
Published: (2023)

Towards sample-optimal learning of bosonic Gaussian quantum states
by: Chen, Senrui, et al.
Published: (2026)

Bayes-optimal learning of an extensive-width neural network from quadratically many samples
by: Maillard, Antoine, et al.
Published: (2024)

Towards Better Statistical Understanding of Watermarking LLMs
by: Cai, Zhongze, et al.
Published: (2024)

Asymptotic evaluation of the information processing capacity in reservoir computing
by: Saito, Yohei
Published: (2025)

Entropy-informed Decoding: Adaptive Information-Driven Branching
by: Evans, Benjamin Patrick, et al.
Published: (2026)

Understanding the Role of Equivariance in Self-supervised Learning
by: Wang, Yifei, et al.
Published: (2024)

Pointwise convergence of Fourier series and deep neural network for the indicator function of d-dimensional ball
by: Kawasumi, Ryota, et al.
Published: (2023)

Discrete approach to machine learning
by: Kashitsyn, Dmitriy, et al.
Published: (2025)