Image de couverture de livre

Soft Clustering Anchors for Self-Supervised Speech Representation Learning in Joint Embedding Prediction Architectures

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ioannides, Georgios, Kieback, Adrian, Goldfeder, Judah, Pang, Linsey, Chadha, Aman, Elkins, Aaron, LeCun, Yann, Shwartz-Ziv, Ravid
Format:	Preprint
Publié:	2026
Sujets:	Audio and Speech Processing Artificial Intelligence Machine Learning Sound
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

JEPA as a Neural Tokenizer: Learning Robust Speech Representations with Density Adaptive Attention
par: Ioannides, Georgios, et autres
Publié: (2025)

Density Adaptive Attention-based Speech Network: Enhancing Feature Understanding for Mental Health Disorders
par: Ioannides, Georgios, et autres
Publié: (2024)

Video Representation Learning with Joint-Embedding Predictive Architectures
par: Drozdov, Katrina, et autres
Publié: (2024)

AI Must Embrace Specialization via Superhuman Adaptable Intelligence
par: Goldfeder, Judah, et autres
Publié: (2026)

Density Adaptive Attention is All You Need: Robust Parameter-Efficient Fine-Tuning Across Multiple Modalities
par: Ioannides, Georgios, et autres
Publié: (2024)

Antislop: A Comprehensive Framework for Identifying and Eliminating Repetitive Patterns in Language Models
par: Paech, Samuel, et autres
Publié: (2025)

The Entropy Enigma: Success and Failure of Entropy Minimization
par: Press, Ori, et autres
Publié: (2024)

Does Representation Matter? Exploring Intermediate Layers in Large Language Models
par: Skean, Oscar, et autres
Publié: (2024)

Out-of-Distribution Detection with Attention Head Masking for Multimodal Document Classification
par: Constantinou, Christos, et autres
Publié: (2024)

MOD-X: A Modular Open Decentralized eXchange Framework proposal for Heterogeneous Interoperable Artificial Intelligence Agents
par: Ioannides, Georgios, et autres
Publié: (2025)

From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaning
par: Shani, Chen, et autres
Publié: (2025)

On Training in Imagination
par: Timor, Nadav, et autres
Publié: (2026)

Variance-Covariance Regularization Improves Representation Learning
par: Zhu, Jiachen, et autres
Publié: (2023)

An Information-Theoretic Perspective on Variance-Invariance-Covariance Regularization
par: Shwartz-Ziv, Ravid, et autres
Publié: (2023)

Rate-In: Information-Driven Adaptive Dropout Rates for Improved Inference-Time Uncertainty Estimation
par: Zeevi, Tal, et autres
Publié: (2024)

LLM-JEPA: Large Language Models Meet Joint Embedding Predictive Architectures
par: Huang, Hai, et autres
Publié: (2025)

Just How Flexible are Neural Networks in Practice?
par: Shwartz-Ziv, Ravid, et autres
Publié: (2024)

DAWZY: A New Addition to AI powered "Human in the Loop" Music Co-creation
par: Elkins, Aaron C, et autres
Publié: (2025)

Layer by Layer: Uncovering Hidden Representations in Language Models
par: Skean, Oscar, et autres
Publié: (2025)

Seq-VCR: Preventing Collapse in Intermediate Transformer Representations for Enhanced Reasoning
par: Arefin, Md Rifat, et autres
Publié: (2024)

A superpersuasive autonomous policy debating system
par: Roush, Allen, et autres
Publié: (2025)

Attention Sinks and Compression Valleys in LLMs are Two Sides of the Same Coin
par: Queipo-de-Llano, Enrique, et autres
Publié: (2025)

Learning to Compress: Local Rank and Information Compression in Deep Neural Networks
par: Patel, Niket, et autres
Publié: (2024)

LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics
par: Balestriero, Randall, et autres
Publié: (2025)

Exploring Human-AI Conceptual Alignment through the Prism of Chess
par: Lomasov, Semyon, et autres
Publié: (2025)

LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels
par: Maes, Lucas, et autres
Publié: (2026)

Rectified LpJEPA: Joint-Embedding Predictive Architectures with Sparse and Maximum-Entropy Representations
par: Kuang, Yilun, et autres
Publié: (2026)

Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations
par: Mialon, Grégoire, et autres
Publié: (2022)

Do Multi-Agents Dream of Electric Screens? Achieving Perfect Accuracy on AndroidWorld Through Task Decomposition
par: Favreau, Pierre-Louis, et autres
Publié: (2026)

RoboPEPP: Vision-Based Robot Pose and Joint Angle Estimation through Embedding Predictive Pre-Training
par: Goswami, Raktim Gautam, et autres
Publié: (2024)

What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?
par: Terver, Basile, et autres
Publié: (2025)

Improving Pre-trained Self-Supervised Embeddings Through Effective Entropy Maximization
par: Chakraborty, Deep, et autres
Publié: (2024)

VL-JEPA: Joint Embedding Predictive Architecture for Vision-language
par: Chen, Delong, et autres
Publié: (2025)

Fast and Exact Enumeration of Deep Networks Partitions Regions
par: Balestriero, Randall, et autres
Publié: (2024)

Introduction to Latent Variable Energy-Based Models: A Path Towards Autonomous Machine Intelligence
par: Dawid, Anna, et autres
Publié: (2023)

Learning by Reconstruction Produces Uninformative Features For Perception
par: Balestriero, Randall, et autres
Publié: (2024)

NdLinear: Preserving Multi-Dimensional Structure for Parameter-Efficient Neural Networks
par: Reneau, Alex, et autres
Publié: (2025)

Gaussian Embeddings: How JEPAs Secretly Learn Your Data Density
par: Balestriero, Randall, et autres
Publié: (2025)

Blockwise Self-Supervised Learning at Scale
par: Siddiqui, Shoaib Ahmed, et autres
Publié: (2023)

A Lightweight Library for Energy-Based Joint-Embedding Predictive Architectures
par: Terver, Basile, et autres
Publié: (2026)