Image de couverture de livre

SpidR-Adapt: A Universal Speech Representation Model for Few-Shot Adaptation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Luthra, Mahi, Shen, Jiayi, Poli, Maxime, Ortiz, Angelo, Higuchi, Yosuke, Benchekroun, Youssef, Gleize, Martin, Saint-James, Charles-Eric, Lin, Dongyan, Rust, Phillip, Villar, Angel, Parimi, Surya, Stark, Vanessa, Moritz, Rashel, Pino, Juan, LeCun, Yann, Dupoux, Emmanuel
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

SpidR: Learning Fast and Stable Linguistic Units for Spoken Language Models Without Supervision
par: Poli, Maxime, et autres
Publié: (2025)

LongTail-Swap: benchmarking language models' abilities on rare words
par: Algayres, Robin, et autres
Publié: (2025)

EgoBabyVLM: Benchmarking Cross-Modal Learning from Naturalistic Egocentric Video Data
par: Lin, Dongyan, et autres
Publié: (2026)

Why AI systems don't learn and what to do about it: Lessons on autonomous learning from cognitive science
par: Dupoux, Emmanuel, et autres
Publié: (2026)

Fast and Exact Enumeration of Deep Networks Partitions Regions
par: Balestriero, Randall, et autres
Publié: (2024)

Introduction to Latent Variable Energy-Based Models: A Path Towards Autonomous Machine Intelligence
par: Dawid, Anna, et autres
Publié: (2023)

LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics
par: Balestriero, Randall, et autres
Publié: (2025)

Learning by Reconstruction Produces Uninformative Features For Perception
par: Balestriero, Randall, et autres
Publié: (2024)

MauBERT: Universal Phonetic Inductive Biases for Few-Shot Acoustic Units Discovery
par: Tandazo, Angelo Ortiz, et autres
Publié: (2025)

LLM-JEPA: Large Language Models Meet Joint Embedding Predictive Architectures
par: Huang, Hai, et autres
Publié: (2025)

Semantic Tube Prediction: Beating LLM Data Efficiency with JEPA
par: Huang, Hai, et autres
Publié: (2026)

Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations
par: Mialon, Grégoire, et autres
Publié: (2022)

A hierarchical loss and its problems when classifying non-hierarchically
par: Wu, Cinna, et autres
Publié: (2017)

Intuitive physics understanding emerges from self-supervised pretraining on natural videos
par: Garrido, Quentin, et autres
Publié: (2025)

Video Representation Learning with Joint-Embedding Predictive Architectures
par: Drozdov, Katrina, et autres
Publié: (2024)

URLOST: Unsupervised Representation Learning without Stationarity or Topology
par: Yun, Zeyu, et autres
Publié: (2023)

DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning
par: Zhou, Gaoyue, et autres
Publié: (2024)

Gaussian Embeddings: How JEPAs Secretly Learn Your Data Density
par: Balestriero, Randall, et autres
Publié: (2025)

The Spike, the Sparse and the Sink: Anatomy of Massive Activations and Attention Sinks
par: Sun, Shangwen, et autres
Publié: (2026)

Improving Spoken Language Modeling with Phoneme Classification: A Simple Fine-tuning Approach
par: Poli, Maxime, et autres
Publié: (2024)

fastabx: A library for efficient computation of ABX discriminability
par: Poli, Maxime, et autres
Publié: (2025)

AI Must Embrace Specialization via Superhuman Adaptable Intelligence
par: Goldfeder, Judah, et autres
Publié: (2026)

The Entropy Enigma: Success and Failure of Entropy Minimization
par: Press, Ori, et autres
Publié: (2024)

RoboPEPP: Vision-Based Robot Pose and Joint Angle Estimation through Embedding Predictive Pre-Training
par: Goswami, Raktim Gautam, et autres
Publié: (2024)

OSVI-WM: One-Shot Visual Imitation for Unseen Tasks using World-Model-Guided Trajectory Generation
par: Goswami, Raktim Gautam, et autres
Publié: (2025)

Blockwise Self-Supervised Learning at Scale
par: Siddiqui, Shoaib Ahmed, et autres
Publié: (2023)

Parallel Stochastic Gradient-Based Planning for World Models
par: Psenka, Michael, et autres
Publié: (2026)

Does Representation Matter? Exploring Intermediate Layers in Large Language Models
par: Skean, Oscar, et autres
Publié: (2024)

Navigation World Models
par: Bar, Amir, et autres
Publié: (2024)

Transformers without Normalization
par: Zhu, Jiachen, et autres
Publié: (2025)

Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation
par: Denton, Remi, et autres
Publié: (2014)

TextSeal: A Localized LLM Watermark for Provenance & Distillation Protection
par: Sander, Tom, et autres
Publié: (2026)

From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaning
par: Shani, Chen, et autres
Publié: (2025)

Causal-JEPA: Learning World Models through Object-Level Latent Masking
par: Nam, Heejeong, et autres
Publié: (2026)

PooDLe: Pooled and dense self-supervised learning from naturalistic videos
par: Wang, Alex N., et autres
Publié: (2024)

What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?
par: Terver, Basile, et autres
Publié: (2025)

On Training in Imagination
par: Timor, Nadav, et autres
Publié: (2026)

Variance-Covariance Regularization Improves Representation Learning
par: Zhu, Jiachen, et autres
Publié: (2023)

Value-guided action planning with JEPA world models
par: Destrade, Matthieu, et autres
Publié: (2025)

Improving Pre-trained Self-Supervised Embeddings Through Effective Entropy Maximization
par: Chakraborty, Deep, et autres
Publié: (2024)