Imagen de Portada

Scaling Properties of Continuous Diffusion Spoken Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Ramapuram, Jason, Dhekane, Eeshan Gunesh, Shidani, Amitis, Busbridge, Dan, Mazoure, Bogdan, Gu, Zijin, Webb, Russ, Likhomanenko, Tatiana, Jaitly, Navdeep
Formato:	Preprint
Publicado:	2026
Materias:	Computation and Language Artificial Intelligence Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Poly-View Contrastive Learning
por: Shidani, Amitis, et al.
Publicado: (2024)

Theory, Analysis, and Best Practices for Sigmoid Self-Attention
por: Ramapuram, Jason, et al.
Publicado: (2024)

Revisiting the Scaling Properties of Downstream Metrics in Large Language Model Training
por: Krajewski, Jakub, et al.
Publicado: (2025)

Distillation Scaling Laws
por: Busbridge, Dan, et al.
Publicado: (2025)

Path-Constrained Mixture-of-Experts
por: Gu, Zijin, et al.
Publicado: (2026)

Omni-Router: Sharing Routing Decisions in Sparse Mixture-of-Experts for Speech Recognition
por: Gu, Zijin, et al.
Publicado: (2025)

SpeakStream: Streaming Text-to-Speech with Interleaved Data
por: Bai, Richard He, et al.
Publicado: (2025)

Which Evaluation for Which Model? A Taxonomy for Speech Model Assessment
por: de Seyssel, Maureen, et al.
Publicado: (2025)

A Small-Scale System for Autoregressive Program Synthesis Enabling Controlled Experimentation
por: Webb, Russ, et al.
Publicado: (2026)

dMel: Speech Tokenization made Simple
por: Bai, Richard He, et al.
Publicado: (2024)

Revisiting ASR Error Correction with Specialized Models
por: Gu, Zijin, et al.
Publicado: (2024)

Thou Shalt Not Prompt: Zero-Shot Human Activity Recognition in Smart Homes via Language Modeling of Sensor Data & Activities
por: Dhekane, Sourish Gunesh, et al.
Publicado: (2025)

Transfer Learning in Human Activity Recognition: A Survey
por: Dhekane, Sourish Gunesh, et al.
Publicado: (2024)

Closing the Gap Between Text and Speech Understanding in LLMs
por: Cuervo, Santiago, et al.
Publicado: (2025)

Attention to Mamba: A Recipe for Cross-Architecture Distillation
por: Moudgil, Abhinav, et al.
Publicado: (2026)

Ranking In Generalized Linear Bandits
por: Shidani, Amitis, et al.
Publicado: (2022)

ChipChat: Low-Latency Cascaded Conversational Agent in MLX
por: Likhomanenko, Tatiana, et al.
Publicado: (2025)

How PARTs assemble into wholes: Learning the relative composition of images
por: Ayoughi, Melika, et al.
Publicado: (2025)

Mechanisms of Multimodal Synchronization: Insights from Decoder-Based Video-Text-to-Speech Synthesis
por: Gupta, Akshita, et al.
Publicado: (2024)

SelfReflect: Can LLMs Communicate Their Internal Answer Distribution?
por: Kirchhof, Michael, et al.
Publicado: (2025)

Bernstein-type dimension-free concentration for self-normalised martingales
por: Akhavan, Arya, et al.
Publicado: (2025)

Completed Hyperparameter Transfer across Modules, Width, Depth, Batch and Duration
por: Mlodozeniec, Bruno, et al.
Publicado: (2025)

The Design Space of Tri-Modal Masked Diffusion Models
por: Bethune, Louis, et al.
Publicado: (2026)

SAGE: Steering Dialog Generation with Future-Aware State-Action Augmentation
por: Zhang, Yizhe, et al.
Publicado: (2025)

Matryoshka Diffusion Models
por: Gu, Jiatao, et al.
Publicado: (2023)

PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Model
por: Zhang, Yizhe, et al.
Publicado: (2023)

Scaling Categorical Flow Maps
por: Davis, Oscar, et al.
Publicado: (2026)

Beyond Real Data: Synthetic Data through the Lens of Regularization
por: Shidani, Amitis, et al.
Publicado: (2025)

What Makes the Preferred Thinking Direction for LLMs in Multiple-choice Questions?
por: Zhang, Yizhe, et al.
Publicado: (2025)

Continuously Augmented Discrete Diffusion model for Categorical Generative Modeling
por: Zheng, Huangjie, et al.
Publicado: (2025)

DISCOVER: Identifying Patterns of Daily Living in Human Activities from Smart Home Data
por: Karpekov, Alexander, et al.
Publicado: (2025)

Kaleido Diffusion: Improving Conditional Diffusion Models with Autoregressive Latent Modeling
por: Gu, Jiatao, et al.
Publicado: (2024)

On the Modeling Capabilities of Large Language Models for Sequential Decision Making
por: Klissarov, Martin, et al.
Publicado: (2024)

Probing the Multi-turn Planning Capabilities of LLMs via 20 Question Games
por: Zhang, Yizhe, et al.
Publicado: (2023)

Layout Agnostic Human Activity Recognition in Smart Homes through Textual Descriptions Of Sensor Triggers (TDOST)
por: Thukral, Megha, et al.
Publicado: (2024)

Improving GFlowNets for Text-to-Image Diffusion Alignment
por: Zhang, Dinghuai, et al.
Publicado: (2024)

DiffuCoder: Understanding and Improving Masked Diffusion Models for Code Generation
por: Gong, Shansan, et al.
Publicado: (2025)

GRACE: A Language Model Framework for Explainable Inverse Reinforcement Learning
por: Sapora, Silvia, et al.
Publicado: (2025)

Flexible Language Modeling in Continuous Space with Transformer-based Autoregressive Flows
por: Zhang, Ruixiang, et al.
Publicado: (2025)

Grounding Multimodal Large Language Models in Actions
por: Szot, Andrew, et al.
Publicado: (2024)