Cover Image

Smoothie: Smoothing Diffusion on Token Embeddings for Text Generation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shabalin, Alexander, Meshchaninov, Viacheslav, Vetrov, Dmitry
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Cosmos: Compressed and Smooth Latent Space for Text Diffusion Modeling
by: Meshchaninov, Viacheslav, et al.
Published: (2025)

Why Gaussian Diffusion Models Fail on Discrete Data and How to Prevent It?
by: Shabalin, Alexander, et al.
Published: (2026)

How to Train Your Latent Diffusion Language Model Jointly With the Latent Space
by: Meshchaninov, Viacheslav, et al.
Published: (2026)

TEncDM: Understanding the Properties of the Diffusion Model in the Space of Language Model Encodings
by: Shabalin, Alexander, et al.
Published: (2024)

Smoothie-Qwen: Post-Hoc Smoothing to Reduce Language Bias in Multilingual LLMs
by: Ji, SeungWon, et al.
Published: (2025)

Diffusion on language model encodings for protein sequence generation
by: Meshchaninov, Viacheslav, et al.
Published: (2024)

Guided Star-Shaped Masked Diffusion
by: Meshchaninov, Viacheslav, et al.
Published: (2025)

Streaming Generation of Co-Speech Gestures via Accelerated Rolling Diffusion
by: Vu, Evgeniia, et al.
Published: (2025)

A Text is Worth Several Tokens: Text Embedding from LLMs Secretly Aligns Well with The Key Tokens
by: Nie, Zhijie, et al.
Published: (2024)

Sticking to the Mean: Detecting Sticky Tokens in Text Embedding Models
by: Chen, Kexin, et al.
Published: (2025)

Empowering Diffusion Models on the Embedding Space for Text Generation
by: Gao, Zhujin, et al.
Published: (2022)

Text-Based Detection of On-Hold Scripts in Contact Center Calls
by: Galimzianov, Dmitrii, et al.
Published: (2024)

Evaluating the Smooth Control of Attribute Intensity in Text Generation with LLMs
by: Zhou, Shang, et al.
Published: (2024)

Ruri: Japanese General Text Embeddings
by: Tsukagoshi, Hayato, et al.
Published: (2024)

Semantic Token Reweighting for Interpretable and Controllable Text Embeddings in CLIP
by: Kim, Eunji, et al.
Published: (2024)

SwiftEmbed: Ultra-Fast Text Embeddings via Static Token Lookup for Real-Time Applications
by: Lansiaux, Edouard, et al.
Published: (2025)

Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documents
by: Günther, Michael, et al.
Published: (2023)

RusCode: Russian Cultural Code Benchmark for Text-to-Image Generation
by: Vasilev, Viacheslav, et al.
Published: (2025)

Diffusion vs. Autoregressive Language Models: A Text Embedding Perspective
by: Zhang, Siyue, et al.
Published: (2025)

Token Prediction as Implicit Classification to Identify LLM-Generated Text
by: Chen, Yutian, et al.
Published: (2023)

Text Generation Beyond Discrete Token Sampling
by: Zhuang, Yufan, et al.
Published: (2025)

A Character-based Diffusion Embedding Algorithm for Enhancing the Generation Quality of Generative Linguistic Steganographic Texts
by: Chen, Yingquan, et al.
Published: (2025)

TASTE-Streaming: Towards Streamable Text-Aligned Speech Tokenization and Embedding for Spoken Language Modeling
by: Tseng, Liang-Hsuan, et al.
Published: (2026)

TASTE: Text-Aligned Speech Tokenization and Embedding for Spoken Language Modeling
by: Tseng, Liang-Hsuan, et al.
Published: (2025)

WavLink: Compact Audio-Text Embeddings with a Global Whisper Token
by: Kumar, Gokul Karthik, et al.
Published: (2026)

Negative Matters: Multi-Granularity Hard-Negative Synthesis and Anchor-Token-Aware Pooling for Enhanced Text Embeddings
by: Pan, Tengyu, et al.
Published: (2025)

Text-only domain adaptation for end-to-end ASR using integrated text-to-mel-spectrogram generator
by: Bataev, Vladimir, et al.
Published: (2023)

Zero-Shot Detection of LLM-Generated Text using Token Cohesiveness
by: Ma, Shixuan, et al.
Published: (2024)

Explainability-Based Token Replacement on LLM-Generated Text
by: Mohammadi, Hadi, et al.
Published: (2025)

Adversarial Attacks on AI-Generated Text Detection Models: A Token Probability-Based Approach Using Embeddings
by: Kadhim, Ahmed K., et al.
Published: (2025)

Subword Tokenization Strategies for Kurdish Word Embeddings
by: Salehi, Ali, et al.
Published: (2025)

Multi-Level Contextual Token Relation Modeling for Machine-Generated Text Detection
by: Wu, Chenwang, et al.
Published: (2026)

Token Distillation: Attention-aware Input Embeddings For New Tokens
by: Dobler, Konstantin, et al.
Published: (2025)

Thunder-Tok: Minimizing Tokens per Word in Tokenizing Korean Texts for Generative Language Models
by: Cho, Gyeongje, et al.
Published: (2025)

Text2Token: Unsupervised Text Representation Learning with Token Target Prediction
by: An, Ruize, et al.
Published: (2025)

Unsupervised Text Embedding Space Generation Using Generative Adversarial Networks for Text Synthesis
by: Lee, Jun-Min, et al.
Published: (2023)

Table-to-Text Generation with Pretrained Diffusion Models
by: Krylov, Aleksei S., et al.
Published: (2024)

Private Synthetic Text Generation with Diffusion Models
by: Ochs, Sebastian, et al.
Published: (2024)

Alternatives To Next Token Prediction In Text Generation -- A Survey
by: Wyatt, Charlie, et al.
Published: (2025)

Reinforcement Learning with Token-level Feedback for Controllable Text Generation
by: Li, Wendi, et al.
Published: (2024)