Cover Image

Learning Variable-Length Tokenization for Generative Recommendation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Minhao, Wu, Bowen, Zhang, Wei
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Variable-Length Semantic IDs for Recommender Systems
by: Khrylchenko, Kirill
Published: (2026)

Improving Variable-Length Generation in Diffusion Language Models via Length Regularization
by: Cheng, Zicong, et al.
Published: (2026)

Enhancing Item Tokenization for Generative Recommendation through Self-Improvement
by: Chen, Runjin, et al.
Published: (2024)

Learning to Rank with Variable Result Presentation Lengths
by: Knyazev, Norman, et al.
Published: (2025)

MultiTok: Variable-Length Tokenization for Efficient LLMs Adapted from LZW Compression
by: Elias, Noel, et al.
Published: (2024)

Fed-CVLC: Compressing Federated Learning Communications with Variable-Length Codes
by: Su, Xiaoxin, et al.
Published: (2024)

TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection
by: Wu, Wei, et al.
Published: (2024)

Grounded Token Initialization for New Vocabulary in LMs for Generative Recommendation
by: Chen, Daiwei, et al.
Published: (2026)

PackMamba: Efficient Processing of Variable-Length Sequences in Mamba training
by: Xu, Haoran, et al.
Published: (2024)

ActionPiece: Contextually Tokenizing Action Sequences for Generative Recommendation
by: Hou, Yupeng, et al.
Published: (2025)

A Logical-Rule Autoencoder for Interpretable Recommendations
by: Pan, Jinhao, et al.
Published: (2026)

Multi-Token Residual Prediction
by: Xu, Yufeng, et al.
Published: (2026)

Length-MAX Tokenizer for Language Models
by: Dong, Dong, et al.
Published: (2025)

Adaptive Tokenization: On the Hop-Overpriority Problem in Tokenized Graph Learning Models
by: Wang, Zhibiao, et al.
Published: (2025)

Controlling Summarization Length Through EOS Token Weighting
by: Belligoli, Zeno, et al.
Published: (2025)

Structure over Pixels: Learning Variable-Length Visual Programs
by: Wyrwiński, Piotr, et al.
Published: (2026)

Scalable Token-Level Hallucination Detection in Large Language Models
by: Min, Rui, et al.
Published: (2026)

Sharpness-Aware Minimization for Generalized Embedding Learning in Federated Recommendation
by: Yu, Fengyuan, et al.
Published: (2026)

DelTA: Discriminative Token Credit Assignment for Reinforcement Learning from Verifiable Rewards
by: Zhang, Kaiyi, et al.
Published: (2026)

LLM Serving Optimization with Variable Prefill and Decode Lengths
by: Wang, Meixuan, et al.
Published: (2025)

Behavior Tokens Speak Louder: Disentangled Explainable Recommendation with Behavior Vocabulary
by: Feng, Xinshun, et al.
Published: (2025)

Length-Aware Adversarial Training for Variable-Length Trajectories: Digital Twins for Mall Shopper Paths
by: Sun, He, et al.
Published: (2026)

Adaptive Inverse Kinematics Framework for Learning Variable-Length Tool Manipulation in Robotics
by: Kothavale, Prathamesh, et al.
Published: (2025)

LANE: Logic Alignment of Non-tuning Large Language Models and Online Recommendation Systems for Explainable Reason Generation
by: Zhao, Hongke, et al.
Published: (2024)

Understanding and Improving Length Generalization in Hierarchical Sparse Attention Models
by: Leng, Jiaqi, et al.
Published: (2025)

LPDP: Inference-Time Reward Control for Variable-Length DNA Generation with Edit Flows
by: Kim, Jeongchan, et al.
Published: (2026)

Generalizing GNNs with Tokenized Mixture of Experts
by: Guo, Xiaoguang, et al.
Published: (2026)

Non-Asymptotic Length Generalization
by: Chen, Thomas, et al.
Published: (2025)

Looped Transformers for Length Generalization
by: Fan, Ying, et al.
Published: (2024)

Token-Controlled Re-ranking for Sequential Recommendation via LLMs
by: Dai, Wenxi, et al.
Published: (2025)

Addressing Correlated Latent Exogenous Variables in Debiased Recommender Systems
by: Zhang, Shuqiang, et al.
Published: (2025)

ReCast: Recasting Learning Signals for Reinforcement Learning in Generative Recommendation
by: Zhang, Peiyan, et al.
Published: (2026)

Global-Lens Transformers: Adaptive Token Mixing for Dynamic Link Prediction
by: Zou, Tao, et al.
Published: (2025)

U-CAN: Utility-Aware Contrastive Attenuation for Efficient Unlearning in Generative Recommendation
by: Wu, Zezheng, et al.
Published: (2026)

MoToRec: Sparse-Regularized Multimodal Tokenization for Cold-Start Recommendation
by: Liu, Jialin, et al.
Published: (2026)

Stochastic Sparse Sampling: A Framework for Variable-Length Medical Time Series Classification
by: Mootoo, Xavier, et al.
Published: (2024)

Minimum Description Length and Generalization Guarantees for Representation Learning
by: Sefidgaran, Milad, et al.
Published: (2024)

Time-Varying Home Field Advantage in Football: Learning from a Non-Stationary Causal Process
by: Qi, Minhao, et al.
Published: (2025)

Quantitative Bounds for Length Generalization in Transformers
by: Izzo, Zachary, et al.
Published: (2025)

Universal Length Generalization with Turing Programs
by: Hou, Kaiying, et al.
Published: (2024)