Cover Image

Beyond the Next Token: Towards Prompt-Robust Zero-Shot Classification via Efficient Multi-Token Prediction

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Qian, Junlang, Zhu, Zixiao, Zhou, Hanzhang, Feng, Zijian, Zhai, Zepeng, Mao, Kezhi
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Unveiling and Manipulating Prompt Influence in Large Language Models
by: Feng, Zijian, et al.
Published: (2024)

UniBias: Unveiling and Mitigating LLM Bias through Internal Attention and FFN Manipulation
by: Zhou, Hanzhang, et al.
Published: (2024)

Logit Separability-Driven Samples and Multiple Class-Related Words Selection for Advancing In-Context Learning
by: Zixiao, Zhu, et al.
Published: (2024)

LLMs Learn Task Heuristics from Demonstrations: A Heuristic-Driven Prompting Strategy for Document-Level Event Argument Extraction
by: Zhou, Hanzhang, et al.
Published: (2023)

FreeCtrl: Constructing Control Centers with Feedforward Layers for Learning-Free Controllable Text Generation
by: Feng, Zijian, et al.
Published: (2024)

Domain Lexical Knowledge-based Word Embedding Learning for Text Classification under Small Data
by: Zhu, Zixiao, et al.
Published: (2025)

Rethinking Prompt Optimizers: From Prompt Merits to Optimization
by: Zhu, Zixiao, et al.
Published: (2025)

Fine-Grained Activation Steering: Steering Less, Achieving More
by: Feng, Zijian, et al.
Published: (2026)

Restoring Pruned Large Language Models via Lost Component Compensation
by: Feng, Zijian, et al.
Published: (2025)

Rewards as Labels: Revisiting RLVR from a Classification Perspective
by: Zhai, Zepeng, et al.
Published: (2026)

Zero-Shot Video Translation via Token Warping
by: Zhu, Haiming, et al.
Published: (2024)

Just Pass Twice: Efficient Token Classification with LLMs for Zero-Shot NER
by: Ewais, Ahmed, et al.
Published: (2026)

From Token to Token Pair: Efficient Prompt Compression for Large Language Models in Clinical Prediction
by: Zhu, Mingcheng, et al.
Published: (2026)

Beyond Next-Token: Next-X Prediction for Autoregressive Visual Generation
by: Ren, Sucheng, et al.
Published: (2025)

Zero-Shot Tokenizer Transfer
by: Minixhofer, Benjamin, et al.
Published: (2024)

Zero-Shot Open-Vocabulary Human Motion Grounding with Test-Time Training
by: Zhou, Yunjiao, et al.
Published: (2025)

Beyond Next-Token Alignment: Distilling Multimodal Large Language Models via Token Interactions
by: Chen, Lin, et al.
Published: (2026)

GeoToken: Hierarchical Geolocalization of Images via Next Token Prediction
by: Ghasemi, Narges, et al.
Published: (2025)

Beyond Next Token Prediction: Patch-Level Training for Large Language Models
by: Shao, Chenze, et al.
Published: (2024)

Towards Understanding the Universality of Transformers for Next-Token Prediction
by: Sander, Michael E., et al.
Published: (2024)

Beyond Training: Dynamic Token Merging for Zero-Shot Video Understanding
by: Zhang, Yiming, et al.
Published: (2024)

TokenCLIP: Token-wise Prompt Learning for Zero-shot Anomaly Detection
by: Zhou, Qihang, et al.
Published: (2025)

Training LLMs Beyond Next Token Prediction -- Filling the Mutual Information Gap
by: Yang, Chun-Hao, et al.
Published: (2025)

Cautious Next Token Prediction
by: Wang, Yizhou, et al.
Published: (2025)

ZSPAPrune: Zero-Shot Prompt-Aware Token Pruning for Vision-Language Models
by: Zhang, Pu, et al.
Published: (2025)

Lossless Compression of Large Language Model-Generated Text via Next-Token Prediction
by: Mao, Yu, et al.
Published: (2025)

Compact Constraint Encoding for LLM Code Generation: An Empirical Study of Token Economics and Constraint Compliance
by: Tang, Hanzhang
Published: (2026)

Token-Efficient Multimodal Reasoning via Image Prompt Packaging
by: Choi, Joong Ho, et al.
Published: (2026)

In-Context Imitation Learning via Next-Token Prediction
by: Fu, Letian, et al.
Published: (2024)

Next-Token Prediction and Regret Minimization
by: Mohri, Mehryar, et al.
Published: (2026)

Humanoid Locomotion as Next Token Prediction
by: Radosavovic, Ilija, et al.
Published: (2024)

Object Recognition as Next Token Prediction
by: Yue, Kaiyu, et al.
Published: (2023)

Medical Referring Image Segmentation via Next-Token Mask Prediction
by: Chen, Xinyu, et al.
Published: (2025)

Toward Consistent World Models with Multi-Token Prediction and Latent Semantic Enhancement
by: Zhong, Qimin, et al.
Published: (2026)

Prot2Token: A Unified Framework for Protein Modeling via Next-Token Prediction
by: Pourmirzaei, Mahdi, et al.
Published: (2025)

TONIC: Token-Centric Semantic Communication for Task-Oriented Wireless Systems
by: Liu, Sige, et al.
Published: (2026)

Moving Beyond Next-Token Prediction: Transformers are Context-Sensitive Language Generators
by: Rhee, Phill Kyu
Published: (2025)

Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
by: Chen, Liang, et al.
Published: (2024)

Multi-scale Graph Autoregressive Modeling: Molecular Property Prediction via Next Token Prediction
by: Jiang, Zhuoyang, et al.
Published: (2026)

TokenCom: Vision-Language Model for Multimodal and Multitask Token Communications
by: Jiang, Feibo, et al.
Published: (2026)