Cover Image

On Support Samples of Next Word Prediction

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Yuqian, Du, Yupei, Liu, Yufang, Feng, Feifei, Feng, Mou Xiao, Wu, Yuanbin
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

BOW: Reinforcement Learning for Bottlenecked Next Word Prediction
by: Shen, Ming, et al.
Published: (2025)

Can You Learn Semantics Through Next-Word Prediction? The Case of Entailment
by: Merrill, William, et al.
Published: (2024)

HieroLM: Egyptian Hieroglyph Recovery with Next Word Prediction Language Model
by: Cai, Xuheng, et al.
Published: (2025)

SWE2: SubWord Enriched and Significant Word Emphasized Framework for Hate Speech Detection
by: Mou, Guanyi, et al.
Published: (2024)

Deepfake Word Detection by Next-token Prediction using Fine-tuned Whisper
by: Tran, Hoan My, et al.
Published: (2026)

Predict the Next Word: Humans exhibit uncertainty in this task and language models _____
by: Ilia, Evgenia, et al.
Published: (2024)

Logit Separability-Driven Samples and Multiple Class-Related Words Selection for Advancing In-Context Learning
by: Zixiao, Zhu, et al.
Published: (2024)

AgentMove: A Large Language Model based Agentic Framework for Zero-shot Next Location Prediction
by: Feng, Jie, et al.
Published: (2024)

FTFT: Efficient and Robust Fine-Tuning by Transferring Training Dynamics
by: Du, Yupei, et al.
Published: (2023)

TASO: Task-Aligned Sparse Optimization for Parameter-Efficient Model Adaptation
by: Miao, Daiye, et al.
Published: (2025)

Incremental and Data-Efficient Concept Formation to Support Masked Word Prediction
by: Lian, Xin, et al.
Published: (2024)

ReverseMath: Answer Inversion for Scalable and Verifiable Mathematical Problem Generation
by: Zhao, Raoyuan, et al.
Published: (2026)

Next Word Suggestion using Graph Neural Network
by: Magar, Abisha Thapa, et al.
Published: (2025)

Resolving Word Vagueness with Scenario-guided Adapter for Natural Language Inference
by: Liu, Yonghao, et al.
Published: (2024)

Reinforced Fast Weights with Next-Sequence Prediction
by: Hwang, Hee Seung, et al.
Published: (2026)

LLMs as Science Journalists: Supporting Early-stage Researchers in Communicating Their Science to the Public
by: Alshomary, Milad, et al.
Published: (2026)

Fostering Video Reasoning via Next-Event Prediction
by: Wang, Haonan, et al.
Published: (2025)

Burn After Reading: Do Multimodal Large Language Models Truly Capture Order of Events in Image Sequences?
by: Song, Yingjin, et al.
Published: (2025)

NDP: Next Distribution Prediction as a More Broad Target
by: Ruan, Junhao, et al.
Published: (2024)

Language models can learn implicit multi-hop reasoning, but only if they have lots of training data
by: Yao, Yuekun, et al.
Published: (2025)

Beyond the Next Token: Towards Prompt-Robust Zero-Shot Classification via Efficient Multi-Token Prediction
by: Qian, Junlang, et al.
Published: (2025)

Generation with Dynamic Vocabulary
by: Liu, Yanting, et al.
Published: (2024)

LogitSpec: Accelerating Retrieval-based Speculative Decoding via Next Next Token Speculation
by: Liu, Tianyu, et al.
Published: (2025)

LLMs vs. Chinese Anime Enthusiasts: A Comparative Study on Emotionally Supportive Role-Playing
by: Qiu, Lanlan, et al.
Published: (2025)

Diversity or Precision? A Deep Dive into Next Token Prediction
by: Wu, Haoyuan, et al.
Published: (2025)

Mitigating Gender Bias in Contextual Word Embeddings
by: Yarrabelly, Navya, et al.
Published: (2024)

TopoAlign: A Framework for Aligning Code to Math via Topological Decomposition
by: Li, Yupei, et al.
Published: (2025)

Enhancing Metaphor Detection through Soft Labels and Target Word Prediction
by: Jia, Kaidi, et al.
Published: (2024)

DVAGen: Dynamic Vocabulary Augmented Generation
by: Du, Wei, et al.
Published: (2025)

Transforming Dutch: Debiasing Dutch Coreference Resolution Systems for Non-binary Pronouns
by: van Boven, Goya, et al.
Published: (2024)

From Graph to Word Bag: Introducing Domain Knowledge to Confusing Charge Prediction
by: Li, Ang, et al.
Published: (2024)

Beyond Agreement: Diagnosing the Rationale Alignment of Automated Essay Scoring Methods based on Linguistically-informed Counterfactuals
by: Wang, Yupei, et al.
Published: (2024)

Cross-Lingual Word Alignment for ASEAN Languages with Contrastive Learning
by: Zhang, Jingshen, et al.
Published: (2024)

Haste Makes Waste: Evaluating Planning Abilities of LLMs for Efficient and Feasible Multitasking with Time Constraints Between Actions
by: Wu, Zirui, et al.
Published: (2025)

Beyond Next Word Prediction: Developing Comprehensive Evaluation Frameworks for measuring LLM performance on real world applications
by: Agrawal, Vishakha, et al.
Published: (2025)

From Words to Worth: Newborn Article Impact Prediction with LLM
by: Zhao, Penghai, et al.
Published: (2024)

Training LLMs Beyond Next Token Prediction -- Filling the Mutual Information Gap
by: Yang, Chun-Hao, et al.
Published: (2025)

SUMFORU: An LLM-Based Review Summarization Framework for Personalized Purchase Decision Support
by: Feng, Yuming, et al.
Published: (2025)

TA&AT: Enhancing Task-Oriented Dialog with Turn-Level Auxiliary Tasks and Action-Tree Based Scheduled Sampling
by: Liu, Longxiang, et al.
Published: (2024)

Counterfactual Samples Constructing and Training for Commonsense Statements Estimation
by: Liu, Chong, et al.
Published: (2024)