Cover Image

Predict the Next Word: Humans exhibit uncertainty in this task and language models _____

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ilia, Evgenia, Aziz, Wilker
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Variability Need Not Imply Error: The Case of Adequate but Semantically Distinct Responses
by: Ilia, Evgenia, et al.
Published: (2024)

Just-in-time and distributed task representations in language models
by: Li, Yuxuan, et al.
Published: (2025)

Clarify, Abstain or Answer? Strategising in Conversation with Belief-Augmented Generation
by: Baan, Joris, et al.
Published: (2026)

Auxiliary task demands mask the capabilities of smaller language models
by: Hu, Jennifer, et al.
Published: (2024)

Code-enabled language models can outperform reasoning models on diverse tasks
by: Zhang, Cedegao E., et al.
Published: (2025)

Superhuman performance of a large language model on the reasoning tasks of a physician
by: Brodeur, Peter G., et al.
Published: (2024)

Evidence from counterfactual tasks supports emergent analogical reasoning in large language models
by: Webb, Taylor, et al.
Published: (2024)

The "LLM World of Words" English free association norms generated by large language models
by: Abramski, Katherine, et al.
Published: (2024)

Are language models aware of the road not taken? Token-level uncertainty and hidden state dynamics
by: Zur, Amir, et al.
Published: (2025)

Humans overrely on overconfident language models, across languages
by: Rathi, Neil, et al.
Published: (2025)

TechGPT-2.0: A large language model project to solve the task of knowledge graph construction
by: Wang, Jiaqi, et al.
Published: (2024)

Testing AI on language comprehension tasks reveals insensitivity to underlying meaning
by: Dentella, Vittoria, et al.
Published: (2023)

Impact of enriched meaning representations for language generation in dialogue tasks: A comprehensive exploration of the relevance of tasks, corpora and metrics
by: Vázquez, Alain, et al.
Published: (2026)

A Human Word Association based model for topic detection in social networks
by: Khadivi, Mehrdad Ranjbar, et al.
Published: (2023)

Efficient semantic uncertainty quantification in language models via diversity-steered sampling
by: Park, Ji Won, et al.
Published: (2025)

Teaching Language Models to Faithfully Express their Uncertainty
by: Eikema, Bryan, et al.
Published: (2025)

Aviary: training language agents on challenging scientific tasks
by: Narayanan, Siddharth, et al.
Published: (2024)

Leveraging small language models for Text2SPARQL tasks to improve the resilience of AI assistance
by: Brei, Felix, et al.
Published: (2024)

Beyond Next Word Prediction: Developing Comprehensive Evaluation Frameworks for measuring LLM performance on real world applications
by: Agrawal, Vishakha, et al.
Published: (2025)

CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning tasks
by: Yu, Ping, et al.
Published: (2025)

Dissociating language and thought in large language models
by: Mahowald, Kyle, et al.
Published: (2023)

Using Perspectival Words Is Harder Than Vocabulary Words for Humans and Even More So for Multimodal Language Models
by: Dong, Dota Tianai, et al.
Published: (2025)

Position Paper On Diagnostic Uncertainty Estimation from Large Language Models: Next-Word Probability Is Not Pre-test Probability
by: Gao, Yanjun, et al.
Published: (2024)

Interpreting Predictive Probabilities: Model Confidence or Human Label Variation?
by: Baan, Joris, et al.
Published: (2024)

N-gram Prediction and Word Difference Representations for Language Modeling
by: Heo, DongNyeong, et al.
Published: (2024)

Fluent dreaming for language models
by: Thompson, T. Ben, et al.
Published: (2024)

Algorithmic progress in language models
by: Ho, Anson, et al.
Published: (2024)

Incremental and Data-Efficient Concept Formation to Support Masked Word Prediction
by: Lian, Xin, et al.
Published: (2024)

Psycholinguistic Word Features: a New Approach for the Evaluation of LLMs Alignment with Humans
by: Conde, Javier, et al.
Published: (2025)

Does quantization affect models' performance on long-context tasks?
by: Mekala, Anmol, et al.
Published: (2025)

Fractal Patterns May Illuminate the Success of Next-Token Prediction
by: Alabdulmohsin, Ibrahim, et al.
Published: (2024)

NDP: Next Distribution Prediction as a More Broad Target
by: Ruan, Junhao, et al.
Published: (2024)

Alternatives To Next Token Prediction In Text Generation -- A Survey
by: Wyatt, Charlie, et al.
Published: (2025)

On the attribution of confidence to large language models
by: Keeling, Geoff, et al.
Published: (2024)

Large language models and linguistic intentionality
by: Grindrod, Jumbly
Published: (2024)

chDzDT: Word-level morphology-aware language model for Algerian social media text
by: Aries, Abdelkrime
Published: (2025)

A survey of textual cyber abuse detection using cutting-edge language models and large language models
by: Diaz-Garcia, Jose A., et al.
Published: (2025)

Do language models practice what they preach? Examining language ideologies about gendered language reform encoded in LLMs
by: Watson, Julia, et al.
Published: (2024)

Cautious Next Token Prediction
by: Wang, Yizhou, et al.
Published: (2025)

From Graph to Word Bag: Introducing Domain Knowledge to Confusing Charge Prediction
by: Li, Ang, et al.
Published: (2024)