Cover Image

TextBandit: Evaluating Probabilistic Reasoning in LLMs Through Language-Only Decision Tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lim, Jimin, Damerla, Arjun, Jiang, Arthur, Le, Nam
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Zero-Shot Embedding Drift Detection: A Lightweight Defense Against Prompt Injections in LLMs
by: Sekar, Anirudh, et al.
Published: (2026)

Evaluating Computational Accuracy of Large Language Models in Numerical Reasoning Tasks for Healthcare Applications
by: Malghan, Arjun R.
Published: (2025)

Hearing Between the Lines: Unlocking the Reasoning Power of LLMs for Speech Evaluation
by: Chandra, Arjun, et al.
Published: (2026)

Flex-Judge: Text-Only Reasoning Unleashes Zero-Shot Multimodal Evaluators
by: Ko, Jongwoo, et al.
Published: (2025)

Evaluating Small Decoder-Only Language Models for Grammar Correction and Text Simplification
by: Lamelas, Anthony
Published: (2026)

Reasoning Under Uncertainty: Exploring Probabilistic Reasoning Capabilities of LLMs
by: Pournemat, Mobina, et al.
Published: (2025)

TRN-R1-Zero: Text-rich Network Reasoning via LLMs with Reinforcement Learning Only
by: Liu, Yilun, et al.
Published: (2026)

Grounding Spatial Relations in Text-Only Language Models
by: Azkune, Gorka, et al.
Published: (2024)

Autonomous Evaluation of LLMs for Truth Maintenance and Reasoning Tasks
by: Karia, Rushang, et al.
Published: (2024)

Decision-Oriented Text Evaluation
by: Huang, Yu-Shiang, et al.
Published: (2025)

Unveiling Decision-Making in LLMs for Text Classification : Extraction of influential and interpretable concepts with Sparse Autoencoders
by: Bail, Mathis Le, et al.
Published: (2025)

Doing Experiments and Revising Rules with Natural Language and Probabilistic Reasoning
by: Piriyakulkij, Wasu Top, et al.
Published: (2024)

Probabilistic Reasoning with LLMs for k-anonymity Estimation
by: Zheng, Jonathan, et al.
Published: (2025)

Say Anything but This: When Tokenizer Betrays Reasoning in LLMs
by: Ayoobi, Navid, et al.
Published: (2026)

Evaluating the Evaluator: Measuring LLMs' Adherence to Task Evaluation Instructions
by: Murugadoss, Bhuvanashree, et al.
Published: (2024)

Teaching and Evaluating LLMs to Reason About Polymer Design Related Tasks
by: Mohanty, Dikshya, et al.
Published: (2026)

Text2VLM: Adapting Text-Only Datasets to Evaluate Alignment Training in Visual Language Models
by: Downer, Gabriel, et al.
Published: (2025)

In-Domain African Languages Translation Using LLMs and Multi-armed Bandits
by: Singh, Pratik Rakesh, et al.
Published: (2025)

A Multi-Task Evaluation of LLMs' Processing of Academic Text Input
by: Li, Tianyi, et al.
Published: (2025)

XCR-Bench: A Multi-Task Benchmark for Evaluating Cultural Reasoning in LLMs
by: Kabir, Mohsinul, et al.
Published: (2026)

From Benchmarking to Reasoning: A Dual-Aspect, Large-Scale Evaluation of LLMs on Vietnamese Legal Text
by: Le, Van-Truong
Published: (2026)

What Are the Odds? Language Models Are Capable of Probabilistic Reasoning
by: Paruchuri, Akshay, et al.
Published: (2024)

MMAFFBen: A Multilingual and Multimodal Affective Analysis Benchmark for Evaluating LLMs and VLMs
by: Liu, Zhiwei, et al.
Published: (2025)

Slot Filling as a Reasoning Task for SpeechLLMs
by: Hacioglu, Kadri, et al.
Published: (2025)

Unveiling Over-Memorization in Finetuning LLMs for Reasoning Tasks
by: Ruan, Zhiwen, et al.
Published: (2025)

MzansiText and MzansiLM: An Open Corpus and Decoder-Only Language Model for South African Languages
by: Lombard, Anri, et al.
Published: (2026)

A Comprehensive Study of Decoder-Only LLMs for Text-to-Image Generation
by: Wang, Andrew Z., et al.
Published: (2025)

Language-Aware Distillation for Multilingual Instruction-Following Speech LLMs with ASR-Only Supervision
by: Gopal, Shreyas, et al.
Published: (2026)

Reliable Decision Support with LLMs: A Framework for Evaluating Consistency in Binary Text Classification Applications
by: Megahed, Fadel M., et al.
Published: (2025)

Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks
by: Wu, Zhaofeng, et al.
Published: (2023)

Implicit Values Embedded in How Humans and LLMs Complete Subjective Everyday Tasks
by: Arunasalam, Arjun, et al.
Published: (2025)

Text2Cypher Across Languages: Evaluating and Finetuning LLMs
by: Ozsoy, Makbule Gulcin, et al.
Published: (2025)

Fino1: On the Transferability of Reasoning-Enhanced LLMs and Reinforcement Learning to Finance
by: Qian, Lingfei, et al.
Published: (2025)

Uncovering Gaps in How Humans and LLMs Interpret Subjective Language
by: Jones, Erik, et al.
Published: (2025)

Multi-Task Learning for Front-End Text Processing in TTS
by: Kang, Wonjune, et al.
Published: (2024)

Scaling Competence, Shrinking Reasoning: Cognitive Signatures in Language Model Learning
by: Singh, Mukul, et al.
Published: (2025)

Can Structural Cues Save LLMs? Evaluating Language Models in Massive Document Streams
by: Lee, Yukyung, et al.
Published: (2026)

Think Only When You Need with Large Hybrid-Reasoning Models
by: Jiang, Lingjie, et al.
Published: (2025)

Low-Resource Domain Adaptation for Speech LLMs via Text-Only Fine-Tuning
by: Fang, Yangui, et al.
Published: (2025)

Evaluation of Deontic Conditional Reasoning in Large Language Models: The Case of Wason's Selection Task
by: Abe, Hirohiko, et al.
Published: (2026)