Cover Image

On the Reasoning Capacity of AI Models and How to Quantify It

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Radha, Santosh Kumar, Goktas, Oktay
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence Computation and Language Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Composite Learning Units: Generalized Learning Beyond Parameter Updates to Transform LLMs into Adaptive Reasoners
by: Radha, Santosh Kumar, et al.
Published: (2024)

Adaptive Graph of Thoughts: Test-Time Adaptive Reasoning Unifying Chain, Tree, and Graph Structures
by: Pandey, Tushar, et al.
Published: (2025)

Improving BM25 Code Retrieval Under Fixed Generic Tokenization: Adaptive q-Log Odds as a Drop-In BM25 Fix
by: Radha, Santosh Kumar, et al.
Published: (2026)

Iteration of Thought: Leveraging Inner Dialogue for Autonomous Large Language Model Reasoning
by: Radha, Santosh Kumar, et al.
Published: (2024)

UWM-JEPA: Predictive World Models That Imagine in Belief Space
by: Radha, Santosh Kumar, et al.
Published: (2026)

Think or Not? Exploring Thinking Efficiency in Large Reasoning Models via an Information-Theoretic Lens
by: Yong, Xixian, et al.
Published: (2025)

From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaning
by: Shani, Chen, et al.
Published: (2025)

Robust AI-Generated Text Detection by Restricted Embeddings
by: Kuznetsov, Kristian, et al.
Published: (2024)

Task-Centric Acceleration of Small-Language Models
by: Tsur, Dor, et al.
Published: (2026)

Large Language Models as Evaluators for Scientific Synthesis
by: Evans, Julia, et al.
Published: (2024)

Conversational Complexity for Assessing Risk in Large Language Models
by: Burden, John, et al.
Published: (2024)

Evaluating Large Language Models for Structured Science Summarization in the Open Research Knowledge Graph
by: Nechakhin, Vladyslav, et al.
Published: (2024)

Slaves to the Law of Large Numbers: An Asymptotic Equipartition Property for Perplexity in Generative Language Models
by: Bell, Tyler, et al.
Published: (2024)

Domain-Partitioned Hybrid RAG for Legal Reasoning: Toward Modular and Explainable Legal AI for India
by: Goel, Rakshita, et al.
Published: (2025)

The Stepwise Informativeness Assumption: Why are Entropy Dynamics and Reasoning Correlated in LLMs?
by: Català, Mar Gonzàlez I, et al.
Published: (2026)

Quantifying Positional Biases in Text Embedding Models
by: Lee, Reagan J., et al.
Published: (2024)

How Many Features Can a Language Model Store Under the Linear Representation Hypothesis?
by: Garg, Nikhil, et al.
Published: (2026)

On the Capacity of Citation Generation by Large Language Models
by: Qian, Haosheng, et al.
Published: (2024)

Test-Time Steering for Lossless Text Compression via Weighted Product of Experts
by: Zhang, Qihang, et al.
Published: (2025)

On Theoretical Interpretations of Concept-Based In-Context Learning
by: Tang, Huaze, et al.
Published: (2025)

Measuring Information Distortion in Hierarchical Ultra long Novel Reconstruction:The Optimal Expansion Ratio
by: Shen, Hanwen, et al.
Published: (2025)

Graph-Enhanced Retrieval-Augmented Question Answering for E-Commerce Customer Support
by: Patel, Piyushkumar
Published: (2025)

Complexity Agnostic Recursive Decomposition of Thoughts
by: Qasim, Kaleem Ullah, et al.
Published: (2025)

Surprisal and Metaphor Novelty Judgments: Moderate Correlations and Divergent Scaling Effects Revealed by Corpus-Based and Synthetic Datasets
by: Momen, Omar, et al.
Published: (2026)

Astro-NER -- Astronomy Named Entity Recognition: Is GPT a Good Domain Expert Annotator?
by: Evans, Julia, et al.
Published: (2024)

An Information-Theoretic Approach to Analyze NLP Classification Tasks
by: Wang, Luran, et al.
Published: (2024)

LogitScope: A Framework for Analyzing LLM Uncertainty Through Information Metrics
by: Ahmed, Farhan, et al.
Published: (2026)

Seq2Seq2Seq: Lossless Data Compression via Discrete Latent Transformers and Reinforcement Learning
by: Khodabandeh, Mahdi, et al.
Published: (2026)

Riddle Quest : The Enigma of Words
by: Parasa, Niharika Sri, et al.
Published: (2026)

Generalized Measures of Anticipation and Responsivity in Online Language Processing
by: Giulianelli, Mario, et al.
Published: (2024)

A quantum semantic framework for natural language processing
by: Agostino, Christopher J., et al.
Published: (2025)

SearchRAG: Can Search Engines Be Helpful for LLM-based Medical Question Answering?
by: Shi, Yucheng, et al.
Published: (2025)

Mitigating Hallucination with ZeroG: An Advanced Knowledge Management Engine
by: Sharma, Anantha, et al.
Published: (2024)

Improving Robustness of Tabular Retrieval via Representational Stability
by: Bhandari, Kushal Raj, et al.
Published: (2026)

Language Modeling Is Compression
by: Delétang, Grégoire, et al.
Published: (2023)

The Information of Large Language Model Geometry
by: Tan, Zhiquan, et al.
Published: (2024)

Know Your Limits: Entropy Estimation Modeling for Compression and Generalization
by: Badger, Benjamin L., et al.
Published: (2025)

A Survey on Large Language Models from Concept to Implementation
by: Wang, Chen, et al.
Published: (2024)

Geometric Signatures of Compositionality Across a Language Model's Lifetime
by: Lee, Jin Hwa, et al.
Published: (2024)

Large Language Models for Scientific Information Extraction: An Empirical Study for Virology
by: Shamsabadi, Mahsa, et al.
Published: (2024)