Cover Image

Beyond Questions: Evaluating What Large Language Models (Actually) Know

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Giordano, Luca, Razniewski, Simon
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Foundations of LLM Knowledge Materialization: Termination, Reproducibility, Robustness
by: Giordano, Luca, et al.
Published: (2025)

Mining the Mind: What 100M Beliefs Reveal About Frontier LLM Knowledge
by: Ghosh, Shrestha, et al.
Published: (2025)

Do Large Language Models Know What They Are Capable Of?
by: Barkan, Casey O., et al.
Published: (2025)

KnowRL: Teaching Language Models to Know What They Know
by: Kale, Sahil, et al.
Published: (2025)

What Large Language Models Know and What People Think They Know
by: Steyvers, Mark, et al.
Published: (2024)

Large Language Models Must Be Taught to Know What They Don't Know
by: Kapoor, Sanyam, et al.
Published: (2024)

What is a Number, That a Large Language Model May Know It?
by: Marjieh, Raja, et al.
Published: (2025)

Large Language Models Often Know When They Are Being Evaluated
by: Needham, Joe, et al.
Published: (2025)

Truth Knows No Language: Evaluating Truthfulness Beyond English
by: Figueras, Blanca Calvo, et al.
Published: (2025)

Decomposing the Delta: What Do Models Actually Learn from Preference Pairs?
by: Lee, Chia-Hsuan, et al.
Published: (2026)

Pap2Pat: Benchmarking Outline-Guided Long-Text Patent Generation with Patent-Paper Pairs
by: Knappich, Valentin, et al.
Published: (2024)

NLP Methods May Actually Be Better Than Professors at Estimating Question Difficulty
by: Zotos, Leonidas, et al.
Published: (2025)

Fine-Tuning Language Models to Know What They Know
by: Park, Sangjun, et al.
Published: (2026)

An Empirical Evaluation of Large Language Models on Consumer Health Questions
by: Abrar, Moaiz, et al.
Published: (2024)

NanoKnow: How to Know What Your Language Model Knows
by: Gu, Lingwei, et al.
Published: (2026)

Enabling LLM Knowledge Analysis via Extensive Materialization
by: Hu, Yujia, et al.
Published: (2024)

Evaluation Methodology for Large Language Models for Multilingual Document Question and Answer
by: Kahana, Adar, et al.
Published: (2024)

Is It Novel and Why? Fine-Grained Patent Novelty Prediction Based on Passage Retrieval
by: Knappich, Valentin, et al.
Published: (2026)

Do Large Language Models Know How Much They Know?
by: Prato, Gabriele, et al.
Published: (2025)

Can AI Assistants Know What They Don't Know?
by: Cheng, Qinyuan, et al.
Published: (2024)

A Solver-in-the-Loop Framework for Improving LLMs on Answer Set Programming for Logic Puzzle Solving
by: Schrader, Timo Pierre, et al.
Published: (2025)

Know More, Know Clearer: A Meta-Cognitive Framework for Knowledge Augmentation in Large Language Models
by: Chen, Hao, et al.
Published: (2026)

Beyond Facts: Evaluating Intent Hallucination in Large Language Models
by: Hao, Yijie, et al.
Published: (2025)

Evaluating the Meta- and Object-Level Reasoning of Large Language Models for Question Answering
by: Ferguson, Nick, et al.
Published: (2025)

Can Language Models Analyze Data? Evaluating Large Language Models for Question Answering over Datasets
by: Xenofontos, Andreas, et al.
Published: (2026)

What Models Know, How Well They Know It: Knowledge-Weighted Fine-Tuning for Learning When to Say "I Don't Know"
by: Lee, Joosung, et al.
Published: (2026)

KnowGPT: Knowledge Graph based Prompting for Large Language Models
by: Zhang, Qinggang, et al.
Published: (2023)

KnowTuning: Knowledge-aware Fine-tuning for Large Language Models
by: Lyu, Yougang, et al.
Published: (2024)

What is the best model? Application-driven Evaluation for Large Language Models
by: Lian, Shiguo, et al.
Published: (2024)

Beyond Keywords: Evaluating Large Language Model Classification of Nuanced Ableism
by: Rizvi, Naba, et al.
Published: (2025)

What Do Large Language Models Know? Tacit Knowledge as a Potential Causal-Explanatory Structure
by: Budding, Céline
Published: (2025)

Ask Good Questions for Large Language Models
by: Wu, Qi, et al.
Published: (2025)

Do Retrieval Augmented Language Models Know When They Don't Know?
by: Zhou, Youchao, et al.
Published: (2025)

Cultural Bias in Large Language Models: Evaluating AI Agents through Moral Questionnaires
by: Münker, Simon
Published: (2025)

Evaluating Monolingual and Multilingual Large Language Models for Greek Question Answering: The DemosQA Benchmark
by: Mastrokostas, Charalampos, et al.
Published: (2026)

THELMA: Task Based Holistic Evaluation of Large Language Model Applications-RAG Question Answering
by: Patel, Udita, et al.
Published: (2025)

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering
by: Arias-Duart, Anna, et al.
Published: (2025)

Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Survey
by: Mondorf, Philipp, et al.
Published: (2024)

Beyond Instruction Following: Evaluating Inferential Rule Following of Large Language Models
by: Sun, Wangtao, et al.
Published: (2024)

Short-Context Dominance: How Much Local Context Natural Language Actually Needs?
by: Vakilian, Vala, et al.
Published: (2025)