Cover Image

Can LLMs Act as Historians? Evaluating Historical Research Capabilities of LLMs via the Chinese Imperial Examination

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gao, Lirong, Wang, Zeqing, Cai, Yuyan, Deng, Jiayi, Gu, Yanmei, Zhang, Yiming, Zhou, Jia, Zhang, Yanfei, Zhao, Junbo
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Can Compressed LLMs Truly Act? An Empirical Evaluation of Agentic Capabilities in LLM Compression
by: Dong, Peijie, et al.
Published: (2025)

DORY: Deliberative Prompt Recovery for LLM
by: Gao, Lirong, et al.
Published: (2024)

Can LLMs "Reason" in Music? An Evaluation of LLMs' Capability of Music Understanding and Generation
by: Zhou, Ziya, et al.
Published: (2024)

FLoE: Fisher-Based Layer Selection for Efficient Sparse Adaptation of Low-Rank Experts
by: Wang, Xinyi, et al.
Published: (2025)

Evaluating LLMs on Chinese Idiom Translation
by: Yang, Cai, et al.
Published: (2025)

Evaluating the Unseen Capabilities: How Many Theorems Do LLMs Know?
by: Li, Xiang, et al.
Published: (2025)

A Thorough Examination of Decoding Methods in the Era of LLMs
by: Shi, Chufan, et al.
Published: (2024)

ABench-Physics: Benchmarking Physical Reasoning in LLMs via High-Difficulty and Dynamic Physics Problems
by: Zhang, Yiming, et al.
Published: (2025)

Exploring the Capability Boundaries of LLMs in Mastering of Chinese Chouxiang Language
by: Lin, Dianqing, et al.
Published: (2026)

PRL-Bench: A Comprehensive Benchmark Evaluating LLMs' Capabilities in Frontier Physics Research
by: Miao, Tingjia, et al.
Published: (2026)

3D-PreMise: Can Large Language Models Generate 3D Shapes with Sharp Features and Parametric Control?
by: Yuan, Zeqing, et al.
Published: (2024)

When LLMs Can't Help: Real-World Evaluation of LLMs in Nutrition
by: Li, Karen Jia-Hui, et al.
Published: (2025)

How Well Can Modern LLMs Act as Agent Cores in Radiology Environments?
by: Zheng, Qiaoyu, et al.
Published: (2024)

Collaborative QA using Interacting LLMs. Impact of Network Structure, Node Capability and Distributed Data
by: Jain, Adit, et al.
Published: (2025)

Are Your LLMs Capable of Stable Reasoning?
by: Liu, Junnan, et al.
Published: (2024)

LLMs Can Covertly Sandbag on Capability Evaluations Against Chain-of-Thought Monitoring
by: Li, Chloe, et al.
Published: (2025)

Can LLMs Classify CVEs? Investigating LLMs Capabilities in Computing CVSS Vectors
by: Marchiori, Francesco, et al.
Published: (2025)

Enough Coin Flips Can Make LLMs Act Bayesian
by: Gupta, Ritwik, et al.
Published: (2025)

Towards Automatic Evaluation for LLMs' Clinical Capabilities: Metric, Data, and Algorithm
by: Liu, Lei, et al.
Published: (2024)

OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safety
by: Liu, Chuang, et al.
Published: (2024)

Evaluating Developmental Cognition Capabilities of LLMs
by: Xiao, Xiao, et al.
Published: (2026)

Olapa-MCoT: Enhancing the Chinese Mathematical Reasoning Capability of LLMs
by: Zhu, Shaojie, et al.
Published: (2023)

PLANET: A Collection of Benchmarks for Evaluating LLMs' Planning Capabilities
by: Li, Haoming, et al.
Published: (2025)

Can LLMs be Fooled? Investigating Vulnerabilities in LLMs
by: Abdali, Sara, et al.
Published: (2024)

Satisfiability Solving with LLMs: A Matched-Pair Evaluation of Reasoning Capability
by: Zhang, Leizhen, et al.
Published: (2026)

Typestate via Revocable Capabilities
by: Jia, Songlin, et al.
Published: (2025)

An Empirical Study on the Capability of LLMs in Decomposing Bug Reports
by: Chen, Zhiyuan, et al.
Published: (2025)

Can LLMs Correct Themselves? A Benchmark of Self-Correction in LLMs
by: Tie, Guiyao, et al.
Published: (2025)

Jailbreaking LLMs & VLMs: Mechanisms, Evaluation, and Unified Defense
by: Chen, Zejian, et al.
Published: (2026)

Are LLMs Effective Negotiators? Systematic Evaluation of the Multifaceted Capabilities of LLMs in Negotiation Dialogues
by: Kwon, Deuksin, et al.
Published: (2024)

Can Editing LLMs Inject Harm?
by: Chen, Canyu, et al.
Published: (2024)

Can Prompts Rewind Time for LLMs? Evaluating the Effectiveness of Prompted Knowledge Cutoffs
by: Gao, Xin, et al.
Published: (2025)

CoBA-RL: Capability-Oriented Budget Allocation for Reinforcement Learning in LLMs
by: Yao, Zhiyuan, et al.
Published: (2026)

SCAN: Structured Capability Assessment and Navigation for LLMs
by: Wang, Zongqi, et al.
Published: (2025)

Learners as Historians: Making History Come Alive through Historical Inquiry
by: Pappas, Marjorie L.
Published: (2007)

Can Agents Price a Reaction? Evaluating LLMs on Chemical Cost Reasoning
by: Wu, Yuyang, et al.
Published: (2026)

LLMAID: Identifying AI Capabilities in Android Apps with LLMs
by: Liu, Pei, et al.
Published: (2025)

Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs
by: Son, Guijin, et al.
Published: (2026)

ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstruction
by: Guo, Zichun, et al.
Published: (2026)

MME-VideoOCR: Evaluating OCR-Based Capabilities of Multimodal LLMs in Video Scenarios
by: Shi, Yang, et al.
Published: (2025)