Imagen de Portada

Do LLMs and Humans Find the Same Questions Difficult? A Case Study on Japanese Quiz Answering

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Sugiura, Naoya, Yamada, Kosuke, Ogawa, Yasuhiro, Toyama, Katsuhiko, Sasano, Ryohei
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Ruri: Japanese General Text Embeddings
por: Tsukagoshi, Hayato, et al.
Publicado: (2024)

To Drop or Not to Drop? Predicting Argument Ellipsis Judgments: A Case Study in Japanese
por: Ishizuki, Yukiko, et al.
Publicado: (2024)

How Do Language Models Acquire Character-Level Information?
por: Sato, Soma, et al.
Publicado: (2026)

FrameEOL: Semantic Frame Induction using Causal Language Models
por: Yano, Chihiro, et al.
Publicado: (2025)

Are Social Sentiments Inherent in LLMs? An Empirical Study on Extraction of Inter-demographic Sentiments
por: Tanaka, Kunitomo, et al.
Publicado: (2024)

Do LLMs Find Human Answers To Fact-Driven Questions Perplexing? A Case Study on Reddit
por: Seegmiller, Parker, et al.
Publicado: (2024)

Redundancy, Isotropy, and Intrinsic Dimensionality of Prompt-based Text Embeddings
por: Tsukagoshi, Hayato, et al.
Publicado: (2025)

Can We Still Hear the Accent? Investigating the Resilience of Native Language Signals in the LLM Era
por: Utami, Nabelanita, et al.
Publicado: (2026)

Do LLMs Understand Ambiguity in Text? A Case Study in Open-world Question Answering
por: Keluskar, Aryan, et al.
Publicado: (2024)

Difficult for Whom? A Study of Japanese Lexical Complexity
por: Nohejl, Adam, et al.
Publicado: (2024)

On Representational Dissociation of Language and Arithmetic in Large Language Models
por: Kisako, Riku, et al.
Publicado: (2025)

CiMaTe: Citation Count Prediction Effectively Leveraging the Main Text
por: Hirako, Jun, et al.
Publicado: (2024)

When Is 0.1% Enough? Analyzing the Combined Effects of Dimensionality Reduction and Quantization on Text Embedding Compression
por: Kisako, Riku, et al.
Publicado: (2026)

Verifying Claims About Metaphors with Large-Scale Automatic Metaphor Identification
por: Aono, Kotaro, et al.
Publicado: (2024)

Simplifying Translations for Children: Iterative Simplification Considering Age of Acquisition with LLMs
por: Oshika, Masashi, et al.
Publicado: (2024)

Enhancing Large Vision-Language Models with Layout Modality for Table Question Answering on Japanese Annual Securities Reports
por: Aida, Hayato, et al.
Publicado: (2025)

DiscoTrace: Representing and Comparing Answering Strategies of Humans and LLMs in Information-Seeking Question Answering
por: Srikanth, Neha, et al.
Publicado: (2026)

Sentence Representations via Gaussian Embedding
por: Yoda, Shohei, et al.
Publicado: (2023)

Do LLMs Understand Romanian Driving Laws? A Study on Multimodal and Fine-Tuned Question Answering
por: Barbu, Eduard, et al.
Publicado: (2025)

Hidden in the Haystack: Smaller Needles are More Difficult for LLMs to Find
por: Bianchi, Owen, et al.
Publicado: (2025)

EDINET-Bench: Evaluating LLMs on Complex Financial Tasks using Japanese Financial Statements
por: Sugiura, Issa, et al.
Publicado: (2025)

Coal Mining Question Answering with LLMs
por: Rivera, Antonio Carlos, et al.
Publicado: (2024)

SAND-Math: Using LLMs to Generate Novel, Difficult and Useful Mathematics Questions and Answers
por: Manem, Chaitanya, et al.
Publicado: (2025)

Context Quality Matters in Training Fusion-in-Decoder for Extractive Open-Domain Question Answering
por: Akimoto, Kosuke, et al.
Publicado: (2024)

A Gaze-grounded Visual Question Answering Dataset for Clarifying Ambiguous Japanese Questions
por: Inadumi, Shun, et al.
Publicado: (2024)

Pretraining and Updates of Domain-Specific LLM: A Case Study in the Japanese Business Domain
por: Takahashi, Kosuke, et al.
Publicado: (2024)

Agri-Query: A Case Study on RAG vs. Long-Context LLMs for Cross-Lingual Technical Question Answering
por: Gun, Julius, et al.
Publicado: (2025)

Exploring the Role of Knowledge Graph-Based RAG in Japanese Medical Question Answering with Small-Scale LLMs
por: Chen, Yingjian, et al.
Publicado: (2025)

Improving Sentence Embeddings with Automatic Generation of Training Data Using Few-shot Examples
por: Sato, Soma, et al.
Publicado: (2024)

Do LLMs Understand Your Translations? Evaluating Paragraph-level MT with Question Answering
por: Fernandes, Patrick, et al.
Publicado: (2025)

ChatGPT as a Translation Engine: A Case Study on Japanese-English
por: Sutanto, Vincent Michael, et al.
Publicado: (2025)

On the Calibration of Multilingual Question Answering LLMs
por: Yang, Yahan, et al.
Publicado: (2023)

JDocQA: Japanese Document Question Answering Dataset for Generative Language Models
por: Onami, Eri, et al.
Publicado: (2024)

LLMs Encode How Difficult Problems Are
por: Lugoloobi, William, et al.
Publicado: (2025)

Accurate Table Question Answering with Accessible LLMs
por: Jiang, Yangfan, et al.
Publicado: (2026)

Agentic LLMs for Question Answering over Tabular Data
por: Tyagi, Rishit, et al.
Publicado: (2025)

How Do Humans Write Code? Large Models Do It the Same Way Too
por: Li, Long, et al.
Publicado: (2024)

None of the Above, Less of the Right: Parallel Patterns between Humans and LLMs on Multi-Choice Questions Answering
por: Tam, Zhi Rui, et al.
Publicado: (2025)

Disambiguation in Conversational Question Answering in the Era of LLMs and Agents: A Survey
por: Tanjim, Md Mehrab, et al.
Publicado: (2025)

Combining LLMs and Knowledge Graphs to Reduce Hallucinations in Question Answering
por: Pusch, Larissa, et al.
Publicado: (2024)