Copertina

Do LLMs and Humans Find the Same Questions Difficult? A Case Study on Japanese Quiz Answering

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Sugiura, Naoya, Yamada, Kosuke, Ogawa, Yasuhiro, Toyama, Katsuhiko, Sasano, Ryohei
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Ruri: Japanese General Text Embeddings
di: Tsukagoshi, Hayato, et al.
Pubblicazione: (2024)

To Drop or Not to Drop? Predicting Argument Ellipsis Judgments: A Case Study in Japanese
di: Ishizuki, Yukiko, et al.
Pubblicazione: (2024)

How Do Language Models Acquire Character-Level Information?
di: Sato, Soma, et al.
Pubblicazione: (2026)

FrameEOL: Semantic Frame Induction using Causal Language Models
di: Yano, Chihiro, et al.
Pubblicazione: (2025)

Are Social Sentiments Inherent in LLMs? An Empirical Study on Extraction of Inter-demographic Sentiments
di: Tanaka, Kunitomo, et al.
Pubblicazione: (2024)

Do LLMs Find Human Answers To Fact-Driven Questions Perplexing? A Case Study on Reddit
di: Seegmiller, Parker, et al.
Pubblicazione: (2024)

Redundancy, Isotropy, and Intrinsic Dimensionality of Prompt-based Text Embeddings
di: Tsukagoshi, Hayato, et al.
Pubblicazione: (2025)

Can We Still Hear the Accent? Investigating the Resilience of Native Language Signals in the LLM Era
di: Utami, Nabelanita, et al.
Pubblicazione: (2026)

Do LLMs Understand Ambiguity in Text? A Case Study in Open-world Question Answering
di: Keluskar, Aryan, et al.
Pubblicazione: (2024)

Difficult for Whom? A Study of Japanese Lexical Complexity
di: Nohejl, Adam, et al.
Pubblicazione: (2024)

On Representational Dissociation of Language and Arithmetic in Large Language Models
di: Kisako, Riku, et al.
Pubblicazione: (2025)

CiMaTe: Citation Count Prediction Effectively Leveraging the Main Text
di: Hirako, Jun, et al.
Pubblicazione: (2024)

When Is 0.1% Enough? Analyzing the Combined Effects of Dimensionality Reduction and Quantization on Text Embedding Compression
di: Kisako, Riku, et al.
Pubblicazione: (2026)

Verifying Claims About Metaphors with Large-Scale Automatic Metaphor Identification
di: Aono, Kotaro, et al.
Pubblicazione: (2024)

Simplifying Translations for Children: Iterative Simplification Considering Age of Acquisition with LLMs
di: Oshika, Masashi, et al.
Pubblicazione: (2024)

Enhancing Large Vision-Language Models with Layout Modality for Table Question Answering on Japanese Annual Securities Reports
di: Aida, Hayato, et al.
Pubblicazione: (2025)

DiscoTrace: Representing and Comparing Answering Strategies of Humans and LLMs in Information-Seeking Question Answering
di: Srikanth, Neha, et al.
Pubblicazione: (2026)

Sentence Representations via Gaussian Embedding
di: Yoda, Shohei, et al.
Pubblicazione: (2023)

Do LLMs Understand Romanian Driving Laws? A Study on Multimodal and Fine-Tuned Question Answering
di: Barbu, Eduard, et al.
Pubblicazione: (2025)

Hidden in the Haystack: Smaller Needles are More Difficult for LLMs to Find
di: Bianchi, Owen, et al.
Pubblicazione: (2025)

EDINET-Bench: Evaluating LLMs on Complex Financial Tasks using Japanese Financial Statements
di: Sugiura, Issa, et al.
Pubblicazione: (2025)

Coal Mining Question Answering with LLMs
di: Rivera, Antonio Carlos, et al.
Pubblicazione: (2024)

SAND-Math: Using LLMs to Generate Novel, Difficult and Useful Mathematics Questions and Answers
di: Manem, Chaitanya, et al.
Pubblicazione: (2025)

Context Quality Matters in Training Fusion-in-Decoder for Extractive Open-Domain Question Answering
di: Akimoto, Kosuke, et al.
Pubblicazione: (2024)

A Gaze-grounded Visual Question Answering Dataset for Clarifying Ambiguous Japanese Questions
di: Inadumi, Shun, et al.
Pubblicazione: (2024)

Pretraining and Updates of Domain-Specific LLM: A Case Study in the Japanese Business Domain
di: Takahashi, Kosuke, et al.
Pubblicazione: (2024)

Agri-Query: A Case Study on RAG vs. Long-Context LLMs for Cross-Lingual Technical Question Answering
di: Gun, Julius, et al.
Pubblicazione: (2025)

Exploring the Role of Knowledge Graph-Based RAG in Japanese Medical Question Answering with Small-Scale LLMs
di: Chen, Yingjian, et al.
Pubblicazione: (2025)

Improving Sentence Embeddings with Automatic Generation of Training Data Using Few-shot Examples
di: Sato, Soma, et al.
Pubblicazione: (2024)

Do LLMs Understand Your Translations? Evaluating Paragraph-level MT with Question Answering
di: Fernandes, Patrick, et al.
Pubblicazione: (2025)

ChatGPT as a Translation Engine: A Case Study on Japanese-English
di: Sutanto, Vincent Michael, et al.
Pubblicazione: (2025)

On the Calibration of Multilingual Question Answering LLMs
di: Yang, Yahan, et al.
Pubblicazione: (2023)

JDocQA: Japanese Document Question Answering Dataset for Generative Language Models
di: Onami, Eri, et al.
Pubblicazione: (2024)

LLMs Encode How Difficult Problems Are
di: Lugoloobi, William, et al.
Pubblicazione: (2025)

Accurate Table Question Answering with Accessible LLMs
di: Jiang, Yangfan, et al.
Pubblicazione: (2026)

Agentic LLMs for Question Answering over Tabular Data
di: Tyagi, Rishit, et al.
Pubblicazione: (2025)

How Do Humans Write Code? Large Models Do It the Same Way Too
di: Li, Long, et al.
Pubblicazione: (2024)

None of the Above, Less of the Right: Parallel Patterns between Humans and LLMs on Multi-Choice Questions Answering
di: Tam, Zhi Rui, et al.
Pubblicazione: (2025)

Disambiguation in Conversational Question Answering in the Era of LLMs and Agents: A Survey
di: Tanjim, Md Mehrab, et al.
Pubblicazione: (2025)

Combining LLMs and Knowledge Graphs to Reduce Hallucinations in Question Answering
di: Pusch, Larissa, et al.
Pubblicazione: (2024)