Copertina

OI-Bench: An Option Injection Benchmark for Evaluating LLM Susceptibility to Directive Interference

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liou, Yow-Fu, Tang, Yu-Chien, Liu, Yu-Hsiang, Yen, An-Zi
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Stay Hungry, Stay Foolish: On the Extended Reading Articles Generation with LLMs
di: Liou, Yow-Fu, et al.
Pubblicazione: (2025)

VISTA: A Generative Egocentric Video Framework for Daily Assistance
di: Liu, Yu-Hsiang, et al.
Pubblicazione: (2026)

ConceptKT: A Benchmark for Concept-Level Deficiency Prediction in Knowledge Tracing
di: Kang, Yu-Chen, et al.
Pubblicazione: (2026)

MathEDU: Feedback Generation on Problem-Solving Processes for Mathematical Learning Support
di: Hsu, Wei-Ling, et al.
Pubblicazione: (2025)

VocalBench-DF: A Benchmark for Evaluating Speech LLM Robustness to Disfluency
di: Liu, Hongcheng, et al.
Pubblicazione: (2025)

Do These LLM Benchmarks Agree? Fixing Benchmark Evaluation with BenchBench
di: Perlitz, Yotam, et al.
Pubblicazione: (2024)

CARPAS: Towards Content-Aware Refinement of Provided Aspects for Summarization in Large Language Models
di: Tian, Yong-En, et al.
Pubblicazione: (2025)

ISSR: Iterative Selection with Self-Review for Vocabulary Test Distractor Generation
di: Liu, Yu-Cheng, et al.
Pubblicazione: (2025)

Mobile-Bench: An Evaluation Benchmark for LLM-based Mobile Agents
di: Deng, Shihan, et al.
Pubblicazione: (2024)

JudgeBench: A Benchmark for Evaluating LLM-based Judges
di: Tan, Sijun, et al.
Pubblicazione: (2024)

NC-Bench: An LLM Benchmark for Evaluating Conversational Competence
di: Moore, Robert J., et al.
Pubblicazione: (2026)

How We Refute Claims: Automatic Fact-Checking through Flaw Identification and Explanation
di: Kao, Wei-Yu, et al.
Pubblicazione: (2024)

WAInjectBench: Benchmarking Prompt Injection Detections for Web Agents
di: Liu, Yinuo, et al.
Pubblicazione: (2025)

CryptoBench: A Dynamic Benchmark for Expert-Level Evaluation of LLM Agents in Cryptocurrency
di: Guo, Jiacheng, et al.
Pubblicazione: (2025)

KoDialogBench: Evaluating Conversational Understanding of Language Models with Korean Dialogue Benchmark
di: Jang, Seongbo, et al.
Pubblicazione: (2024)

BenchBench: Benchmarking Automated Benchmark Generation
di: Zheng, Yandan, et al.
Pubblicazione: (2026)

GroupDPO: Memory efficient Group-wise Direct Preference Optimization
di: Leng, Jixuan, et al.
Pubblicazione: (2026)

PST-Bench: Tracing and Benchmarking the Source of Publications
di: Zhang, Fanjin, et al.
Pubblicazione: (2024)

ParamBench: A Graduate-Level Benchmark for Evaluating LLM Understanding on Indic Subjects
di: Maheshwari, Ayush, et al.
Pubblicazione: (2025)

Evaluating Cultural and Social Awareness of LLM Web Agents
di: Qiu, Haoyi, et al.
Pubblicazione: (2024)

VCB Bench: An Evaluation Benchmark for Audio-Grounded Large Language Model Conversational Agents
di: Hu, Jiliang, et al.
Pubblicazione: (2025)

Heron-Bench: A Benchmark for Evaluating Vision Language Models in Japanese
di: Inoue, Yuichi, et al.
Pubblicazione: (2024)

RefuteBench 2.0 -- Agentic Benchmark for Dynamic Evaluation of LLM Responses to Refutation Instruction
di: Yan, Jianhao, et al.
Pubblicazione: (2025)

LCTG Bench: LLM Controlled Text Generation Benchmark
di: Kurihara, Kentaro, et al.
Pubblicazione: (2025)

AlpsBench: An LLM Personalization Benchmark for Real-Dialogue Memorization and Preference Alignment
di: Xiao, Jianfei, et al.
Pubblicazione: (2026)

LLM-as-a-Reviewer: Benchmarking Their Ability, Divergence, and Prompt Injection Resistance as Paper Reviewers
di: Li, Lingyao, et al.
Pubblicazione: (2026)

VULCA-Bench: A Multicultural Vision-Language Benchmark for Evaluating Cultural Understanding
di: Yu, Haorui, et al.
Pubblicazione: (2026)

HoWToBench: Holistic Evaluation for LLM's Capability in Human-level Writing using Tree of Writing
di: Feng, Andrew Zhuoer, et al.
Pubblicazione: (2026)

VarBench: Robust Language Model Benchmarking Through Dynamic Variable Perturbation
di: Qian, Kun, et al.
Pubblicazione: (2024)

The Facade of Truth: Uncovering and Mitigating LLM Susceptibility to Deceptive Evidence
di: Wan, Herun, et al.
Pubblicazione: (2026)

StreamBench: Towards Benchmarking Continuous Improvement of Language Agents
di: Wu, Cheng-Kuang, et al.
Pubblicazione: (2024)

DOCBENCH: A Benchmark for Evaluating LLM-based Document Reading Systems
di: Zou, Anni, et al.
Pubblicazione: (2024)

KGHaluBench: A Knowledge Graph-Based Hallucination Benchmark for Evaluating the Breadth and Depth of LLM Knowledge
di: Robertson, Alex, et al.
Pubblicazione: (2026)

FActBench: A Benchmark for Fine-grained Automatic Evaluation of LLM-Generated Text in the Medical Domain
di: Afzal, Anum, et al.
Pubblicazione: (2025)

GroupTravelBench: Benchmarking LLM Agents on Multi-Person Travel Planning
di: Cheng, Xiang, et al.
Pubblicazione: (2026)

TTT-Bench: A Benchmark for Evaluating Reasoning Ability with Simple and Novel Tic-Tac-Toe-style Games
di: Mishra, Prakamya, et al.
Pubblicazione: (2025)

IberBench: LLM Evaluation on Iberian Languages
di: González, José Ángel, et al.
Pubblicazione: (2025)

UrbanPlanBench: A Comprehensive Urban Planning Benchmark for Evaluating Large Language Models
di: Zheng, Yu, et al.
Pubblicazione: (2025)

MTR-Bench: A Comprehensive Benchmark for Multi-Turn Reasoning Evaluation
di: Li, Xiaoyuan, et al.
Pubblicazione: (2025)

GlobalDentBench: A Multinational Benchmark for Evaluating LLM Clinical Reasoning in Dentistry with Expert Calibration
di: Zhao, Junjie, et al.
Pubblicazione: (2026)