Imagen de Portada

Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMs

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Hua, Andong, Tang, Kenan, Gu, Chenhe, Gu, Jindong, Wong, Eric, Qin, Yao
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Artificial Intelligence Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Improving Adversarial Transferability in MLLMs via Dynamic Vision-Language Alignment Attack
por: Gu, Chenhe, et al.
Publicado: (2025)

Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Pro
por: Tang, Kenan, et al.
Publicado: (2026)

PromptBench: A Unified Library for Evaluation of Large Language Models
por: Zhu, Kaijie, et al.
Publicado: (2023)

Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates
por: Lyu, Kaifeng, et al.
Publicado: (2024)

Architectural Flaw Detection in Civil Engineering Using GPT-4
por: Kumar, Saket, et al.
Publicado: (2024)

Interesting Scientific Idea Generation using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaders
por: Gu, Xuemei, et al.
Publicado: (2024)

Selective Prompting Tuning for Personalized Conversations with LLMs
por: Huang, Qiushi, et al.
Publicado: (2024)

AgentBench: Evaluating LLMs as Agents
por: Liu, Xiao, et al.
Publicado: (2023)

Batch Calibration: Rethinking Calibration for In-Context Learning and Prompt Engineering
por: Zhou, Han, et al.
Publicado: (2023)

LLMs Should Express Uncertainty Explicitly
por: Guo, Junyu, et al.
Publicado: (2026)

Special Characters Attack: Toward Scalable Training Data Extraction From Large Language Models
por: Bai, Yang, et al.
Publicado: (2024)

Revisiting Prompt Sensitivity in Large Language Models for Text Classification: The Role of Prompt Underspecification
por: Pecher, Branislav, et al.
Publicado: (2026)

Evaluating the Generalization Ability of Quantized LLMs: Benchmark, Analysis, and Toolbox
por: Liu, Yijun, et al.
Publicado: (2024)

How Susceptible are LLMs to Influence in Prompts?
por: Anagnostidis, Sotiris, et al.
Publicado: (2024)

Safe, or Simply Incapable? Rethinking Safety Evaluation for Phone-Use Agents
por: Tang, Zhengyang, et al.
Publicado: (2026)

Multiplex Thinking: Reasoning via Token-wise Branch-and-Merge
por: Tang, Yao, et al.
Publicado: (2026)

Beyond Confidence: Rethinking Self-Assessments for Performance Prediction in LLMs
por: Bhattacharyya, Sree, et al.
Publicado: (2026)

Higher-order Linear Attention
por: Zhang, Yifan, et al.
Publicado: (2025)

Evaluating Prompt Engineering Techniques for Accuracy and Confidence Elicitation in Medical LLMs
por: Naderi, Nariman, et al.
Publicado: (2025)

Learning and Enforcing Context-Sensitive Control for LLMs
por: Albinhassan, Mohammad, et al.
Publicado: (2026)

Dynamic Evaluation of Large Language Models by Meta Probing Agents
por: Zhu, Kaijie, et al.
Publicado: (2024)

POSIX: A Prompt Sensitivity Index For Large Language Models
por: Chatterjee, Anwoy, et al.
Publicado: (2024)

On Meta-Prompting
por: de Wynter, Adrian, et al.
Publicado: (2023)

Rethinking the Potential of Multimodality in Collaborative Problem Solving Diagnosis with Large Language Models
por: Wong, K., et al.
Publicado: (2025)

Prompt Repetition Improves Non-Reasoning LLMs
por: Leviathan, Yaniv, et al.
Publicado: (2025)

Tabular Transfer Learning via Prompting LLMs
por: Nam, Jaehyun, et al.
Publicado: (2024)

Relative Preference Optimization: Enhancing LLM Alignment through Contrasting Responses across Identical and Diverse Prompts
por: Yin, Yueqin, et al.
Publicado: (2024)

KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models
por: Yu, Zhuohao, et al.
Publicado: (2024)

Tactic: Adaptive Sparse Attention with Clustering and Distribution Fitting for Long-Context LLMs
por: Zhu, Kan, et al.
Publicado: (2025)

Does Machine Unlearning Truly Remove Knowledge?
por: Chen, Haokun, et al.
Publicado: (2025)

Rethinking the Role of Prompting Strategies in LLM Test-Time Scaling: A Perspective of Probability Theory
por: Liu, Yexiang, et al.
Publicado: (2025)

Rethinking Time Series Forecasting with LLMs via Nearest Neighbor Contrastive Learning
por: Bogahawatte, Jayanie, et al.
Publicado: (2024)

UltraEdit: Training-, Subject-, and Memory-Free Lifelong Editing in Language Models
por: Gu, Xiaojie, et al.
Publicado: (2025)

StyleBench: Evaluating thinking styles in Large Language Models
por: Guo, Junyu, et al.
Publicado: (2025)

Tensor Product Attention Is All You Need
por: Zhang, Yifan, et al.
Publicado: (2025)

DyVal: Dynamic Evaluation of Large Language Models for Reasoning Tasks
por: Zhu, Kaijie, et al.
Publicado: (2023)

L-TUNING: Synchronized Label Tuning for Prompt and Prefix in LLMs
por: Kowsher, Md., et al.
Publicado: (2023)

RewardAnything: Generalizable Principle-Following Reward Models
por: Yu, Zhuohao, et al.
Publicado: (2025)

Rethinking Reward Model Evaluation Through the Lens of Reward Overoptimization
por: Kim, Sunghwan, et al.
Publicado: (2025)

Rethinking Evaluation of Sparse Autoencoders through the Representation of Polysemous Words
por: Minegishi, Gouki, et al.
Publicado: (2025)