Imagen de Portada

Identifying the Achilles' Heel: An Iterative Method for Dynamically Uncovering Factual Errors in Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wang, Wenxuan, Chan, Yuk-Kit, Ling, Zixuan, Shi, Juluan, Yuan, Youliang, Huang, Jen-tse, Zhang, Yifei, Jiao, Wenxiang, Tu, Zhaopeng, Lyu, Michael R.
Formato:	Preprint
Publicado:	2024
Materias:	Software Engineering Artificial Intelligence Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Learning to Ask: When LLM Agents Meet Unclear Instruction
por: Wang, Wenxuan, et al.
Publicado: (2024)

LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models
por: Wan, Yuxuan, et al.
Publicado: (2024)

All Languages Matter: On the Multilingual Safety of Large Language Models
por: Wang, Wenxuan, et al.
Publicado: (2023)

On the Shortcut Learning in Multilingual Neural Machine Translation
por: Wang, Wenxuan, et al.
Publicado: (2024)

GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher
por: Yuan, Youliang, et al.
Publicado: (2023)

Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Training
por: Yuan, Youliang, et al.
Publicado: (2024)

Chain-of-Jailbreak Attack for Image Generation Models via Editing Step by Step
por: Wang, Wenxuan, et al.
Publicado: (2024)

Rigorous Simulation-based Testing for Autonomous Driving Systems -- Targeting the Achilles' Heel of Four Open Autopilots
por: Li, Changwen, et al.
Publicado: (2024)

Not All Countries Celebrate Thanksgiving: On the Cultural Dominance in Large Language Models
por: Wang, Wenxuan, et al.
Publicado: (2023)

New Job, New Gender? Measuring the Social Bias in Image Generation Models
por: Wang, Wenxuan, et al.
Publicado: (2024)

Who is ChatGPT? Benchmarking LLMs' Psychological Portrayal Using PsychoBench
por: Huang, Jen-tse, et al.
Publicado: (2023)

CodeCrash: Exposing LLM Fragility to Misleading Natural Language in Code Reasoning
por: Lam, Man Ho, et al.
Publicado: (2025)

How Far Are We on the Decision-Making of LLMs? Evaluating LLMs' Gaming Ability in Multi-Agent Environments
por: Huang, Jen-tse, et al.
Publicado: (2024)

Insight Over Sight: Exploring the Vision-Knowledge Conflicts in Multimodal LLMs
por: Liu, Xiaoyuan, et al.
Publicado: (2024)

FairCoder: Evaluating Social Bias of LLMs in Code Generation
por: Du, Yongkang, et al.
Publicado: (2025)

Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBench
por: Huang, Jen-tse, et al.
Publicado: (2023)

UniDebugger: Hierarchical Multi-Agent Framework for Unified Software Debugging
por: Lee, Cheryl, et al.
Publicado: (2024)

Rigor, Reliability, and Reproducibility Matter: A Decade-Scale Survey of 572 Code Benchmarks
por: Cao, Jialun, et al.
Publicado: (2025)

ComboBench: Can LLMs Manipulate Physical Devices to Play Virtual Reality Games?
por: Li, Shuqing, et al.
Publicado: (2025)

gigiProfiler: Diagnosing Performance Issues by Uncovering Application Resource Bottlenecks
por: Hu, Yigong, et al.
Publicado: (2025)

Understanding and Mitigating the Uncertainty in Zero-Shot Translation
por: Wang, Wenxuan, et al.
Publicado: (2022)

ComUICoder: Component-based Reusable UI Code Generation for Complex Websites via Semantic Segmentation and Element-wise Feedback
por: Xiao, Jingyu, et al.
Publicado: (2026)

Technical Report for Argoverse2 Scenario Mining Challenges on Iterative Error Correction and Spatially-Aware Prompting
por: Chen, Yifei, et al.
Publicado: (2025)

Can't See the Forest for the Trees: Benchmarking Multimodal Safety Awareness for Multimodal LLMs
por: Wang, Wenxuan, et al.
Publicado: (2025)

Towards Evaluating Proactive Risk Awareness of Multimodal Language Models
por: Yuan, Youliang, et al.
Publicado: (2025)

The Achilles' Heel of LLMs: How Altering a Handful of Neurons Can Cripple Language Abilities
por: Qin, Zixuan, et al.
Publicado: (2025)

Human Cognitive Benchmarks Reveal Foundational Visual Gaps in MLLMs
por: Huang, Jen-Tse, et al.
Publicado: (2025)

Exposing and Defending the Achilles' Heel of Video Mixture-of-Experts
por: Wang, Songping, et al.
Publicado: (2026)

Evaluating the Capability of LLMs in Identifying Compilation Errors in Configurable Systems
por: Albuquerque, Lucas, et al.
Publicado: (2024)

Revisiting the Reliability of Psychological Scales on Large Language Models
por: Huang, Jen-tse, et al.
Publicado: (2023)

SWE-Chain: Benchmarking Coding Agents on Chained Release-Level Package Upgrades
por: Lam, Man Ho, et al.
Publicado: (2026)

Uncover the Premeditated Attacks: Detecting Exploitable Reentrancy Vulnerabilities by Identifying Attacker Contracts
por: Yang, Shuo, et al.
Publicado: (2024)

Extramedullary Disease—Achilles Heel in Myeloma?
por: Shaji Kumar, et al.
Publicado: (2025)

A Survey on the Safety and Security Threats of Computer-Using Agents: JARVIS or Ultron?
por: Chen, Ada, et al.
Publicado: (2025)

A Multi-stage Error Diagnosis for APB Transaction
por: Tsai, Cheng-Yang, et al.
Publicado: (2025)

Detecting Build Dependency Errors in Incremental Builds
por: Lyu, Jun, et al.
Publicado: (2024)

Curing Miracle Steps in LLM Mathematical Reasoning with Rubric Rewards
por: Yuan, Youliang, et al.
Publicado: (2025)

NESSiE: The Necessary Safety Benchmark -- Identifying Errors that should not Exist
por: Bertram, Johannes, et al.
Publicado: (2026)

[WIP] Jailbreak Paradox: The Achilles' Heel of LLMs
por: Rao, Abhinav, et al.
Publicado: (2024)

Achilles Heel of Distributed Multi-Agent Systems
por: Zhang, Yiting, et al.
Publicado: (2025)