Cover Image

Towards Evaluation for Real-World LLM Unlearning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Miao, Ke, Hu, Yuke, Li, Xiaochen, Bao, Wenjie, Liu, Zhihao, Qin, Zhan, Ren, Kui
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Module-Aware Parameter-Efficient Machine Unlearning on Transformers
by: Bao, Wenjie, et al.
Published: (2025)

Towards Mitigating Excessive Forgetting in LLM Unlearning via Entanglement-Guidance with Proxy Constraint
by: Liu, Zhihao, et al.
Published: (2025)

ERASER: Machine Unlearning in MLaaS via an Inference Serving-Aware Approach
by: Hu, Yuke, et al.
Published: (2023)

Membership Inference Attacks Against Vision-Language Models
by: Hu, Yuke, et al.
Published: (2025)

Releasing Malevolence from Benevolence: The Menace of Benign Data on Machine Unlearning
by: Ma, Binhao, et al.
Published: (2024)

Shadow in the Cache: Unveiling and Mitigating Privacy Risks of KV-cache in LLM Inference
by: Luo, Zhifan, et al.
Published: (2025)

Quantifying and Defending against Privacy Threats on Federated Knowledge Graph Embedding
by: Hu, Yuke, et al.
Published: (2023)

Aligned but Fragile: Enhancing LLM Safety Robustness via Zeroth-Order Optimization
by: Liu, Zhihao, et al.
Published: (2026)

The Unlearning Mirage: A Dynamic Framework for Evaluating LLM Unlearning
by: Shah, Raj Sanjay, et al.
Published: (2026)

Textual Unlearning Gives a False Sense of Unlearning
by: Du, Jiacheng, et al.
Published: (2024)

Tianyi: A Traditional Chinese Medicine all-rounder language model and its Real-World Clinical Practice
by: Liu, Zhi, et al.
Published: (2025)

Eguard: Defending LLM Embeddings Against Inversion Attacks via Text Mutual Information Optimization
by: Liu, Tiantian, et al.
Published: (2024)

PPU-Bench:Real World Benchmark for Personalized Partial Unlearning in Vision Language Models
by: Guang, Jiahui, et al.
Published: (2026)

Explanation as a Watermark: Towards Harmless and Multi-bit Model Ownership Verification via Watermarking Feature Attribution
by: Shao, Shuo, et al.
Published: (2024)

Toward Personalized LLM-Powered Agents: Foundations, Evaluation, and Future Directions
by: Xu, Yue, et al.
Published: (2026)

Can LLM Agents Generate Real-World Evidence? Evaluating Observational Studies in Medical Databases
by: Li, Dubai, et al.
Published: (2026)

Toward Real-World Table Agents: Capabilities, Workflows, and Design Principles for LLM-based Table Intelligence
by: Tian, Jiaming, et al.
Published: (2025)

PhysicianBench: Evaluating LLM Agents in Real-World EHR Environments
by: Liu, Ruoqi, et al.
Published: (2026)

Prompt-Consistency Image Generation (PCIG): A Unified Framework Integrating LLMs, Knowledge Graphs, and Controllable Diffusion Models
by: Sun, Yichen, et al.
Published: (2024)

RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models
by: Jin, Zhuoran, et al.
Published: (2024)

Unlearners Can Lie: Evaluating and Improving Honesty in LLM Unlearning
by: Gu, Renjie, et al.
Published: (2026)

COMAP: Co-Evolving World Models and Agent Policies for LLM Agents
by: Liu, Youwei, et al.
Published: (2026)

DeepSeek-VL: Towards Real-World Vision-Language Understanding
by: Lu, Haoyu, et al.
Published: (2024)

Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications
by: Kawaharazuka, Kento, et al.
Published: (2025)

Explainable Token-level Noise Filtering for LLM Fine-tuning Datasets
by: Yang, Yuchen, et al.
Published: (2026)

Combating Concept Drift with Explanatory Detection and Adaptation for Android Malware Classification
by: He, Yiling, et al.
Published: (2024)

Unlearning of Knowledge Graph Embedding via Preference Optimization
by: Liu, Jiajun, et al.
Published: (2025)

Evaluating LLM Metrics Through Real-World Capabilities
by: Miller, Justin K, et al.
Published: (2025)

DeliveryBench: Can Agents Earn Profit in Real World?
by: Mao, Lingjun, et al.
Published: (2025)

BrowserArena: Evaluating LLM Agents on Real-World Web Navigation Tasks
by: Anupam, Sagnik, et al.
Published: (2025)

Attractive Metadata Attack: Inducing LLM Agents to Invoke Malicious Tools
by: Mo, Kanghua, et al.
Published: (2025)

Wide-Horizon Thinking and Simulation-Based Evaluation for Real-World LLM Planning with Multifaceted Constraints
by: Yang, Dongjie, et al.
Published: (2025)

HarmMetric Eval: Benchmarking Metrics and Judges for LLM Harmfulness Assessment
by: Yang, Langqi, et al.
Published: (2025)

A Real-World Evaluation of LLM Medication Safety Reviews in NHS Primary Care
by: Normand, Oliver, et al.
Published: (2025)

FinToolBench: Evaluating LLM Agents for Real-World Financial Tool Use
by: Lu, Jiaxuan, et al.
Published: (2026)

DRAGON: Guard LLM Unlearning in Context via Negative Detection and Reasoning
by: Wang, Yaxuan, et al.
Published: (2025)

UniErase: Towards Balanced and Precise Unlearning in Language Models
by: Yu, Miao, et al.
Published: (2025)

LLM Unlearning via Loss Adjustment with Only Forget Data
by: Wang, Yaxuan, et al.
Published: (2024)

Channel-Level Semantic Perturbations: Unlearnable Examples for Diverse Training Paradigms
by: Wang, Bo, et al.
Published: (2026)

DetectRL: Benchmarking LLM-Generated Text Detection in Real-World Scenarios
by: Wu, Junchao, et al.
Published: (2024)