Cover Image

CI-Bench: Benchmarking Contextual Integrity of AI Assistants on Synthetic Data

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Cheng, Zhao, Wan, Diane, Abueg, Matthew, Ghalebikesabi, Sahra, Yi, Ren, Bagdasarian, Eugene, Balle, Borja, Mellem, Stefan, O'Banion, Shawn
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Operationalizing Contextual Integrity in Privacy-Conscious Assistants
by: Ghalebikesabi, Sahra, et al.
Published: (2024)

AirGapAgent: Protecting Privacy-Conscious Conversational Agents
by: Bagdasarian, Eugene, et al.
Published: (2024)

Enhancing Math through Literature.
by: O'Banion, Carie
Published: (1997)

Massively Scalable Inverse Reinforcement Learning in Google Maps
by: Barnes, Matt, et al.
Published: (2023)

UserSumBench: A Benchmark Framework for Evaluating User Summarization Approaches
by: Wang, Chao, et al.
Published: (2024)

User-LLM: Efficient LLM Contextualization with User Embeddings
by: Ning, Lin, et al.
Published: (2024)

PrivaCI-Bench: Evaluating Privacy with Contextual Integrity and Legal Compliance
by: Li, Haoran, et al.
Published: (2025)

Contextual Agent Security: A Policy for Every Purpose
by: Tsai, Lillian, et al.
Published: (2025)

CI-Work: Benchmarking Contextual Integrity in Enterprise LLM Agents
by: Fu, Wenjie, et al.
Published: (2026)

Trusted Machine Learning Models Unlock Private Inference for Problems Currently Infeasible with Cryptography
by: Shumailov, Ilia, et al.
Published: (2025)

AI Agents May Always Fall for Prompt Injections
by: Abdelnabi, Sahar, et al.
Published: (2026)

Eustachian Tube Dysfunction Questionnaire Score Changes at 6 and 12 Weeks: Follow‐Up Implications
by: Alexander R. Gomez‐Lara, et al.
Published: (2026)

Explainable AI for survival analysis: a median-SHAP approach
by: Ter-Minassian, Lucile, et al.
Published: (2024)

Verification Required: The Impact of Information Credibility on AI Persuasion
by: Mahmud, Saaduddin, et al.
Published: (2026)

SciIntegrity-Bench: A Benchmark for Evaluating Academic Integrity in AI Scientist Systems
by: Yang, Zonglin, et al.
Published: (2026)

Contrastive Privacy: A Semantic Approach to Measuring Privacy of AI-based Sanitization
by: Bissias, George, et al.
Published: (2026)

RLPF: Reinforcement Learning from Prediction Feedback for User Summarization with LLMs
by: Wu, Jiaxing, et al.
Published: (2024)

MPCI-Bench: A Benchmark for Multimodal Pairwise Contextual Integrity Evaluation of Language Model Agents
by: Wang, Shouju, et al.
Published: (2026)

Enhancing Reasoning with Collaboration and Memory
by: Michelman, Julie, et al.
Published: (2025)

RubberDuckBench: A Benchmark for AI Coding Assistants
by: Mohammed, Ferida, et al.
Published: (2026)

AI User Assistant
by: Sen, Subhayu, et al.
Published: (2025)

On the Privacy of Selection Mechanisms with Gaussian Noise
by: Lebensold, Jonathan, et al.
Published: (2024)

CI-Repair-Bench: A Repository-Aware Benchmark for Automated Patch Validation via CI Workflows
by: Muna, Rabeya Khatun, et al.
Published: (2026)

Automating Governing Knowledge Commons and Contextual Integrity (GKC-CI) Privacy Policy Annotations with Large Language Models
by: Chanenson, Jake, et al.
Published: (2023)

Privacy Reasoning in Ambiguous Contexts
by: Yi, Ren, et al.
Published: (2025)

VoiceAssistant-Eval: Benchmarking AI Assistants across Listening, Speaking, and Viewing
by: Wang, Ke, et al.
Published: (2025)

Beyond the Calibration Point: Mechanism Comparison in Differential Privacy
by: Kaissis, Georgios, et al.
Published: (2024)

Contextual Data Integrity
by: Soma, Gaius
Published: (2025)

Contextual Integrity Games
by: Wolff, Ran
Published: (2024)

VoiceBench: Benchmarking LLM-Based Voice Assistants
by: Chen, Yiming, et al.
Published: (2024)

CIMemories: A Compositional Benchmark for Contextual Integrity of Persistent Memory in LLMs
by: Mireshghallah, Niloofar, et al.
Published: (2025)

Optimal Approximate Minimization of One-Letter Weighted Finite Automata
by: Lacroce, Clara, et al.
Published: (2023)

Disappearing Ink: Obfuscation Breaks N-gram Code Watermarks in Theory and Practice
by: Zhang, Gehao, et al.
Published: (2025)

Understanding Persuasion in Long-Running Agents
by: Jeong, Hyejun, et al.
Published: (2026)

Backdooring Bias ($B^2$) into Stable Diffusion Models
by: Naseh, Ali, et al.
Published: (2024)

Antiproliferative Effect of Okra Seed Protein Isolate against HepG2 and A549 Cell Lines
by: Letisha Maistry, et al.
Published: (2026)

TeleEgo: Benchmarking Egocentric AI Assistants in the Wild
by: Yan, Jiaqi, et al.
Published: (2025)

SPILLage: Agentic Oversharing on the Web
by: Roh, Jaechul, et al.
Published: (2026)

Integrating Differential Privacy and Contextual Integrity
by: Benthall, Sebastian, et al.
Published: (2024)

Building Egocentric Procedural AI Assistant: Methods, Benchmarks, and Challenges
by: Li, Junlong, et al.
Published: (2025)