Opal: Private Memory for Personal AI

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Kaviani, Darya, Ozdarendeli, Alp Eren, Zhu, Jinhao, Ding, Yu, Popa, Raluca Ada
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913000828436480
author Kaviani, Darya
Ozdarendeli, Alp Eren
Zhu, Jinhao
Ding, Yu
Popa, Raluca Ada
author_facet Kaviani, Darya
Ozdarendeli, Alp Eren
Zhu, Jinhao
Ding, Yu
Popa, Raluca Ada
contents Personal AI systems increasingly retain long-term memory of user activity, including documents, emails, messages, meetings, and ambient recordings. Trusted hardware can keep this data private, but struggles to scale with a growing datastore. This pushes the data to external storage, which exposes retrieval access patterns that leak private information to the application provider. Oblivious RAM (ORAM) is a cryptographic primitive that can hide these patterns, but it requires a fixed access budget, precluding the query-dependent traversals that agentic memory systems rely on for accuracy. We present Opal, a private memory system for personal AI. Our key insight is to decouple all data-dependent reasoning from the bulk of personal data, confining it to the trusted enclave. Untrusted disk then sees only fixed, oblivious memory accesses. This enclave-resident component uses a lightweight knowledge graph to capture personal context that semantic search alone misses and handles continuous ingestion by piggybacking reindexing and capacity management on every ORAM access. Evaluated on a comprehensive synthetic personal-data pipeline driven by stochastic communication models, Opal improves retrieval accuracy by 13 percentage points over semantic search and achieves 29x higher throughput with 15x lower infrastructure cost than a secure baseline. Opal is under consideration for deployment to millions of users at a major AI provider.
format Preprint
id arxiv_https___arxiv_org_abs_2604_02522
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Opal: Private Memory for Personal AI
Kaviani, Darya
Ozdarendeli, Alp Eren
Zhu, Jinhao
Ding, Yu
Popa, Raluca Ada
Cryptography and Security
Artificial Intelligence
Personal AI systems increasingly retain long-term memory of user activity, including documents, emails, messages, meetings, and ambient recordings. Trusted hardware can keep this data private, but struggles to scale with a growing datastore. This pushes the data to external storage, which exposes retrieval access patterns that leak private information to the application provider. Oblivious RAM (ORAM) is a cryptographic primitive that can hide these patterns, but it requires a fixed access budget, precluding the query-dependent traversals that agentic memory systems rely on for accuracy. We present Opal, a private memory system for personal AI. Our key insight is to decouple all data-dependent reasoning from the bulk of personal data, confining it to the trusted enclave. Untrusted disk then sees only fixed, oblivious memory accesses. This enclave-resident component uses a lightweight knowledge graph to capture personal context that semantic search alone misses and handles continuous ingestion by piggybacking reindexing and capacity management on every ORAM access. Evaluated on a comprehensive synthetic personal-data pipeline driven by stochastic communication models, Opal improves retrieval accuracy by 13 percentage points over semantic search and achieves 29x higher throughput with 15x lower infrastructure cost than a secure baseline. Opal is under consideration for deployment to millions of users at a major AI provider.
title Opal: Private Memory for Personal AI
topic Cryptography and Security
Artificial Intelligence
url https://arxiv.org/abs/2604.02522