PersonaBench: Evaluating AI Models on Understanding Personal Information through Accessing (Synthetic) Private User Data
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913998918647808 |
|---|---|
| author | Tan, Juntao Yang, Liangwei Liu, Zuxin Liu, Zhiwei Murthy, Rithesh Awalgaonkar, Tulika Manoj Zhang, Jianguo Yao, Weiran Zhu, Ming Kokane, Shirley Savarese, Silvio Wang, Huan Xiong, Caiming Heinecke, Shelby |
| author_facet | Tan, Juntao Yang, Liangwei Liu, Zuxin Liu, Zhiwei Murthy, Rithesh Awalgaonkar, Tulika Manoj Zhang, Jianguo Yao, Weiran Zhu, Ming Kokane, Shirley Savarese, Silvio Wang, Huan Xiong, Caiming Heinecke, Shelby |
| contents | Personalization is critical in AI assistants, particularly in the context of private AI models that work with individual users. A key scenario in this domain involves enabling AI models to access and interpret a user's private data (e.g., conversation history, user-AI interactions, app usage) to understand personal details such as biographical information, preferences, and social connections. However, due to the sensitive nature of such data, there are no publicly available datasets that allow us to assess an AI model's ability to understand users through direct access to personal information.
To address this gap, we introduce a synthetic data generation pipeline that creates diverse, realistic user profiles and private documents simulating human activities. Leveraging this synthetic data, we present PersonaBench, a benchmark designed to evaluate AI models' performance in understanding personal information derived from simulated private user data.
We evaluate Retrieval-Augmented Generation (RAG) pipelines using questions directly related to a user's personal information, supported by the relevant private documents provided to the models. Our results reveal that current retrieval-augmented AI models struggle to answer private questions by extracting personal information from user documents, highlighting the need for improved methodologies to enhance personalization capabilities in AI. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_20616 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | PersonaBench: Evaluating AI Models on Understanding Personal Information through Accessing (Synthetic) Private User Data Tan, Juntao Yang, Liangwei Liu, Zuxin Liu, Zhiwei Murthy, Rithesh Awalgaonkar, Tulika Manoj Zhang, Jianguo Yao, Weiran Zhu, Ming Kokane, Shirley Savarese, Silvio Wang, Huan Xiong, Caiming Heinecke, Shelby Artificial Intelligence Personalization is critical in AI assistants, particularly in the context of private AI models that work with individual users. A key scenario in this domain involves enabling AI models to access and interpret a user's private data (e.g., conversation history, user-AI interactions, app usage) to understand personal details such as biographical information, preferences, and social connections. However, due to the sensitive nature of such data, there are no publicly available datasets that allow us to assess an AI model's ability to understand users through direct access to personal information. To address this gap, we introduce a synthetic data generation pipeline that creates diverse, realistic user profiles and private documents simulating human activities. Leveraging this synthetic data, we present PersonaBench, a benchmark designed to evaluate AI models' performance in understanding personal information derived from simulated private user data. We evaluate Retrieval-Augmented Generation (RAG) pipelines using questions directly related to a user's personal information, supported by the relevant private documents provided to the models. Our results reveal that current retrieval-augmented AI models struggle to answer private questions by extracting personal information from user documents, highlighting the need for improved methodologies to enhance personalization capabilities in AI. |
| title | PersonaBench: Evaluating AI Models on Understanding Personal Information through Accessing (Synthetic) Private User Data |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2502.20616 |