Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wang, Yanshuo, Xu, Yuan, Li, Xuesong, Hong, Jie, Wang, Yizhou, Chen, Chang Wen, Zhu, Wentao
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2604.19564
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917427068010496
author Wang, Yanshuo
Xu, Yuan
Li, Xuesong
Hong, Jie
Wang, Yizhou
Chen, Chang Wen
Zhu, Wentao
author_facet Wang, Yanshuo
Xu, Yuan
Li, Xuesong
Hong, Jie
Wang, Yizhou
Chen, Chang Wen
Zhu, Wentao
contents Egocentric assistants often rely on first-person view data to capture user behavior and context for personalized services. Since different users exhibit distinct habits, preferences, and routines, such personalization is essential for truly effective assistance. However, effectively integrating long-term user data for personalization remains a key challenge. To address this, we introduce EgoSelf, a system that includes a graph-based interaction memory constructed from past observations and a dedicated learning task for personalization. The memory captures temporal and semantic relationships among interaction events and entities, from which user-specific profiles are derived. The personalized learning task is formulated as a prediction problem where the model predicts possible future interactions from individual user's historical behavior recorded in the graph. Extensive experiments demonstrate the effectiveness of EgoSelf as a personalized egocentric assistant. Code is available at https://abie-e.github.io/EgoSelf/.
format Preprint
id arxiv_https___arxiv_org_abs_2604_19564
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle EgoSelf: From Memory to Personalized Egocentric Assistant
Wang, Yanshuo
Xu, Yuan
Li, Xuesong
Hong, Jie
Wang, Yizhou
Chen, Chang Wen
Zhu, Wentao
Computer Vision and Pattern Recognition
Artificial Intelligence
Egocentric assistants often rely on first-person view data to capture user behavior and context for personalized services. Since different users exhibit distinct habits, preferences, and routines, such personalization is essential for truly effective assistance. However, effectively integrating long-term user data for personalization remains a key challenge. To address this, we introduce EgoSelf, a system that includes a graph-based interaction memory constructed from past observations and a dedicated learning task for personalization. The memory captures temporal and semantic relationships among interaction events and entities, from which user-specific profiles are derived. The personalized learning task is formulated as a prediction problem where the model predicts possible future interactions from individual user's historical behavior recorded in the graph. Extensive experiments demonstrate the effectiveness of EgoSelf as a personalized egocentric assistant. Code is available at https://abie-e.github.io/EgoSelf/.
title EgoSelf: From Memory to Personalized Egocentric Assistant
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2604.19564