OpenLifelogQA: An Open-Ended Multi-Modal Lifelog Question-Answering Dataset
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911631401811968 |
|---|---|
| author | Tran, Quang-Linh Le, Hoang-Bao Diep, Tuong-Nghiem Nguyen, Binh Jones, Gareth J. F. Gurrin, Cathal |
| author_facet | Tran, Quang-Linh Le, Hoang-Bao Diep, Tuong-Nghiem Nguyen, Binh Jones, Gareth J. F. Gurrin, Cathal |
| contents | We introduce OpenLifelogQA, a large-scale open-ended lifelog QA dataset constructed from 18 months of multimodal lifelog data. Lifelogging is the passive collection and analysis of personal daily activities using wearable devices, producing rich multimodal data such as images, locations, and biometrics. Question answering (QA) over lifelog data enables users to interactively query their own experiences, supporting applications in memory support, lifestyle analysis, and personal assistance. OpenLifelogQA contains 14,187 Q&A pairs spanning multiple question types and difficulty levels, designed to support robust evaluation in realistic settings. Compared with prior resources, OpenLifelogQA offers greater diversity and practicality for real-world applications. To establish baselines, we evaluate the LLaVA-NeXT-Interleave 7B model, achieving 89.7% BERTScore, 25.87% ROUGE-L, and an average LLM Score of 3.97. By releasing OpenLifelogQA, we aim to promote future research on lifelog technologies, paving the way for personal lifelog assistants capable of memory augmentation, healthcare support, and lifestyle coaching. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_03583 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | OpenLifelogQA: An Open-Ended Multi-Modal Lifelog Question-Answering Dataset Tran, Quang-Linh Le, Hoang-Bao Diep, Tuong-Nghiem Nguyen, Binh Jones, Gareth J. F. Gurrin, Cathal Multimedia Information Retrieval We introduce OpenLifelogQA, a large-scale open-ended lifelog QA dataset constructed from 18 months of multimodal lifelog data. Lifelogging is the passive collection and analysis of personal daily activities using wearable devices, producing rich multimodal data such as images, locations, and biometrics. Question answering (QA) over lifelog data enables users to interactively query their own experiences, supporting applications in memory support, lifestyle analysis, and personal assistance. OpenLifelogQA contains 14,187 Q&A pairs spanning multiple question types and difficulty levels, designed to support robust evaluation in realistic settings. Compared with prior resources, OpenLifelogQA offers greater diversity and practicality for real-world applications. To establish baselines, we evaluate the LLaVA-NeXT-Interleave 7B model, achieving 89.7% BERTScore, 25.87% ROUGE-L, and an average LLM Score of 3.97. By releasing OpenLifelogQA, we aim to promote future research on lifelog technologies, paving the way for personal lifelog assistants capable of memory augmentation, healthcare support, and lifestyle coaching. |
| title | OpenLifelogQA: An Open-Ended Multi-Modal Lifelog Question-Answering Dataset |
| topic | Multimedia Information Retrieval |
| url | https://arxiv.org/abs/2508.03583 |