Privacy Preserving Personal Assistant with On-Device Diarization and Spoken Dialogue System for Home and Beyond

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Chollet, Gérard, Sansen, Hugues, Tevissen, Yannis, Boudy, Jérôme, Hariz, Mossaab, Lohr, Christophe, Yassa, Fathy
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917557753085952
author Chollet, Gérard
Sansen, Hugues
Tevissen, Yannis
Boudy, Jérôme
Hariz, Mossaab
Lohr, Christophe
Yassa, Fathy
author_facet Chollet, Gérard
Sansen, Hugues
Tevissen, Yannis
Boudy, Jérôme
Hariz, Mossaab
Lohr, Christophe
Yassa, Fathy
contents In the age of personal voice assistants, the question of privacy arises. These digital companions often lack memory of past interactions, while relying heavily on the internet for speech processing, raising privacy concerns. Modern smartphones now enable on-device speech processing, making cloud-based solutions unnecessary. Personal assistants for the elderly should excel at memory recall, especially in medical examinations. The e-ViTA project developed a versatile conversational application with local processing and speaker recognition. This paper highlights the importance of speaker diarization enriched with sensor data fusion for contextualized conversation preservation. The use cases applied to the e-VITA project have shown that truly personalized dialogue is pivotal for individual voice assistants. Secure local processing and sensor data fusion ensure virtual companions meet individual user needs without compromising privacy or data security.
format Preprint
id arxiv_https___arxiv_org_abs_2401_01146
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Privacy Preserving Personal Assistant with On-Device Diarization and Spoken Dialogue System for Home and Beyond
Chollet, Gérard
Sansen, Hugues
Tevissen, Yannis
Boudy, Jérôme
Hariz, Mossaab
Lohr, Christophe
Yassa, Fathy
Human-Computer Interaction
In the age of personal voice assistants, the question of privacy arises. These digital companions often lack memory of past interactions, while relying heavily on the internet for speech processing, raising privacy concerns. Modern smartphones now enable on-device speech processing, making cloud-based solutions unnecessary. Personal assistants for the elderly should excel at memory recall, especially in medical examinations. The e-ViTA project developed a versatile conversational application with local processing and speaker recognition. This paper highlights the importance of speaker diarization enriched with sensor data fusion for contextualized conversation preservation. The use cases applied to the e-VITA project have shown that truly personalized dialogue is pivotal for individual voice assistants. Secure local processing and sensor data fusion ensure virtual companions meet individual user needs without compromising privacy or data security.
title Privacy Preserving Personal Assistant with On-Device Diarization and Spoken Dialogue System for Home and Beyond
topic Human-Computer Interaction
url https://arxiv.org/abs/2401.01146