Harmony: A Human-Aware, Responsive, Modular Assistant with a Locally Deployed Large Language Model

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yin, Ziqi, Zhang, Mingxin, Kawahara, Daisuke
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912531831848960
author Yin, Ziqi
Zhang, Mingxin
Kawahara, Daisuke
author_facet Yin, Ziqi
Zhang, Mingxin
Kawahara, Daisuke
contents Large Language Models (LLMs) offer powerful capabilities for natural language understanding, enabling more intelligent smart home assistants. However, existing systems often rely on cloud-based LLMs, raising concerns around user privacy and system dependency on external connectivity. In this work, we present Harmony, a privacy-preserving and robust smart home assistant powered by the locally deployable Llama3-8B model. Beyond protecting user data, Harmony also addresses reliability challenges of smaller models, such as hallucination and instruction misinterpretation, through structured prompting and modular agent design. Experimental results in both virtual environments and user studies show that Harmony achieves performance comparable to GPT-4-based systems, while enabling offline, proactive, and personalized smart home interaction.
format Preprint
id arxiv_https___arxiv_org_abs_2410_14252
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Harmony: A Human-Aware, Responsive, Modular Assistant with a Locally Deployed Large Language Model
Yin, Ziqi
Zhang, Mingxin
Kawahara, Daisuke
Human-Computer Interaction
Large Language Models (LLMs) offer powerful capabilities for natural language understanding, enabling more intelligent smart home assistants. However, existing systems often rely on cloud-based LLMs, raising concerns around user privacy and system dependency on external connectivity. In this work, we present Harmony, a privacy-preserving and robust smart home assistant powered by the locally deployable Llama3-8B model. Beyond protecting user data, Harmony also addresses reliability challenges of smaller models, such as hallucination and instruction misinterpretation, through structured prompting and modular agent design. Experimental results in both virtual environments and user studies show that Harmony achieves performance comparable to GPT-4-based systems, while enabling offline, proactive, and personalized smart home interaction.
title Harmony: A Human-Aware, Responsive, Modular Assistant with a Locally Deployed Large Language Model
topic Human-Computer Interaction
url https://arxiv.org/abs/2410.14252