MiCU: End-to-End Smart Home Command Understanding with Large Language Model

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Han, Haowei, Hu, Kexin, Cai, Weiwei, Zhang, Debiao, Qin, Bin, Wang, Yuxiang, Jiang, Jiawei, Yan, Xiao, Du, Bo
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910277251891200
author Han, Haowei
Hu, Kexin
Cai, Weiwei
Zhang, Debiao
Qin, Bin
Wang, Yuxiang
Jiang, Jiawei
Yan, Xiao
Du, Bo
author_facet Han, Haowei
Hu, Kexin
Cai, Weiwei
Zhang, Debiao
Qin, Bin
Wang, Yuxiang
Jiang, Jiawei
Yan, Xiao
Du, Bo
contents Command understanding systems in smart home ecosystems can automate device control and substantially improve user experience. However, while they perform well on precise utterances (e.g., "turn on the bedroom light"), they struggle with ambiguous or misaligned commands (e.g., "make the bedroom cozy"). Large language models (LLMs) generalize well across various domains and can outperform traditional rule-based systems on such tasks, but their effectiveness is often constrained by scarce domain-specific data, insufficient task-specific adaptation, and high computational costs. In this paper, we propose an automated training data synthesis workflow using user logs and LLMs; then we build MiCU, a domain-specific LLM that excels at command understanding. Specifically, we employ curriculum learning to inject domain knowledge into the base LLM, then we enhance its reasoning ability via cold-start training combined with reinforcement learning (RL) guided by domain-specific thinking rules. Additionally, we introduce a token compression technique that condenses device description into a single special token, substantially reducing inference overhead and enabling \model-fast, an efficient variant optimized for long inputs. Extensive experiments show that MiCU significantly outperforms baselines, with an average accuracy gain of 20.01% across all device categories. We have deployed MiCU in the Xiaomi Home app, receiving approximately 1.7 million page views per day. Production evaluations show that MiCU reduces user correction rate by 1.57% and increases human audited accuracy by 32.05%. Our data and code are available at https://github.com/xiaomi-research/iot_spec_llm
format Preprint
id arxiv_https___arxiv_org_abs_2606_01099
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MiCU: End-to-End Smart Home Command Understanding with Large Language Model
Han, Haowei
Hu, Kexin
Cai, Weiwei
Zhang, Debiao
Qin, Bin
Wang, Yuxiang
Jiang, Jiawei
Yan, Xiao
Du, Bo
Computation and Language
Artificial Intelligence
Command understanding systems in smart home ecosystems can automate device control and substantially improve user experience. However, while they perform well on precise utterances (e.g., "turn on the bedroom light"), they struggle with ambiguous or misaligned commands (e.g., "make the bedroom cozy"). Large language models (LLMs) generalize well across various domains and can outperform traditional rule-based systems on such tasks, but their effectiveness is often constrained by scarce domain-specific data, insufficient task-specific adaptation, and high computational costs. In this paper, we propose an automated training data synthesis workflow using user logs and LLMs; then we build MiCU, a domain-specific LLM that excels at command understanding. Specifically, we employ curriculum learning to inject domain knowledge into the base LLM, then we enhance its reasoning ability via cold-start training combined with reinforcement learning (RL) guided by domain-specific thinking rules. Additionally, we introduce a token compression technique that condenses device description into a single special token, substantially reducing inference overhead and enabling \model-fast, an efficient variant optimized for long inputs. Extensive experiments show that MiCU significantly outperforms baselines, with an average accuracy gain of 20.01% across all device categories. We have deployed MiCU in the Xiaomi Home app, receiving approximately 1.7 million page views per day. Production evaluations show that MiCU reduces user correction rate by 1.57% and increases human audited accuracy by 32.05%. Our data and code are available at https://github.com/xiaomi-research/iot_spec_llm
title MiCU: End-to-End Smart Home Command Understanding with Large Language Model
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2606.01099