An Intelligent AI glasses System with Multi-Agent Architecture for Real-Time Voice Processing and Task Execution
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912814182957056 |
|---|---|
| author | Chen, Sheng-Kai Wu, Jyh-Horng Lin, Ching-Yao Lin, Yen-Ting |
| author_facet | Chen, Sheng-Kai Wu, Jyh-Horng Lin, Ching-Yao Lin, Yen-Ting |
| contents | This paper presents an AI glasses system that integrates real-time voice processing, artificial intelligence(AI) agents, and cross-network streaming capabilities. The system employs dual-agent architecture where Agent 01 handles Automatic Speech Recognition (ASR) and Agent 02 manages AI processing through local Large Language Models (LLMs), Model Context Protocol (MCP) tools, and Retrieval-Augmented Generation (RAG). The system supports real-time RTSP streaming for voice and video data transmission, eye tracking data collection, and remote task execution through RabbitMQ messaging. Implementation demonstrates successful voice command processing with multilingual support and cross-platform task execution capabilities. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_06235 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | An Intelligent AI glasses System with Multi-Agent Architecture for Real-Time Voice Processing and Task Execution Chen, Sheng-Kai Wu, Jyh-Horng Lin, Ching-Yao Lin, Yen-Ting Sound Artificial Intelligence Human-Computer Interaction This paper presents an AI glasses system that integrates real-time voice processing, artificial intelligence(AI) agents, and cross-network streaming capabilities. The system employs dual-agent architecture where Agent 01 handles Automatic Speech Recognition (ASR) and Agent 02 manages AI processing through local Large Language Models (LLMs), Model Context Protocol (MCP) tools, and Retrieval-Augmented Generation (RAG). The system supports real-time RTSP streaming for voice and video data transmission, eye tracking data collection, and remote task execution through RabbitMQ messaging. Implementation demonstrates successful voice command processing with multilingual support and cross-platform task execution capabilities. |
| title | An Intelligent AI glasses System with Multi-Agent Architecture for Real-Time Voice Processing and Task Execution |
| topic | Sound Artificial Intelligence Human-Computer Interaction |
| url | https://arxiv.org/abs/2601.06235 |