Towards Natural Language Environment: Understanding Seamless Natural-Language-Based Human-Multi-Robot Interactions
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918299294498816 |
|---|---|
| author | Liu, Ziyi Wang, Xinyi Hsia, Shao-Kang Zhu, Chenfei Zhu, Zhengzhe Hu, Xiyun Ostrowski, Anastasia Kouvaras Ramani, Karthik |
| author_facet | Liu, Ziyi Wang, Xinyi Hsia, Shao-Kang Zhu, Chenfei Zhu, Zhengzhe Hu, Xiyun Ostrowski, Anastasia Kouvaras Ramani, Karthik |
| contents | As multiple robots are expected to coexist in future households, natural language is increasingly envisioned as a primary medium for human-robot and robot-robot communication. This paper introduces the concept of a Natural Language Environment (NLE), defined as an interaction space in which humans and multiple heterogeneous robots coordinate primarily through natural language.
Rather than proposing a deployable system, this work aims to explore the design space of such environments. We first synthesize prior work on language-based human-robot interaction to derive a preliminary design space for NLEs. We then conduct a role-playing study in virtual reality to investigate how people conceptualize, negotiate, and coordinate human-multi-robot interactions within this imagined environment.
Based on qualitative and quantitative analysis, we refine the preliminary design space and derive design implications that highlight key tensions and opportunities around task coordination dominance, robot autonomy, and robot personality in Natural Language Environments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_13338 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Towards Natural Language Environment: Understanding Seamless Natural-Language-Based Human-Multi-Robot Interactions Liu, Ziyi Wang, Xinyi Hsia, Shao-Kang Zhu, Chenfei Zhu, Zhengzhe Hu, Xiyun Ostrowski, Anastasia Kouvaras Ramani, Karthik Human-Computer Interaction Robotics As multiple robots are expected to coexist in future households, natural language is increasingly envisioned as a primary medium for human-robot and robot-robot communication. This paper introduces the concept of a Natural Language Environment (NLE), defined as an interaction space in which humans and multiple heterogeneous robots coordinate primarily through natural language. Rather than proposing a deployable system, this work aims to explore the design space of such environments. We first synthesize prior work on language-based human-robot interaction to derive a preliminary design space for NLEs. We then conduct a role-playing study in virtual reality to investigate how people conceptualize, negotiate, and coordinate human-multi-robot interactions within this imagined environment. Based on qualitative and quantitative analysis, we refine the preliminary design space and derive design implications that highlight key tensions and opportunities around task coordination dominance, robot autonomy, and robot personality in Natural Language Environments. |
| title | Towards Natural Language Environment: Understanding Seamless Natural-Language-Based Human-Multi-Robot Interactions |
| topic | Human-Computer Interaction Robotics |
| url | https://arxiv.org/abs/2601.13338 |