Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2504.10055 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908317859708928 |
|---|---|
| author | Wulff, Theodor Maharjan, Rahul Singh Chi, Xinyun Cangelosi, Angelo |
| author_facet | Wulff, Theodor Maharjan, Rahul Singh Chi, Xinyun Cangelosi, Angelo |
| contents | An agent's intention often remains hidden behind the black-box nature of embodied policies. Communication using natural language statements that describe the next action can provide transparency towards the agent's behavior. We aim to insert transparent behavior directly into the learning process, by transforming the problem of policy learning into a language generation problem and combining it with traditional autoregressive modelling. The resulting model produces transparent natural language statements followed by tokens representing the specific actions to solve long-horizon tasks in the Language-Table environment. Following previous work, the model is able to learn to produce a policy represented by special discretized tokens in an autoregressive manner. We place special emphasis on investigating the relationship between predicting actions and producing high-quality language for a transparent agent. We find that in many cases both the quality of the action trajectory and the transparent statement increase when they are generated simultaneously. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_10055 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Joint Action Language Modelling for Transparent Policy Execution Wulff, Theodor Maharjan, Rahul Singh Chi, Xinyun Cangelosi, Angelo Robotics Computation and Language An agent's intention often remains hidden behind the black-box nature of embodied policies. Communication using natural language statements that describe the next action can provide transparency towards the agent's behavior. We aim to insert transparent behavior directly into the learning process, by transforming the problem of policy learning into a language generation problem and combining it with traditional autoregressive modelling. The resulting model produces transparent natural language statements followed by tokens representing the specific actions to solve long-horizon tasks in the Language-Table environment. Following previous work, the model is able to learn to produce a policy represented by special discretized tokens in an autoregressive manner. We place special emphasis on investigating the relationship between predicting actions and producing high-quality language for a transparent agent. We find that in many cases both the quality of the action trajectory and the transparent statement increase when they are generated simultaneously. |
| title | Joint Action Language Modelling for Transparent Policy Execution |
| topic | Robotics Computation and Language |
| url | https://arxiv.org/abs/2504.10055 |