Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2205.12420 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909239764582400 |
|---|---|
| author | Wu, Te-Lin Zhang, Caiqi Hu, Qingyuan Spangher, Alex Peng, Nanyun |
| author_facet | Wu, Te-Lin Zhang, Caiqi Hu, Qingyuan Spangher, Alex Peng, Nanyun |
| contents | The ability to infer pre- and postconditions of an action is vital for comprehending complex instructions, and is essential for applications such as autonomous instruction-guided agents and assistive AI that supports humans to perform physical tasks. In this work, we propose a task dubbed action condition inference, and collecting a high-quality, human annotated dataset of preconditions and postconditions of actions in instructional manuals. We propose a weakly supervised approach to automatically construct large-scale training instances from online instructional manuals, and curate a densely human-annotated and validated dataset to study how well the current NLP models can infer action-condition dependencies in the instruction texts. We design two types of models differ by whether contextualized and global information is leveraged, as well as various combinations of heuristics to construct the weak supervisions. Our experimental results show a >20% F1-score improvement with considering the entire instruction contexts and a >6% F1-score benefit with the proposed heuristics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2205_12420 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | Learning Action Conditions from Instructional Manuals for Instruction Understanding Wu, Te-Lin Zhang, Caiqi Hu, Qingyuan Spangher, Alex Peng, Nanyun Computation and Language The ability to infer pre- and postconditions of an action is vital for comprehending complex instructions, and is essential for applications such as autonomous instruction-guided agents and assistive AI that supports humans to perform physical tasks. In this work, we propose a task dubbed action condition inference, and collecting a high-quality, human annotated dataset of preconditions and postconditions of actions in instructional manuals. We propose a weakly supervised approach to automatically construct large-scale training instances from online instructional manuals, and curate a densely human-annotated and validated dataset to study how well the current NLP models can infer action-condition dependencies in the instruction texts. We design two types of models differ by whether contextualized and global information is leveraged, as well as various combinations of heuristics to construct the weak supervisions. Our experimental results show a >20% F1-score improvement with considering the entire instruction contexts and a >6% F1-score benefit with the proposed heuristics. |
| title | Learning Action Conditions from Instructional Manuals for Instruction Understanding |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2205.12420 |