Beyond Natural Language: LLMs Leveraging Alternative Formats for Enhanced Reasoning and Communication
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866911924735705088 |
|---|---|
| author | Chen, Weize Yuan, Chenfei Yuan, Jiarui Su, Yusheng Qian, Chen Yang, Cheng Xie, Ruobing Liu, Zhiyuan Sun, Maosong |
| author_facet | Chen, Weize Yuan, Chenfei Yuan, Jiarui Su, Yusheng Qian, Chen Yang, Cheng Xie, Ruobing Liu, Zhiyuan Sun, Maosong |
| contents | Natural language (NL) has long been the predominant format for human cognition and communication, and by extension, has been similarly pivotal in the development and application of Large Language Models (LLMs). Yet, besides NL, LLMs have seen various non-NL formats during pre-training, such as code and logical expression. NL's status as the optimal format for LLMs, particularly in single-LLM reasoning and multi-agent communication, has not been thoroughly examined. In this work, we challenge the default use of NL by exploring the utility of non-NL formats in these contexts. We show that allowing LLMs to autonomously select the most suitable format before reasoning or communicating leads to a 3.3 to 5.7\% improvement in reasoning efficiency for different LLMs, and up to a 72.7\% reduction in token usage in multi-agent communication, all while maintaining communicative effectiveness. Our comprehensive analysis further reveals that LLMs can devise a format from limited task instructions and that the devised format is effectively transferable across different LLMs. Intriguingly, the structured communication format decided by LLMs exhibits notable parallels with established agent communication languages, suggesting a natural evolution towards efficient, structured communication in agent communication. Our code is released at \url{https://github.com/thunlp/AutoForm}. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_18439 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Beyond Natural Language: LLMs Leveraging Alternative Formats for Enhanced Reasoning and Communication Chen, Weize Yuan, Chenfei Yuan, Jiarui Su, Yusheng Qian, Chen Yang, Cheng Xie, Ruobing Liu, Zhiyuan Sun, Maosong Computation and Language Artificial Intelligence Natural language (NL) has long been the predominant format for human cognition and communication, and by extension, has been similarly pivotal in the development and application of Large Language Models (LLMs). Yet, besides NL, LLMs have seen various non-NL formats during pre-training, such as code and logical expression. NL's status as the optimal format for LLMs, particularly in single-LLM reasoning and multi-agent communication, has not been thoroughly examined. In this work, we challenge the default use of NL by exploring the utility of non-NL formats in these contexts. We show that allowing LLMs to autonomously select the most suitable format before reasoning or communicating leads to a 3.3 to 5.7\% improvement in reasoning efficiency for different LLMs, and up to a 72.7\% reduction in token usage in multi-agent communication, all while maintaining communicative effectiveness. Our comprehensive analysis further reveals that LLMs can devise a format from limited task instructions and that the devised format is effectively transferable across different LLMs. Intriguingly, the structured communication format decided by LLMs exhibits notable parallels with established agent communication languages, suggesting a natural evolution towards efficient, structured communication in agent communication. Our code is released at \url{https://github.com/thunlp/AutoForm}. |
| title | Beyond Natural Language: LLMs Leveraging Alternative Formats for Enhanced Reasoning and Communication |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2402.18439 |