Flows: Building Blocks of Reasoning and Collaborating AI
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910320381919232 |
|---|---|
| author | Josifoski, Martin Klein, Lars Peyrard, Maxime Baldwin, Nicolas Li, Yifei Geng, Saibo Schnitzler, Julian Paul Yao, Yuxing Wei, Jiheng Paul, Debjit West, Robert |
| author_facet | Josifoski, Martin Klein, Lars Peyrard, Maxime Baldwin, Nicolas Li, Yifei Geng, Saibo Schnitzler, Julian Paul Yao, Yuxing Wei, Jiheng Paul, Debjit West, Robert |
| contents | Recent advances in artificial intelligence (AI) have produced highly capable and controllable systems. This creates unprecedented opportunities for structured reasoning as well as collaboration among multiple AI systems and humans. To fully realize this potential, it is essential to develop a principled way of designing and studying such structured interactions. For this purpose, we introduce the conceptual framework Flows. Flows are self-contained building blocks of computation, with an isolated state, communicating through a standardized message-based interface. This modular design simplifies the process of creating Flows by allowing them to be recursively composed into arbitrarily nested interactions and is inherently concurrency-friendly. Crucially, any interaction can be implemented using this framework, including prior work on AI-AI and human-AI interactions, prompt engineering schemes, and tool augmentation. We demonstrate the potential of Flows on competitive coding, a challenging task on which even GPT-4 struggles. Our results suggest that structured reasoning and collaboration substantially improve generalization, with AI-only Flows adding +21 and human-AI Flows adding +54 absolute points in terms of solve rate. To support rapid and rigorous research, we introduce the aiFlows library embodying Flows. The aiFlows library is available at https://github.com/epfl-dlab/aiflows. Data and Flows for reproducing our experiments are available at https://github.com/epfl-dlab/cc_flows. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2308_01285 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Flows: Building Blocks of Reasoning and Collaborating AI Josifoski, Martin Klein, Lars Peyrard, Maxime Baldwin, Nicolas Li, Yifei Geng, Saibo Schnitzler, Julian Paul Yao, Yuxing Wei, Jiheng Paul, Debjit West, Robert Artificial Intelligence Human-Computer Interaction Recent advances in artificial intelligence (AI) have produced highly capable and controllable systems. This creates unprecedented opportunities for structured reasoning as well as collaboration among multiple AI systems and humans. To fully realize this potential, it is essential to develop a principled way of designing and studying such structured interactions. For this purpose, we introduce the conceptual framework Flows. Flows are self-contained building blocks of computation, with an isolated state, communicating through a standardized message-based interface. This modular design simplifies the process of creating Flows by allowing them to be recursively composed into arbitrarily nested interactions and is inherently concurrency-friendly. Crucially, any interaction can be implemented using this framework, including prior work on AI-AI and human-AI interactions, prompt engineering schemes, and tool augmentation. We demonstrate the potential of Flows on competitive coding, a challenging task on which even GPT-4 struggles. Our results suggest that structured reasoning and collaboration substantially improve generalization, with AI-only Flows adding +21 and human-AI Flows adding +54 absolute points in terms of solve rate. To support rapid and rigorous research, we introduce the aiFlows library embodying Flows. The aiFlows library is available at https://github.com/epfl-dlab/aiflows. Data and Flows for reproducing our experiments are available at https://github.com/epfl-dlab/cc_flows. |
| title | Flows: Building Blocks of Reasoning and Collaborating AI |
| topic | Artificial Intelligence Human-Computer Interaction |
| url | https://arxiv.org/abs/2308.01285 |