Kolb-Based Experiential Learning for Generalist Agents with Human-Level Kaggle Data Science Performance
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909787403321344 |
|---|---|
| author | Grosnit, Antoine Maraval, Alexandre N, Refinath S Zhao, Zichao Doran, James Paolo, Giuseppe Thomas, Albert Gonzalez, Jonas Kumar, Abhineet Khandelwal, Khyati Benechehab, Abdelhakim Cherkaoui, Hamza El-Hili, Youssef Attia Shao, Kun Hao, Jianye Yao, Jun Kégl, Balázs Bou-Ammar, Haitham Wang, Jun |
| author_facet | Grosnit, Antoine Maraval, Alexandre N, Refinath S Zhao, Zichao Doran, James Paolo, Giuseppe Thomas, Albert Gonzalez, Jonas Kumar, Abhineet Khandelwal, Khyati Benechehab, Abdelhakim Cherkaoui, Hamza El-Hili, Youssef Attia Shao, Kun Hao, Jianye Yao, Jun Kégl, Balázs Bou-Ammar, Haitham Wang, Jun |
| contents | Human expertise emerges through iterative cycles of interaction, reflection, and internal model updating, which are central to cognitive theories such as Kolb's experiential learning and Vygotsky's zone of proximal development. In contrast, current AI systems, particularly LLM agents, rely on static pre-training or rigid workflows, lacking mechanisms for continual adaptation. Recent studies identified early cognitive traits in LLM agents (reflection, revision, and self-correction) suggesting foundational elements of human-like experiential learning. Thus the key question: Can we design LLM agents capable of structured, cognitively grounded learning similar to human processes? In response, we propose a computational framework of Kolb's learning cycle with Vygotsky's ZPD for autonomous agents. Our architecture separates extrinsic (environment interaction) and intrinsic (internal reflection/abstraction) functions, enabling cognitively grounded scaffolded learning, where the agent initially learns within structured environments, followed by open-ended generalisation. This approach empowers agents to master complex tasks ; domains that traditional fine-tuning or simple reflective methods could not tackle effectively. Its potential is powerfully demonstrated via direct comparison with humans in real-world Kaggle data science competitions. Learning fully automated data science code generation across 81 tasks, our system, Agent K, demonstrated the ability to perform the entire workflow autonomously, achieving an Elo-MMR score of 1694, beyond median score of the Kaggle Masters (the top 2% among 200,000 users) of our study. With 9 gold, 8 silver, and 12 bronze medals level performance - including 4 gold and 4 silver on prize-awarding competitions - Agent K is the 1st AI system to successfully integrate Kolb- and Vygotsky-inspired human cognitive learning, marking a major step toward generalist AI. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_03562 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Kolb-Based Experiential Learning for Generalist Agents with Human-Level Kaggle Data Science Performance Grosnit, Antoine Maraval, Alexandre N, Refinath S Zhao, Zichao Doran, James Paolo, Giuseppe Thomas, Albert Gonzalez, Jonas Kumar, Abhineet Khandelwal, Khyati Benechehab, Abdelhakim Cherkaoui, Hamza El-Hili, Youssef Attia Shao, Kun Hao, Jianye Yao, Jun Kégl, Balázs Bou-Ammar, Haitham Wang, Jun Machine Learning Artificial Intelligence Human expertise emerges through iterative cycles of interaction, reflection, and internal model updating, which are central to cognitive theories such as Kolb's experiential learning and Vygotsky's zone of proximal development. In contrast, current AI systems, particularly LLM agents, rely on static pre-training or rigid workflows, lacking mechanisms for continual adaptation. Recent studies identified early cognitive traits in LLM agents (reflection, revision, and self-correction) suggesting foundational elements of human-like experiential learning. Thus the key question: Can we design LLM agents capable of structured, cognitively grounded learning similar to human processes? In response, we propose a computational framework of Kolb's learning cycle with Vygotsky's ZPD for autonomous agents. Our architecture separates extrinsic (environment interaction) and intrinsic (internal reflection/abstraction) functions, enabling cognitively grounded scaffolded learning, where the agent initially learns within structured environments, followed by open-ended generalisation. This approach empowers agents to master complex tasks ; domains that traditional fine-tuning or simple reflective methods could not tackle effectively. Its potential is powerfully demonstrated via direct comparison with humans in real-world Kaggle data science competitions. Learning fully automated data science code generation across 81 tasks, our system, Agent K, demonstrated the ability to perform the entire workflow autonomously, achieving an Elo-MMR score of 1694, beyond median score of the Kaggle Masters (the top 2% among 200,000 users) of our study. With 9 gold, 8 silver, and 12 bronze medals level performance - including 4 gold and 4 silver on prize-awarding competitions - Agent K is the 1st AI system to successfully integrate Kolb- and Vygotsky-inspired human cognitive learning, marking a major step toward generalist AI. |
| title | Kolb-Based Experiential Learning for Generalist Agents with Human-Level Kaggle Data Science Performance |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2411.03562 |