Solving Context Window Overflow in AI Agents
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915642973618176 |
|---|---|
| author | Labate, Anton Bulle de Sousa, Valesca Moura Fiorini, Sandro Rama Azevedo, Leonardo Guerreiro Thiago, Raphael Melo da Silva, Viviane Torres |
| author_facet | Labate, Anton Bulle de Sousa, Valesca Moura Fiorini, Sandro Rama Azevedo, Leonardo Guerreiro Thiago, Raphael Melo da Silva, Viviane Torres |
| contents | Large Language Models (LLMs) have become increasingly capable of interacting with external tools, granting access to specialized knowledge beyond their training data - critical in dynamic, knowledge-intensive domains such as Chemistry and Materials Science. However, large tool outputs can overflow the LLMs' context window, preventing task completion. Existing solutions such as truncation or summarization fail to preserve complete outputs, making them unsuitable for workflows requiring the full data. This work introduces a method that enables LLMs to process and utilize tool responses of arbitrary length without loss of information. By shifting the model's interaction from raw data to memory pointers, the method preserves tool functionality, allows seamless integration into agentic workflows, and reduces token usage and execution time. The proposed method is validated on a real-world Materials Science application that cannot be executed with conventional workflows, and its effectiveness is demonstrated via a comparative analysis where both methods succeed. In this experiment, the proposed approach consumed approximately seven times fewer tokens than the traditional workflow. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_22729 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Solving Context Window Overflow in AI Agents Labate, Anton Bulle de Sousa, Valesca Moura Fiorini, Sandro Rama Azevedo, Leonardo Guerreiro Thiago, Raphael Melo da Silva, Viviane Torres Artificial Intelligence Multiagent Systems Large Language Models (LLMs) have become increasingly capable of interacting with external tools, granting access to specialized knowledge beyond their training data - critical in dynamic, knowledge-intensive domains such as Chemistry and Materials Science. However, large tool outputs can overflow the LLMs' context window, preventing task completion. Existing solutions such as truncation or summarization fail to preserve complete outputs, making them unsuitable for workflows requiring the full data. This work introduces a method that enables LLMs to process and utilize tool responses of arbitrary length without loss of information. By shifting the model's interaction from raw data to memory pointers, the method preserves tool functionality, allows seamless integration into agentic workflows, and reduces token usage and execution time. The proposed method is validated on a real-world Materials Science application that cannot be executed with conventional workflows, and its effectiveness is demonstrated via a comparative analysis where both methods succeed. In this experiment, the proposed approach consumed approximately seven times fewer tokens than the traditional workflow. |
| title | Solving Context Window Overflow in AI Agents |
| topic | Artificial Intelligence Multiagent Systems |
| url | https://arxiv.org/abs/2511.22729 |