Infogent: An Agent-Based Framework for Web Information Aggregation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Reddy, Revanth Gangi, Mukherjee, Sagnik, Kim, Jeonghwan, Wang, Zhenhailong, Hakkani-Tur, Dilek, Ji, Heng
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917815714316288
author Reddy, Revanth Gangi
Mukherjee, Sagnik
Kim, Jeonghwan
Wang, Zhenhailong
Hakkani-Tur, Dilek
Ji, Heng
author_facet Reddy, Revanth Gangi
Mukherjee, Sagnik
Kim, Jeonghwan
Wang, Zhenhailong
Hakkani-Tur, Dilek
Ji, Heng
contents Despite seemingly performant web agents on the task-completion benchmarks, most existing methods evaluate the agents based on a presupposition: the web navigation task consists of linear sequence of actions with an end state that marks task completion. In contrast, our work focuses on web navigation for information aggregation, wherein the agent must explore different websites to gather information for a complex query. We consider web information aggregation from two different perspectives: (i) Direct API-driven Access relies on a text-only view of the Web, leveraging external tools such as Google Search API to navigate the web and a scraper to extract website contents. (ii) Interactive Visual Access uses screenshots of the webpages and requires interaction with the browser to navigate and access information. Motivated by these diverse information access settings, we introduce Infogent, a novel modular framework for web information aggregation involving three distinct components: Navigator, Extractor and Aggregator. Experiments on different information access settings demonstrate Infogent beats an existing SOTA multi-agent search framework by 7% under Direct API-Driven Access on FRAMES, and improves over an existing information-seeking web agent by 4.3% under Interactive Visual Access on AssistantBench.
format Preprint
id arxiv_https___arxiv_org_abs_2410_19054
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Infogent: An Agent-Based Framework for Web Information Aggregation
Reddy, Revanth Gangi
Mukherjee, Sagnik
Kim, Jeonghwan
Wang, Zhenhailong
Hakkani-Tur, Dilek
Ji, Heng
Artificial Intelligence
Computation and Language
Despite seemingly performant web agents on the task-completion benchmarks, most existing methods evaluate the agents based on a presupposition: the web navigation task consists of linear sequence of actions with an end state that marks task completion. In contrast, our work focuses on web navigation for information aggregation, wherein the agent must explore different websites to gather information for a complex query. We consider web information aggregation from two different perspectives: (i) Direct API-driven Access relies on a text-only view of the Web, leveraging external tools such as Google Search API to navigate the web and a scraper to extract website contents. (ii) Interactive Visual Access uses screenshots of the webpages and requires interaction with the browser to navigate and access information. Motivated by these diverse information access settings, we introduce Infogent, a novel modular framework for web information aggregation involving three distinct components: Navigator, Extractor and Aggregator. Experiments on different information access settings demonstrate Infogent beats an existing SOTA multi-agent search framework by 7% under Direct API-Driven Access on FRAMES, and improves over an existing information-seeking web agent by 4.3% under Interactive Visual Access on AssistantBench.
title Infogent: An Agent-Based Framework for Web Information Aggregation
topic Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2410.19054