LiveWeb-IE: A Benchmark For Online Web Information Extraction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yang, Seungbin, Kim, Jihwan, Choi, Jaemin, Kim, Dongjin, Yang, Soyoung, Park, ChaeHun, Choo, Jaegul
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918388015562752
author Yang, Seungbin
Kim, Jihwan
Choi, Jaemin
Kim, Dongjin
Yang, Soyoung
Park, ChaeHun
Choo, Jaegul
author_facet Yang, Seungbin
Kim, Jihwan
Choi, Jaemin
Kim, Dongjin
Yang, Soyoung
Park, ChaeHun
Choo, Jaegul
contents Web information extraction (WIE) is the task of automatically extracting data from web pages, offering high utility for various applications. The evaluation of WIE systems has traditionally relied on benchmarks built from HTML snapshots captured at a single point in time. However, this offline evaluation paradigm fails to account for the temporally evolving nature of the web; consequently, performance on these static benchmarks often fails to generalize to dynamic real-world scenarios. To bridge this gap, we introduce \dataset, a new benchmark designed for evaluating WIE systems directly against live websites. Based on trusted and permission-granted websites, we curate natural language queries that require information extraction of various data categories, such as text, images, and hyperlinks. We further design these queries to represent four levels of complexity, based on the number and cardinality of attributes to be extracted, enabling a granular assessment of WIE systems. In addition, we propose Visual Grounding Scraper (VGS), a novel multi-stage agentic framework that mimics human cognitive processes by visually narrowing down web page content to extract desired information. Extensive experiments across diverse backbone models demonstrate the effectiveness and robustness of VGS. We believe that this study lays the foundation for developing practical and robust WIE systems.
format Preprint
id arxiv_https___arxiv_org_abs_2603_13773
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle LiveWeb-IE: A Benchmark For Online Web Information Extraction
Yang, Seungbin
Kim, Jihwan
Choi, Jaemin
Kim, Dongjin
Yang, Soyoung
Park, ChaeHun
Choo, Jaegul
Computation and Language
Web information extraction (WIE) is the task of automatically extracting data from web pages, offering high utility for various applications. The evaluation of WIE systems has traditionally relied on benchmarks built from HTML snapshots captured at a single point in time. However, this offline evaluation paradigm fails to account for the temporally evolving nature of the web; consequently, performance on these static benchmarks often fails to generalize to dynamic real-world scenarios. To bridge this gap, we introduce \dataset, a new benchmark designed for evaluating WIE systems directly against live websites. Based on trusted and permission-granted websites, we curate natural language queries that require information extraction of various data categories, such as text, images, and hyperlinks. We further design these queries to represent four levels of complexity, based on the number and cardinality of attributes to be extracted, enabling a granular assessment of WIE systems. In addition, we propose Visual Grounding Scraper (VGS), a novel multi-stage agentic framework that mimics human cognitive processes by visually narrowing down web page content to extract desired information. Extensive experiments across diverse backbone models demonstrate the effectiveness and robustness of VGS. We believe that this study lays the foundation for developing practical and robust WIE systems.
title LiveWeb-IE: A Benchmark For Online Web Information Extraction
topic Computation and Language
url https://arxiv.org/abs/2603.13773