XPath Agent: An Efficient XPath Programming Agent Based on LLM for Web Crawler
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913703034617856 |
|---|---|
| author | Li, Yu Wang, Bryce Luan, Xinyu |
| author_facet | Li, Yu Wang, Bryce Luan, Xinyu |
| contents | We present XPath Agent, a production-ready XPath programming agent specifically designed for web crawling and web GUI testing. A key feature of XPath Agent is its ability to automatically generate XPath queries from a set of sampled web pages using a single natural language query. To demonstrate its effectiveness, we benchmark XPath Agent against a state-of-the-art XPath programming agent across a range of web crawling tasks. Our results show that XPath Agent achieves comparable performance metrics while significantly reducing token usage and improving clock-time efficiency. The well-designed two-stage pipeline allows for seamless integration into existing web crawling or web GUI testing workflows, thereby saving time and effort in manual XPath query development. The source code for XPath Agent is available at https://github.com/eavae/feilian. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_15688 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | XPath Agent: An Efficient XPath Programming Agent Based on LLM for Web Crawler Li, Yu Wang, Bryce Luan, Xinyu Information Retrieval Artificial Intelligence Software Engineering 68T50 I.2.7 We present XPath Agent, a production-ready XPath programming agent specifically designed for web crawling and web GUI testing. A key feature of XPath Agent is its ability to automatically generate XPath queries from a set of sampled web pages using a single natural language query. To demonstrate its effectiveness, we benchmark XPath Agent against a state-of-the-art XPath programming agent across a range of web crawling tasks. Our results show that XPath Agent achieves comparable performance metrics while significantly reducing token usage and improving clock-time efficiency. The well-designed two-stage pipeline allows for seamless integration into existing web crawling or web GUI testing workflows, thereby saving time and effort in manual XPath query development. The source code for XPath Agent is available at https://github.com/eavae/feilian. |
| title | XPath Agent: An Efficient XPath Programming Agent Based on LLM for Web Crawler |
| topic | Information Retrieval Artificial Intelligence Software Engineering 68T50 I.2.7 |
| url | https://arxiv.org/abs/2502.15688 |