Cover Image

Web Page Classification using LLMs for Crawling Support

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sasazawa, Yuichi, Sogawa, Yasuhiro
Format:	Preprint
Published:	2025
Subjects:	Information Retrieval Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Layout Generation Agents with Large Language Models
by: Sasazawa, Yuichi, et al.
Published: (2024)

The Synergy of Automated Pipelines with Prompt Engineering and Generative AI in Web Crawling
by: Huang, Chau-Jian
Published: (2024)

Multilingual Attribute Extraction from News Web Pages
by: Bedrin, Pavel, et al.
Published: (2025)

Multi-Record Web Page Information Extraction From News Websites
by: Kustenkov, Alexander, et al.
Published: (2025)

Movie Recommendation using Web Crawling
by: Raj, Pronit, et al.
Published: (2024)

Text Clustering as Classification with LLMs
by: Huang, Chen, et al.
Published: (2024)

Neural Prioritisation for Web Crawling
by: Pezzuti, Francesca, et al.
Published: (2025)

Multi-Document Financial Question Answering using LLMs
by: Shah, Shalin, et al.
Published: (2024)

TOPICAL: TOPIC Pages AutomagicaLly
by: Giorgi, John, et al.
Published: (2024)

Cancer Type, Stage and Prognosis Assessment from Pathology Reports using LLMs
by: Saluja, Rachit, et al.
Published: (2025)

DEXTER: A Benchmark for open-domain Complex Question Answering using LLMs
by: Prabhu, Venktesh V. Deepali, et al.
Published: (2024)

Document Quality Scoring for Web Crawling
by: Pezzuti, Francesca, et al.
Published: (2025)

Efficient Crawling for Scalable Web Data Acquisition (Extended Version)
by: Gauquier, Antoine, et al.
Published: (2026)

LLM-as-classifier: Semi-Supervised, Iterative Framework for Hierarchical Text Classification using Large Language Models
by: You, Doohee, et al.
Published: (2025)

HEISIR: Hierarchical Expansion of Inverted Semantic Indexing for Training-free Retrieval of Conversational Data using LLMs
by: Kim, Sangyeop, et al.
Published: (2025)

An Index-based Approach for Efficient and Effective Web Content Extraction
by: Chen, Yihan, et al.
Published: (2025)

The Pre-Training Study of Expanded-SPLADE Models on Web Document Titles
by: Kim, Hiun, et al.
Published: (2026)

Combining Language and Graph Models for Semi-structured Information Extraction on the Web
by: Hong, Zhi, et al.
Published: (2024)

From Relevance to Authority: Authority-aware Generative Retrieval in Web Search Engines
by: Lee, Sunkyung, et al.
Published: (2026)

Best Practices for Distilling Large Language Models into BERT for Web Search Ranking
by: Ye, Dezhi, et al.
Published: (2024)

MiLQ: Benchmarking IR Models for Bilingual Web Search with Mixed Language Queries
by: Kim, Jonghwi, et al.
Published: (2025)

RAG-Enhanced Large Language Models for Dynamic Content Expiration Prediction in Web Search
by: Chen, Tingyu, et al.
Published: (2026)

Redefining Retrieval Evaluation in the Era of LLMs
by: Trappolini, Giovanni, et al.
Published: (2025)

LTRR: Learning To Rank Retrievers for LLMs
by: Kim, To Eun, et al.
Published: (2025)

BASES: Large-scale Web Search User Simulation with Large Language Model based Agents
by: Ren, Ruiyang, et al.
Published: (2024)

Navigating the Post-API Dilemma | Search Engine Results Pages Present a Biased View of Social Media Data
by: Poudel, Amrit, et al.
Published: (2024)

Political Events using RAG with LLMs
by: Arslan, Muhammad, et al.
Published: (2025)

Predicting Movie Hits Before They Happen with LLMs
by: Agah, Shaghayegh, et al.
Published: (2025)

Generative Pseudo-Labeling for Pre-Ranking with LLMs
by: Bi, Junyu, et al.
Published: (2026)

Evaluating LLMs for Gender Disparities in Notable Persons
by: Rhue, Lauren, et al.
Published: (2024)

Taxonomy-Guided Zero-Shot Recommendations with LLMs
by: Liang, Yueqing, et al.
Published: (2024)

Leveraging Generative Models for Real-Time Query-Driven Text Summarization in Large-Scale Web Search
by: Xiong, Zeyu, et al.
Published: (2025)

WeKnow-RAG: An Adaptive Approach for Retrieval-Augmented Generation Integrating Web Search and Knowledge Graphs
by: Xie, Weijian, et al.
Published: (2024)

CWRCzech: 100M Query-Document Czech Click Dataset and Its Application to Web Relevance Ranking
by: Vonášek, Josef, et al.
Published: (2024)

A Global-Local Attention Mechanism for Relation Classification
by: Sun, Yiping
Published: (2024)

ScholarSearch: Benchmarking Scholar Searching Ability of LLMs
by: Zhou, Junting, et al.
Published: (2025)

Study on LLMs for Promptagator-Style Dense Retriever Training
by: Gwon, Daniel, et al.
Published: (2025)

Information Extraction From Fiscal Documents Using LLMs
by: Aggarwal, Vikram, et al.
Published: (2025)

HyperG: Hypergraph-Enhanced LLMs for Structured Knowledge
by: Huang, Sirui, et al.
Published: (2025)

A Systematic Study of Pseudo-Relevance Feedback with LLMs
by: Jedidi, Nour, et al.
Published: (2026)