Agentic Search in the Wild: Intents and Trajectory Dynamics from 14M+ Real Search Requests

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ning, Jingjie, Coelho, João, Kong, Yibo, Long, Yunfan, Martins, Bruno, Magalhães, João, Callan, Jamie, Xiong, Chenyan
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914514802311168
author Ning, Jingjie
Coelho, João
Kong, Yibo
Long, Yunfan
Martins, Bruno
Magalhães, João
Callan, Jamie
Xiong, Chenyan
author_facet Ning, Jingjie
Coelho, João
Kong, Yibo
Long, Yunfan
Martins, Bruno
Magalhães, João
Callan, Jamie
Xiong, Chenyan
contents LLM-powered search agents are increasingly being used for multi-step information seeking tasks, yet the IR community lacks empirical understanding of how agentic search sessions unfold and how retrieved evidence is reflected in later queries. This paper presents a large-scale log analysis of agentic search based on 14.44M search requests (3.97M sessions) collected from DeepResearchGym, i.e., an open-source search API accessed by external agentic clients. We sessionize the logs, assign session-level intents and step-wise query-reformulation labels using LLM-based annotation, and propose Context-driven Term Adoption Rate (CTAR) to quantify whether newly introduced query terms are lexically traceable to previously retrieved evidence. Our analyses reveal distinctive behavioral patterns. First, over 90\% of multi-turn sessions contain at most ten steps, and 89\% of inter-step intervals fall under one minute. Second, behavior varies by intent. Fact-seeking sessions exhibit high repetition that increases over time, while sessions requiring reasoning sustain broader exploration. Third, query reformulations are often traceable to retrieved evidence across steps. On average, 54\% of newly introduced query terms appear in the accumulated evidence context, with additional traceability to earlier steps beyond the most recent retrieval. These findings provide candidate signals for repetition-aware stopping, intent-adaptive retrieval budgeting, and explicit cross-step context tracking. We released the anonymized logs, making them available at a public HuggingFace~\chref{https://huggingface.co/datasets/cx-cmu/deepresearchgym-agentic-search-logs}{repository}.
format Preprint
id arxiv_https___arxiv_org_abs_2601_17617
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Agentic Search in the Wild: Intents and Trajectory Dynamics from 14M+ Real Search Requests
Ning, Jingjie
Coelho, João
Kong, Yibo
Long, Yunfan
Martins, Bruno
Magalhães, João
Callan, Jamie
Xiong, Chenyan
Information Retrieval
Computation and Language
H.3.3
LLM-powered search agents are increasingly being used for multi-step information seeking tasks, yet the IR community lacks empirical understanding of how agentic search sessions unfold and how retrieved evidence is reflected in later queries. This paper presents a large-scale log analysis of agentic search based on 14.44M search requests (3.97M sessions) collected from DeepResearchGym, i.e., an open-source search API accessed by external agentic clients. We sessionize the logs, assign session-level intents and step-wise query-reformulation labels using LLM-based annotation, and propose Context-driven Term Adoption Rate (CTAR) to quantify whether newly introduced query terms are lexically traceable to previously retrieved evidence. Our analyses reveal distinctive behavioral patterns. First, over 90\% of multi-turn sessions contain at most ten steps, and 89\% of inter-step intervals fall under one minute. Second, behavior varies by intent. Fact-seeking sessions exhibit high repetition that increases over time, while sessions requiring reasoning sustain broader exploration. Third, query reformulations are often traceable to retrieved evidence across steps. On average, 54\% of newly introduced query terms appear in the accumulated evidence context, with additional traceability to earlier steps beyond the most recent retrieval. These findings provide candidate signals for repetition-aware stopping, intent-adaptive retrieval budgeting, and explicit cross-step context tracking. We released the anonymized logs, making them available at a public HuggingFace~\chref{https://huggingface.co/datasets/cx-cmu/deepresearchgym-agentic-search-logs}{repository}.
title Agentic Search in the Wild: Intents and Trajectory Dynamics from 14M+ Real Search Requests
topic Information Retrieval
Computation and Language
H.3.3
url https://arxiv.org/abs/2601.17617