Proximity to seed sites_Proposal for measurement_DavidVesterlund_10.5281/zenodo.17401322
Fuente:
Zenodo
Gespeichert in:
| 1. Verfasser: | |
|---|---|
| Format: | Recurso digital |
| Veröffentlicht: |
Zenodo
2025
|
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866901152673562624 |
|---|---|
| author | Vesterlund, David |
| author_facet | Vesterlund, David |
| contents | <div> <div> <div> <p>Search engines bootstrap crawling and ranking from a set of trusted seed sites. While the exact composition of these seeds is undisclosed, theory and patents on link-based ranking and trust propagation imply that shorter graph distance to seeds should correlate with faster discovery, recrawl, and indexing (lower time-to-first-index, TTFI). This article advances a research program for measuring seed proximity indirectly via indexing latency, while presenting a critical discussion of confounders such as crawl budget, news freshness mechanisms, sitemaps/notifications, JavaScript rendering load, internal linking, and server quality. <br>We synthesize prior literature on PageRank, TrustRank, web crawling, and Google’s public guidance on crawl budget; review empirical anecdotes from Swedish media sites; and propose an experimental design that uses survival analysis and difference-in-differences (DiD) around new inlinks from seed candidates. We call for collaborative data collection to validate whether indexing latency can serve as a robust proxy for seed proximity in practice.</p> </div> </div> </div> |
| format | Recurso digital |
| id | zenodo_https___doi_org_10_5281_zenodo_17401322 |
| institution | Zenodo |
| language | |
| publishDate | 2025 |
| publisher | Zenodo |
| record_format | zenodo |
| spellingShingle | Proximity to seed sites_Proposal for measurement_DavidVesterlund_10.5281/zenodo.17401322 Vesterlund, David <div> <div> <div> <p>Search engines bootstrap crawling and ranking from a set of trusted seed sites. While the exact composition of these seeds is undisclosed, theory and patents on link-based ranking and trust propagation imply that shorter graph distance to seeds should correlate with faster discovery, recrawl, and indexing (lower time-to-first-index, TTFI). This article advances a research program for measuring seed proximity indirectly via indexing latency, while presenting a critical discussion of confounders such as crawl budget, news freshness mechanisms, sitemaps/notifications, JavaScript rendering load, internal linking, and server quality. <br>We synthesize prior literature on PageRank, TrustRank, web crawling, and Google’s public guidance on crawl budget; review empirical anecdotes from Swedish media sites; and propose an experimental design that uses survival analysis and difference-in-differences (DiD) around new inlinks from seed candidates. We call for collaborative data collection to validate whether indexing latency can serve as a robust proxy for seed proximity in practice.</p> </div> </div> </div> |
| title | Proximity to seed sites_Proposal for measurement_DavidVesterlund_10.5281/zenodo.17401322 |
| url | https://doi.org/10.5281/zenodo.17401322 |