3DLNews: A Three-decade Dataset of US Local News Articles

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ariyarathne, Gangani, Nwala, Alexander C.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929453825785856
author Ariyarathne, Gangani
Nwala, Alexander C.
author_facet Ariyarathne, Gangani
Nwala, Alexander C.
contents We present 3DLNews, a novel dataset with local news articles from the United States spanning the period from 1996 to 2024. It contains almost 1 million URLs (with HTML text) from over 14,000 local newspapers, TV, and radio stations across all 50 states, and provides a broad snapshot of the US local news landscape. The dataset was collected by scraping Google and Twitter search results. We employed a multi-step filtering process to remove non-news article links and enriched the dataset with metadata such as the names and geo-coordinates of the source news media organizations, article publication dates, etc. Furthermore, we demonstrated the utility of 3DLNews by outlining four applications.
format Preprint
id arxiv_https___arxiv_org_abs_2408_04716
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle 3DLNews: A Three-decade Dataset of US Local News Articles
Ariyarathne, Gangani
Nwala, Alexander C.
Information Retrieval
We present 3DLNews, a novel dataset with local news articles from the United States spanning the period from 1996 to 2024. It contains almost 1 million URLs (with HTML text) from over 14,000 local newspapers, TV, and radio stations across all 50 states, and provides a broad snapshot of the US local news landscape. The dataset was collected by scraping Google and Twitter search results. We employed a multi-step filtering process to remove non-news article links and enriched the dataset with metadata such as the names and geo-coordinates of the source news media organizations, article publication dates, etc. Furthermore, we demonstrated the utility of 3DLNews by outlining four applications.
title 3DLNews: A Three-decade Dataset of US Local News Articles
topic Information Retrieval
url https://arxiv.org/abs/2408.04716