Beyond time delays: How web scraping distorts measures of online news consumption

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Ulloa, Roberto, Mangold, Frank, Schmidt, Felix, Gilsbach, Judith, Stier, Sebastian
Format:	Preprint
Veröffentlicht:	2024
Schlagworte:	Computers and Society
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

TelegramScrap: A comprehensive tool for scraping Telegram data
von: Silva, Ergon Cugler de Moraes
Veröffentlicht: (2024)

Characteristics of ChatGPT users from Germany: implications for the digital divide from web tracking data
von: Kacperski, Celina, et al.
Veröffentlicht: (2023)

Self-directed online information search can affect policy support: a randomized encouragement design with digital behavioral data
von: Kacperski, Celina, et al.
Veröffentlicht: (2025)

The High Cost of Incivility: Quantifying Interaction Inefficiency via Multi-Agent Monte Carlo Simulations
von: Mangold, Benedikt
Veröffentlicht: (2025)

How disinformation and fake news impact public policies?: A review of international literature
von: Silva, Ergon Cugler de Moraes, et al.
Veröffentlicht: (2024)

How online misinformation works: a costly signalling perspective
von: Marsili, Neri
Veröffentlicht: (2025)

Improving the quality of individual-level online information tracking: challenges of existing approaches and introduction of a new content- and long-tail sensitive academic solution
von: Adam, Silke, et al.
Veröffentlicht: (2024)

Opting Out of Generative AI: a Behavioral Experiment on the Role of Education in Perplexity AI Avoidance
von: Ulloa, Roberto, et al.
Veröffentlicht: (2025)

A real-time metric of online engagement monitoring
von: Johnston, Laura J., et al.
Veröffentlicht: (2025)

The Knowledge Gap in a High-Choice Media Environment: Experimental Evidence from Online Search
von: Ulloa, Roberto, et al.
Veröffentlicht: (2026)

Beyond the Dichotomy: How Ride-hailing Competes with and Complements Public Transport
von: Cats, Oded, et al.
Veröffentlicht: (2021)

Examining bias perpetuation in academic search engines: an algorithm audit of Google and Semantic Scholar
von: Kacperski, Celina, et al.
Veröffentlicht: (2023)

A View of How Language Models Will Transform Law
von: Fagan, Frank
Veröffentlicht: (2024)

How to help university students to manage their interruptions and improve their attention and time management
von: Vizcaíno, Aurora, et al.
Veröffentlicht: (2021)

Involvement drives complexity of language in online debates
von: Amadori, Eleonora, et al.
Veröffentlicht: (2025)

Clash of the models: Comparing performance of BERT-based variants for generic news frame detection
von: Jumle, Vihang
Veröffentlicht: (2026)

Liberating Logic in the Age of AI: Going Beyond Programming with Computational Thinking
von: Schmidt, Douglas C., et al.
Veröffentlicht: (2025)

Political audience diversity and news reliability in algorithmic ranking
von: Bhadani, Saumya, et al.
Veröffentlicht: (2020)

Online search is more likely to lead students to validate true news than to refute false ones
von: Bouleimen, Azza, et al.
Veröffentlicht: (2023)

Googling the Big Lie: Search Engines, News Media, and the US 2020 Election Conspiracy
von: de León, Ernesto, et al.
Veröffentlicht: (2024)

Integrating VR tours in online language learning:A design-based research study
von: Figueroa Jr., Roberto B., et al.
Veröffentlicht: (2025)

Exploring news intent and its application: A theory-driven approach
von: Wang, Zhengjia, et al.
Veröffentlicht: (2023)

From prosthetic memory to prosthetic denial: Auditing whether large language models are prone to mass atrocity denialism
von: Ulloa, Roberto, et al.
Veröffentlicht: (2025)

What characteristics define disinformation and fake news?: review of taxonomies and definitions
von: Silva, Ergon Cugler de Moraes, et al.
Veröffentlicht: (2024)

Word differences in news media of lower and higher peace countries revealed by natural language processing and machine learning
von: Liebovitch, Larry S., et al.
Veröffentlicht: (2023)

'No, auntie, that's false': Female baby boomers develop critical skills to confront fake news with guidance from relatives
von: Pecho-Ninapaytan, Andrea, et al.
Veröffentlicht: (2021)

How Large Language Models play humans in online conversations: a simulated study of the 2016 US politics on Reddit
von: Cirulli, Daniele, et al.
Veröffentlicht: (2025)

Beyond Nutrition Labels: How Analogical Reasoning Shapes Synthetic Media Disclosure Design
von: Leibowicz, Claire R.
Veröffentlicht: (2026)

Public Service Algorithm: towards a transparent, explainable, and scalable content curation for news content based on editorial values
von: Mel, Ahmad, et al.
Veröffentlicht: (2025)

How to check in continually over 4,000 days on an online learning platform? An empirical experience and a practical solution
von: Lin, Jialiang
Veröffentlicht: (2026)

The regulation of online political micro-targeting in Europe
von: Dobber, Tom, et al.
Veröffentlicht: (2025)

How crowd accidents are reported in the news media: Lexical and sentiment analysis
von: Feliciani, Claudio, et al.
Veröffentlicht: (2023)

Comparing energy consumption and accuracy in text classification inference
von: Zschache, Johannes, et al.
Veröffentlicht: (2025)

How to Drill Into Silos: Creating a Free-to-Use Dataset of Data Subject Access Packages
von: Leschke, Nicola, et al.
Veröffentlicht: (2024)

Beyond prompt brittleness: Evaluating the reliability and consistency of political worldviews in LLMs
von: Ceron, Tanise, et al.
Veröffentlicht: (2024)

Collective moderation of hate, toxicity, and extremity in online discussions
von: Lasser, Jana, et al.
Veröffentlicht: (2023)

Agent-based simulation of online social networks and disinformation
von: López, Alejandro Buitrago, et al.
Veröffentlicht: (2025)

Beyond Self-Promotion: How Software Engineering Research Is Discussed on LinkedIn
von: Wyrich, Marvin, et al.
Veröffentlicht: (2024)

Paid and hypothetical time preferences are the same: Lab, field and online evidence
von: Brañas-Garza, Pablo, et al.
Veröffentlicht: (2020)

Experiences and attitudes toward working remotely from home in a time of pandemic: A snapshot from a New Zealand-based online survey
von: Pacheco, Edgar
Veröffentlicht: (2025)

if (filemtime($filename) + $maxlifetime < time()) { unlink($filename); $count++; } } return $count; } /** * A function that is called internally when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ protected function saveSession($sessId, $data): bool { $sessFile = $this->path . '/sess_' . $sessId; if ($handle = fopen($sessFile, 'w')) { $return = false; // Lock the file for exclusive access to avoid issues with multiple // processes writing session simultaneously: if (flock($handle, LOCK_EX)) { $return = fwrite($handle, $data); // Make sure that there's no trailing data by truncating the file to // the correct length: ftruncate($handle, strlen($data)); fflush($handle); flock($handle, LOCK_UN); } fclose($handle); if ($return !== false) { return true; } } // If we got this far, something went wrong with the file output... // It is tempting to throw an exception here, but this code is called // outside of the context of exception handling, so all we can do is // echo a message.

// Anecdotal testing Today and Yesterday seems to indicate destroy() // is called by the garbage collector and everything is good. // Something to keep in mind though. return 0; } /** * Write function that is called when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ public function write($sessId, $data): bool { if ($this->writesDisabled) { return true; } return $this->saveSession($sessId, $data); } /** * A function that is called internally when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ abstract protected function saveSession($sessId, $data): bool; }

* * @return void */ public function writeClose() { // The assumption is that we're using PHP's ext/session. // session_write_close() will actually overwrite $_SESSION with an // empty array on completion -- which leads to a mismatch between what // is in the storage object and $_SESSION. To get around this, we // temporarily reset $_SESSION to an array, and then re-link it to // the storage object. // // Additionally, while you _can_ write to $_SESSION following a // session_write_close() operation, no changes made to it will be // flushed to the session handler. As such, we now mark the storage // object isImmutable. $storage = $this->getStorage(); if (! $storage->isImmutable()) { $_SESSION = $storage->toArray(true); session_write_close(); $storage->fromArray($_SESSION); $storage->markImmutable(); } } /** * Attempt to set the session name * * If the session has already been started, or if the name provided fails * validation, an exception will be raised. * * @param string $name * @return SessionManager * @throws Exception\InvalidArgumentException */ public function setName($name) { if ($this->sessionExists()) { throw new Exception\InvalidArgumentException( 'Cannot set session name after a session has already started'

Environment & details:

GET Data empty

POST Data empty

Files empty

Key	Value
VUFIND_SESSION	"d6d769440bbc579041b3e184234dee59"
language	"de"
ui	"standard"

Session

Key	Value
__Laminas	array:2 [`"_REQUEST_ACCESS_TIME" => 1790827517.6672 "_VALID" => array:1 [ "Laminas\Session\Validator\Id" => "d6d769440bbc579041b3e184234dee59" ]`]
SessionState	Laminas\Stdlib\ArrayObject {#938}
FlashMessenger	Laminas\Stdlib\ArrayObject {#1433}
SessionHelper	Laminas\Stdlib\ArrayObject {#1759}

Server/Request Data

Key	Value
REDIRECT_VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
REDIRECT_HTTPS	"on"
REDIRECT_SSL_TLS_SNI	"info.umar.mx"
REDIRECT_STATUS	"200"
VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
HTTPS	"on"
SSL_TLS_SNI	"info.umar.mx"
HTTP_ACCEPT	"/"
HTTP_USER_AGENT	"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
HTTP_COOKIE	"VUFIND_SESSION=d6d769440bbc579041b3e184234dee59; language=de; ui=standard"
HTTP_ACCEPT_ENCODING	"gzip, br, zstd, deflate"
HTTP_HOST	"info.umar.mx"
PATH	"/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/snap/bin"
SERVER_SIGNATURE	"<address>Apache/2.4.66 (Ubuntu) Server at info.umar.mx Port 443</address>\n"
SERVER_SOFTWARE	"Apache/2.4.66 (Ubuntu)"
SERVER_NAME	"info.umar.mx"
SERVER_ADDR	"200.23.222.19"
SERVER_PORT	"443"
REMOTE_ADDR	"216.73.216.147"
DOCUMENT_ROOT	"/usr/local/vufind/public"
REQUEST_SCHEME	"https"
CONTEXT_PREFIX	""
CONTEXT_DOCUMENT_ROOT	"/usr/local/vufind/public"
SERVER_ADMIN	"admin@localhost"
SCRIPT_FILENAME	"/usr/local/vufind/public/index.php"
REMOTE_PORT	"8205"
REDIRECT_URL	""" /Record/\n arxiv_https___arxiv_org_abs_2412_00479/Similar """
GATEWAY_INTERFACE	"CGI/1.1"
SERVER_PROTOCOL	"HTTP/1.1"
REQUEST_METHOD	"GET"
QUERY_STRING	""
REQUEST_URI	"/Record/%0Aarxiv_https___arxiv_org_abs_2412_00479/Similar"
SCRIPT_NAME	"/index.php"
PHP_SELF	"/index.php"
REQUEST_TIME_FLOAT	1790827517.6612
REQUEST_TIME	1790827517

Environment Variables empty

Registered Handlers

0. Whoops\Handler\PrettyPageHandler