Simultaneous Estimation and Model Choice for Big Discrete Time-to-Event Data with Additive Predictors

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Müller, Benjamin, Umlauf, Nikolaus, Seiler, Johannes, Harttgen, Kenneth, Lang, Stefan
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916838351306752
author Müller, Benjamin
Umlauf, Nikolaus
Seiler, Johannes
Harttgen, Kenneth
Lang, Stefan
author_facet Müller, Benjamin
Umlauf, Nikolaus
Seiler, Johannes
Harttgen, Kenneth
Lang, Stefan
contents Discrete-time hazard models are widely used when event times are measured in intervals or are not precisely observed. While these models can be estimated using standard generalized linear model techniques, they rely on extensive data augmentation, making estimation computationally demanding in high-dimensional settings. In this paper, we demonstrate how the recently proposed Batchwise Backfitting algorithm, a general framework for scalable estimation and variable selection in distributional regression, can be effectively extended to discrete hazard models. Using both simulated data and a large-scale application on infant mortality in sub-Saharan Africa, we show that the algorithm delivers accurate estimates, automatically selects relevant predictors, and scales efficiently to large data sets. The findings underscore the algorithm's practical utility for analysing large-scale, complex survival data with high-dimensional covariates.
format Preprint
id arxiv_https___arxiv_org_abs_2507_08099
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Simultaneous Estimation and Model Choice for Big Discrete Time-to-Event Data with Additive Predictors
Müller, Benjamin
Umlauf, Nikolaus
Seiler, Johannes
Harttgen, Kenneth
Lang, Stefan
Methodology
Discrete-time hazard models are widely used when event times are measured in intervals or are not precisely observed. While these models can be estimated using standard generalized linear model techniques, they rely on extensive data augmentation, making estimation computationally demanding in high-dimensional settings. In this paper, we demonstrate how the recently proposed Batchwise Backfitting algorithm, a general framework for scalable estimation and variable selection in distributional regression, can be effectively extended to discrete hazard models. Using both simulated data and a large-scale application on infant mortality in sub-Saharan Africa, we show that the algorithm delivers accurate estimates, automatically selects relevant predictors, and scales efficiently to large data sets. The findings underscore the algorithm's practical utility for analysing large-scale, complex survival data with high-dimensional covariates.
title Simultaneous Estimation and Model Choice for Big Discrete Time-to-Event Data with Additive Predictors
topic Methodology
url https://arxiv.org/abs/2507.08099