A Semiparametric Nonlinear Mixed Effects Model with Penalized Splines Using Automatic Differentiation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: D'Alessandro, Matteo, Thoresen, Magne, Sørensen, Øystein
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917334987309056
author D'Alessandro, Matteo
Thoresen, Magne
Sørensen, Øystein
author_facet D'Alessandro, Matteo
Thoresen, Magne
Sørensen, Øystein
contents We present an estimation procedure for nonlinear mixed-effects models in which the population trajectory is represented by penalized splines and adapted to individuals via subject-specific transformation parameters. By exploiting the mixed model representation of penalized splines, the level of smoothness can be estimated jointly with other variance components. The integration over random effects needed to obtain the marginal likelihood is carried out using the Laplace approximation. Exact derivatives for evaluation and maximization of the resulting likelihood are obtained via automatic differentiation implemented through Template Model Builder. In simulation studies, the method produces improved inferential performance and reduced computational burden when compared to the existing procedure. The approach is further illustrated through a case study on infant height growth in the first two years of life.
format Preprint
id arxiv_https___arxiv_org_abs_2603_11728
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Semiparametric Nonlinear Mixed Effects Model with Penalized Splines Using Automatic Differentiation
D'Alessandro, Matteo
Thoresen, Magne
Sørensen, Øystein
Methodology
Computation
We present an estimation procedure for nonlinear mixed-effects models in which the population trajectory is represented by penalized splines and adapted to individuals via subject-specific transformation parameters. By exploiting the mixed model representation of penalized splines, the level of smoothness can be estimated jointly with other variance components. The integration over random effects needed to obtain the marginal likelihood is carried out using the Laplace approximation. Exact derivatives for evaluation and maximization of the resulting likelihood are obtained via automatic differentiation implemented through Template Model Builder. In simulation studies, the method produces improved inferential performance and reduced computational burden when compared to the existing procedure. The approach is further illustrated through a case study on infant height growth in the first two years of life.
title A Semiparametric Nonlinear Mixed Effects Model with Penalized Splines Using Automatic Differentiation
topic Methodology
Computation
url https://arxiv.org/abs/2603.11728