Guardado en:
Detalles Bibliográficos
Autores principales: Cabezas, Alberto, Montorsi, Carlotta
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:https://arxiv.org/abs/2506.01874
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918299879604224
author Cabezas, Alberto
Montorsi, Carlotta
author_facet Cabezas, Alberto
Montorsi, Carlotta
contents Generative modelling with Transformer architectures can simulate complex sequential structures across various applications. We extend this line of work to the social sciences by introducing a Transformer-based generative model tailored to longitudinal socio-economic data. Our contributions are: (i) we design a novel encoding method that represents socio-economic life histories as sequences, including overlapping events across life domains; and (ii) we adapt generative modelling techniques to simulate plausible alternative life trajectories conditioned on past histories. Using large-scale data from the Italian social security administration (INPS), we show that the model can be trained at scale, reproduces realistic labour market patterns consistent with known causal relationships, and generates coherent hypothetical life paths. This work demonstrates the feasibility of generative modelling for socio-economic trajectories and opens new opportunities for policy-oriented research, with counterfactual generation as a particularly promising application.
format Preprint
id arxiv_https___arxiv_org_abs_2506_01874
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Life Sequence Transformer: Generative Modelling of Socio-Economic Trajectories from Administrative Data
Cabezas, Alberto
Montorsi, Carlotta
Econometrics
Methodology
Generative modelling with Transformer architectures can simulate complex sequential structures across various applications. We extend this line of work to the social sciences by introducing a Transformer-based generative model tailored to longitudinal socio-economic data. Our contributions are: (i) we design a novel encoding method that represents socio-economic life histories as sequences, including overlapping events across life domains; and (ii) we adapt generative modelling techniques to simulate plausible alternative life trajectories conditioned on past histories. Using large-scale data from the Italian social security administration (INPS), we show that the model can be trained at scale, reproduces realistic labour market patterns consistent with known causal relationships, and generates coherent hypothetical life paths. This work demonstrates the feasibility of generative modelling for socio-economic trajectories and opens new opportunities for policy-oriented research, with counterfactual generation as a particularly promising application.
title Life Sequence Transformer: Generative Modelling of Socio-Economic Trajectories from Administrative Data
topic Econometrics
Methodology
url https://arxiv.org/abs/2506.01874