EconBase
← All papers

Life Sequence Transformer: Generative Modelling for Counterfactual Simulation

Alberto Cabezas, Carlotta Montorsi

arXiv 2 Jun 2025 · Econometrics

arXiv:2506.01874 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Social sciences rely on counterfactual analysis using surveys and administrative data, generally depending on strong assumptions or the existence of suitable control groups, to evaluate policy interventions and estimate causal effects. We propose a novel approach that leverages the Transformer architecture to simulate counterfactual life trajectories from large-scale administrative records. Our contributions are: the design of a novel encoding method that transforms longitudinal administrative data to sequences and the proposal of a generative model tailored to life sequences with overlapping events across life domains. We test our method using data from the Istituto Nazionale di Previdenza Sociale (INPS), showing that it enables the realistic and coherent generation of life trajectories. This framework offers a scalable alternative to classical counterfactual identification strategy, such as difference-in-differences and synthetic controls, particularly in contexts where these methods are infeasible or their assumptions unverifiable. We validate the model's utility by comparing generated life trajectories against established findings from causal studies, demonstrating its potential to enrich labour market research and policy evaluation through individual-level simulations.

Citation extraction

40
references
55
in-text mentions
40
distinct cited
0
self-citations
5,566
main-text words

appendix boundary found by appendix_command · 40% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1G. Savcisens, T. Eliassi-Rad, L. K. Hansen, L. H. Mortensen, L. Lill… (2024) Using sequences of life-events to predict human lives0.8434475%
2Z. Yang, A. Mitra, W. Liu, D. Berlowitz, and H. Yu (2023) TransformEHR: transformer-based encoder-decoder generative model to enhance prediction of disease outcomes using electronic heal…0.7373367%
3H. Kleven, C. Landais, and J. E. Sgaard (2019) Children and gender inequality: Evidence from denmark0.6444250%
4C. Ardito, R. Leombruni, D. Blane, and A. d’Errico (2020) To work or not to work? the effect of higher pension age on cardiovascular health0.5112250%
5A. Bena, R. Leombruni, M. Giraudo, and G. Costa (2012) A new italian surveillance system for occupational injuries: characteristics and initial results0.5112250%
6G. Brunello and R. Miniaci (1997) Benefit transfers in italy: an empirical study of mobility lists in the milan area0.5112250%
7A. Casarico and S. Lattanzio (2023) Behind the child penalty: understanding what contributes to the labour market costs of motherhood0.5112250%
8R. Leombruni, R. Quaranta, and C. Villosio (2010) Note di pubblicazione di whip v. 3.20.5112250%
9J. Su, Y. Lu, S. Pan, A. Murtadha, B. Wen, and Y. Liu (2023) Roformer: Enhanced transformer with rotary position embedding, 20230.51121100%
10B. Zhang and R. Sennrich (2019) Root mean square layer normalization0.51121100%

Showing the top 10 of 40 scored citations.