EconBase
← All papers

Rethinking travel behavior modeling representations through embeddings

Francisco C. Pereira

arXiv 31 Aug 2019 · Econometrics · 10 citations (OpenAlex)

arXiv:1909.00154 · PDF · DOI · OpenAlex · Extracted main text

Abstract

This paper introduces the concept of travel behavior embeddings, a method for re-representing discrete variables that are typically used in travel demand modeling, such as mode, trip purpose, education level, family type or occupation. This re-representation process essentially maps those variables into a latent space called the embedding space. The benefit of this is that such spaces allow for richer nuances than the typical transformations used in categorical variables (e.g. dummy encoding, contrasted encoding, principal components analysis). While the usage of latent variable representations is not new per se in travel demand modeling, the idea presented here brings several innovations: it is an entirely data driven algorithm; it is informative and consistent, since the latent space can be visualized and interpreted based on distances between different categories; it preserves interpretability of coefficients, despite being based on Neural Network principles; and it is transferrable, in that embeddings learned from one dataset can be reused for other ones, as long as travel behavior keeps consistent between the datasets. The idea is strongly inspired on natural language processing techniques, namely the word2vec algorithm. Such algorithm is behind recent developments such as in automatic translation or next word prediction. Our method is demonstrated using a model choice model, and shows improvements of up to 60% with respect to initial likelihood, and up to 20% with respect to likelihood of the corresponding traditional model (i.e. using dummy variables) in out-of-sample evaluation. We provide a new Python package, called PyTre (PYthon TRavel Embeddings), that others can straightforwardly use to replicate our results or improve their own models. Our experiments are themselves based on an open dataset (swissmetro).

Citation extraction

15
references
20
in-text mentions
15
distinct cited
1
self-citations
9,952
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1M. Bierlaire, K. Axhausen, G. Abay, The acceptance of modal innovati… (2001)0.64422100%
2Inferring dynamic origin-destination flows by transport mode using m… (2019) 254 – 2750.51121100%
3T. Brathwaite, J. L. Walker, Asymmetric, closed-form, finite-paramet… (2018) 78–1120.51121100%
4Fasttext - embeddings for 157 languages, https://fasttext.cc, accessed (2019) -06-190.51121100%
5Word2vec tutorial - the skip-gram model, http://mccormickml.com/ (2016) /04/19/word2vec-tutorial-the-skip-gram-model/, accessed: 2019-06-300.51121100%
6N. Arora, G. M. Allenby, J. L. Ginter, A hierarchical bayes model of… (1998) 29–440.40511100%
7M. E. Ben-Akiva, S. R. Lerman, S. R. Lerman, Discrete choice analysi… (1985)0.40511100%
8M. J. Davis, Contrast coding in multiple regression analysis: Streng… (2010) 61–730.40511100%
9Y. Goldberg, O. Levy, word2vec explained: deriving mikolov et al.'s…0.40511100%
10D. Guthrie, B. Allison, W. Liu, L. Guthrie, Y. Wilks, A closer look… (2006) pp0.40511100%

Showing the top 10 of 15 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Combining Discrete Choice Models and Neural Networks through Embeddings: Formulation, Interpretability and Performance0.84333
2ResLogit: A residual neural network logit model for data-driven choice modelling0.64422
3Attitudes and Latent Class Choice Models using Machine Learning0.40511