Christian Møller Dahl, Torben Johansen, Christian Vedel
arXiv 21 Feb 2024 · cs.CL · 1 citations (OpenAlex)
arXiv:2402.13604 · PDF · DOI · OpenAlex · Extracted main text
This paper introduces a new tool, OccCANINE, to automatically transform occupational descriptions into the HISCO classification system. The manual work involved in processing and classifying occupational descriptions is error-prone, tedious, and time-consuming. We finetune a preexisting language model (CANINE) to do this automatically, thereby performing in seconds and minutes what previously took days and weeks. The model is trained on 14 million pairs of occupational descriptions and HISCO codes in 13 different languages contributed by 22 different sources. Our approach is shown to have accuracy, recall, and precision above 90 percent. Our tool breaks the metaphorical HISCO barrier and makes this data readily available for analysis of occupational structures with broad applicability in economics, economic history, and various related disciplines.
appendix boundary found by appendix_command · 50% of the source is main text. Read the extracted text to check this.
The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.
| Reference | Intensity | Mentions | Sections | Main text | |
|---|---|---|---|---|---|
| 1 | IPUMS APACrefauthors Ruggles, S. , Cleveland, L L. , Dávila, R L. ,… (2025) 2025 | 0.956 | 8 | 3 | 88% |
| 2 | Clark2022CANINE APACrefauthors Clark, J H. , Garrette, D. , Turc, I.… (2022) 2022 | 0.737 | 3 | 3 | 67% |
| 3 | LinkLives2022Guide APACrefauthors Robinson, O. , Thomsen, A. , Mathi… (2023) 2023 | 0.644 | 2 | 2 | 100% |
| 4 | Vedel2023 APACrefauthors Vedel, C. APACrefauthors \ (2025) 2025 | 0.644 | 2 | 2 | 100% |
| 5 | ddd_method2015 APACrefauthors Clausen, N F. APACrefauthors \ (2015) 2015 | 0.644 | 2 | 2 | 100% |
| 6 | gorges2025tracksmodernityrailroadsgrowth APACrefauthors Görges, T. ,… (2025) 2025 | 0.644 | 2 | 2 | 100% |
| 7 | vaswani2017attention APACrefauthors Vaswani, A. , Shazeer, N. , Parm… (2017) 2017 | 0.644 | 2 | 2 | 100% |
| 8 | Ford2023 APACrefauthors Ford, N M. APACrefauthors \ (2023) 2023 | 0.585 | 3 | 1 | 100% |
| 9 | ipums_cross_walk2017 APACrefauthors Mourits, R. APACrefauthors \ (2017) 2017 | 0.511 | 2 | 2 | 50% |
| 10 | Gweon2017 APACrefauthors Gweon, H. , Schonlau, M. , Kaczmirek, L. ,… 2017 | 0.511 | 2 | 1 | 100% |
Showing the top 10 of 64 scored citations.