EconBase
← All papers

Inference for ROC Curves Based on Estimated Predictive Indices

Yu-Chin Hsu, Robert P. Lieli

arXiv 3 Dec 2021 · Econometrics · 2 citations (OpenAlex)

arXiv:2112.01772 · PDF · DOI · OpenAlex · Extracted main text

Abstract

We provide a comprehensive theory of conducting in-sample statistical inference about receiver operating characteristic (ROC) curves that are based on predicted values from a first stage model with estimated parameters (such as a logit regression). The term "in-sample" refers to the practice of using the same data for model estimation (training) and subsequent evaluation, i.e., the construction of the ROC curve. We show that in this case the first stage estimation error has a generally non-negligible impact on the asymptotic distribution of the ROC curve and develop the appropriate pointwise and functional limit theory. We propose methods for simulating the distribution of the limit process and show how to use the results in practice in comparing ROC curves.

Citation extraction

0
references
0
in-text mentions
0
distinct cited
0
self-citations
15,163
main-text words

appendix boundary found by appendix_command · 70% of the source is main text. Read the extracted text to check this.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1A Sharp Test for the Judge Leniency Design0.00021