EconBase
← All papers

Binary Classification Tests, Imperfect Standards, and Ambiguous Information

Gabriel Ziegler

arXiv 21 Dec 2020 · Econometrics · 3 citations (OpenAlex)

arXiv:2012.11215 · PDF · DOI · OpenAlex · Extracted main text

Abstract

New binary classification tests are often evaluated relative to a pre-established test. For example, rapid Antigen tests for the detection of SARS-CoV-2 are assessed relative to more established PCR tests. In this paper, I argue that the new test can be described as producing ambiguous information when the pre-established is imperfect. This allows for a phenomenon called dilation -- an extreme form of non-informativeness. As an example, I present hypothetical test data satisfying the WHO's minimum quality requirement for rapid Antigen tests which leads to dilation. The ambiguity in the information arises from a missing data problem due to imperfection of the established test: the joint distribution of true infection and test results is not observed. Using results from Copula theory, I construct the (usually non-singleton) set of all these possible joint distributions, which allows me to assess the new test's informativeness. This analysis leads to a simple sufficient condition to make sure that a new test is not a dilation. I illustrate my approach with applications to data from three COVID-19 related tests. Two rapid Antigen tests satisfy my sufficient condition easily and are therefore informative. However, less accurate procedures, like chest CT scans, may exhibit dilation.

Citation extraction

34
references
80
in-text mentions
34
distinct cited
0
self-citations
11,542
main-text words

appendix boundary found by appendix_command · 93% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Blackwell, D (1951) Comparison of Experiments, in1.00083100%
2WHO (2020) Antigen-Detection in the Diagnosis of SARS-CoV-2 Infection Using Rapid Immunoassays, https://www.who.int/publications-detail-red…1.00063100%
3Manski, C. F. and F. Molinari (2021) Estimating the COVID-19 Infection Rate: Anatomy of an Inference Problem0.87452100%
4Stoye, J (2020) Bounding Disease Prevalence by Bounding Selectivity and Accuracy of Tests: The Case of COVID-190.81142100%
5Joe, H (1997) Multivariate Models and Multivariate Dependence Concepts0.7374275%
6Manski, C. F (2020) Bounding the Accuracy of Diagnostic Tests, with Application to COVID-19 Antibody Tests0.73732100%
7Zhou, X.-H., N. A. Obuchowski, and D. K. McClish (2014) Statistical Methods in Diagnostic Medicine0.73732100%
8Gietema, H. A., N. Zelis, J. M. Nobel, L. J. G. Lambriks, L. B. van… (2020) CT in Relation to RT-PCR in Diagnosing COVID-19 in The Netherlands: A Prospective Study0.69351100%
9Kaiser, L., I. Eckerle, M. Schibler, and A. Berger (2020) Validation Report: SARS-CoV-2 Antigen Rapid Diagnostic Test, Tech0.69351100%
10Ai, T., Z. Yang, H. Hou, C. Zhan, C. Chen, W. Lv, Q. Tao, Z. Sun, an… (2020) Correlation of Chest CT and RT-PCR Testing for Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases0.64441100%

Showing the top 10 of 34 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Measuring Diagnostic Test Performance Using Imperfect Reference Tests: A Partial Identification Approach0.73733