EconBase
← All papers

Regression based thresholds in principal loading analysis

J. O. Bauer, B. Drabant

arXiv 11 Mar 2021 · Mathematics — Statistics Theory

arXiv:2103.06691 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Principal loading analysis is a dimension reduction method that discards variables which have only a small distorting effect on the covariance matrix. As a special case, principal loading analysis discards variables that are not correlated with the remaining ones. In multivariate linear regression on the other hand, predictors that are neither correlated with both the remaining predictors nor with the dependent variables have a regression coefficients equal to zero. Hence, if the goal is to select a number of predictors, variables that do not correlate are discarded as it is also done in principal loading analysis. That both methods select the same variables occurs not only for the special case of zero correlation however. We contribute conditions under which both methods share the same variable selection. Further, we extend those conditions to provide a choice for the threshold in principal loading analysis which only follows recommendations based on simulation results so far.

Citation extraction

21
references
33
in-text mentions
21
distinct cited
2
self-citations
6,230
main-text words

appendix boundary found by appendix_command · 72% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Bauer, J. O., Drabant, B (2021) Principal loading analysis self0.9619789%
2Bauer, J. O (2021) Correlation based principal loading analysis self0.64422100%
3Neudecker, H., Wesselman, A (1990) The asymptotic variance matrix of the sample correlation matrix0.5112250%
4Stewart, G. W., Sun, J (1990) Matrix perturbation theory0.5112250%
5Yu, Y., Wang, T., Samworth, R. J (2015) A useful variant of the Davis–Kahan theorem for statisticians0.5112250%
6Anderson, T. W (1963) Asymptotic theory for principal component analysis0.40511100%
7Davis, C., Kahan, W. M (1970) The rotation of eigenvectors by a perturbation0.40511100%
8Dauxois, J., Pousse, A., Romain, Y (1982) Asymptotic theory for the principal component analysis of a vector random function: Some applications to statistical inference0.40511100%
9Hawkins, D. M (1973) On the investigation of alternative regressions by principal component analysis0.40511100%
10Hotelling, H (1933) Analysis of a complex of statistical variables into principal components0.40511100%

Showing the top 10 of 21 scored citations.