EconBase
← All papers

Testing Clustered Equal Predictive Ability with Unknown Clusters

Oguzhan Akgun, Alain Pirotte, Giovanni Urga, Zhenlin Yang

arXiv 19 Jul 2025 · Econometrics

arXiv:2507.14621 · PDF · DOI · OpenAlex · Extracted main text

Abstract

This paper proposes a selective inference procedure for testing equal predictive ability in panel data settings with unknown heterogeneity. The framework allows predictive performance to vary across unobserved clusters and accounts for the data-driven selection of these clusters using the Panel Kmeans Algorithm. A post-selection Wald-type statistic is constructed, and valid $p$-values are derived under general forms of autocorrelation and cross-sectional dependence in forecast loss differentials. The method accommodates conditioning on covariates or common factors and permits both strong and weak dependence across units. Simulations demonstrate the finite-sample validity of the procedure and show that it has very high power. An empirical application to exchange rate forecasting using machine learning methods illustrates the practical relevance of accounting for unknown clusters in forecast evaluation.

Citation extraction

66
references
151
in-text mentions
66
distinct cited
0
self-citations
11,230
main-text words

appendix boundary found by appendix_command · 43% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Giacomini \ White (2006) `Tests of conditional predictive ability', Econometrica 74(6), 1545–15781.00053100%
2Gao, Bien \ Witten (2024) `Selective inference for hierarchical clustering', Journal of the American Statistical Association 119(545), 332–3420.9507486%
3Chen \ Witten (2023) `Selective inference for0.81115553%
4Spreng \ Urga (2023) `Combining0.81142100%
5Vovk \ Wang (2020) `Combining0.79410550%
6Bonhomme \ Manresa (2015) `Grouped patterns of heterogeneity in panel data', Econometrica 83(3), 1147–11840.76911445%
7Patton \ Weller (2023) `Testing for unobserved heterogeneity via0.75414643%
8Vovk, Wang \ Wang (2022) `Admissible ways of merging p-values under arbitrary dependence', The Annals of Statistics 50(1), 351–3750.7374350%
9Chudik, Pesaran \ Tosetti (2011) `Weak and strong cross-section dependence and estimation of large panels', The Econometrics Journal 14(1), C45–C900.64422100%
10Clark \ McCracken (2013) `Advances in forecast evaluation', Handbook of Economic Forecasting 2, 1107–12010.64422100%

Showing the top 10 of 66 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Robust Inference Methods for Latent Group Panel Models under Possible Group Non-Separation0.40511