EconBase
← All papers

Do We Exploit all Information for Counterfactual Analysis? Benefits of Factor Models and Idiosyncratic Correction

Jianqing Fan, Ricardo P. Masini, Marcelo C. Medeiros

arXiv 8 Nov 2020 · Econometrics · publishedJournal of the American Statistical Association (2021) · 19 citations (OpenAlex)

arXiv:2011.03996 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Optimal pricing, i.e., determining the price level that maximizes profit or revenue of a given product, is a vital task for the retail industry. To select such a quantity, one needs first to estimate the price elasticity from the product demand. Regression methods usually fail to recover such elasticities due to confounding effects and price endogeneity. Therefore, randomized experiments are typically required. However, elasticities can be highly heterogeneous depending on the location of stores, for example. As the randomization frequently occurs at the municipal level, standard difference-in-differences methods may also fail. Possible solutions are based on methodologies to measure the effects of treatments on a single (or just a few) treated unit(s) based on counterfactuals constructed from artificial controls. For example, for each city in the treatment group, a counterfactual may be constructed from the untreated locations. In this paper, we apply a novel high-dimensional statistical method to measure the effects of price changes on daily sales from a major retailer in Brazil. The proposed methodology combines principal components (factors) and sparse regressions, resulting in a method called Factor-Adjusted Regularized Method for Treatment evaluation (FarmTreat). The data consist of daily sales and prices of five different products over more than 400 municipalities. The products considered belong to the sweet and candies category and experiments have been conducted over the years of 2016 and 2017. Our results confirm the hypothesis of a high degree of heterogeneity yielding very different pricing strategies over distinct municipalities.

Citation extraction

23
references
97
in-text mentions
23
distinct cited
5
self-citations
14,102
main-text words

appendix boundary found by appendix_command · 73% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Chernozhukov, V., K. Wüthrich, and Y. Zhu (2020) An exact and robust conformal inference method for counterfactual and synthetic controls1.000165100%
2Masini, R. and M. Medeiros (2021+) (2021) Counterfactual analysis with artificial controls: Inference, high dimensions and nonstationarity self1.00094100%
3Gobillon, L. and T. Magnac (2016) Regional policy evaluation: Interactive fixed effects and synthetic controls0.95014586%
4Carvalho, C., R. Masini, and M. Medeiros (2018) Arco: An artificial counterfactual approach for high-dimensional panel time-series data0.92820780%
5Fan, J., R. Masini, and M. Medeiros (2021) Bridging factor and sparse models self0.9285380%
6Ahn, S. and A. Horenstein (2013) Eigenvalue ratio test for the number of factors0.87452100%
7Fan, J., Y. Ke, and K. Wang (2020) Factor-adjusted regularized model selection self0.81142100%
8Masini, R. and M. Medeiros (2020) Counterfactual analysis and inference with non-stationary data self0.81142100%
9Hsiao, C., H. S. Ching, and S. K. Wan (2012) A panel data approach for program evaluation: Measuring the benefits of political and economic integration of Hong Kong with mai…0.64422100%
10Bai, J. and S. Ng (2008) Large dimensional factor analysis0.64422100%

Showing the top 10 of 23 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1State-Building through Public Land Disposal? An Application of Matrix Completion for Counterfactual Prediction0.40511
2Quasi Maximum Likelihood Estimation and Inference .2cm of Large Approximate Dynamic Factor Models .2cm via the EM algorithm -.2cm0.40511
3Distributional Counterfactual Analysis in High-Dimensional Setup0.40511
4Inference with few treated units0.40511
5Propensity score with factor loadings: the effect of the Paris Agreement0.40511