EconBase
← Back to paper

Unbiased Estimation of Central Moments in Unbalanced Two- and Three-Level Models

Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.

16,284 characters · 4 sections · 8 citation commands

Rendered from LaTeX for readability, not typeset faithfully. Citation keys are highlighted; maths is left as source; figures, tables and equation environments are summarised rather than reproduced; unrecognised commands are greyed out so nothing is silently dropped. Email addresses are removed.

Unbiased Estimation of Central Moments in Unbalanced Two- and Three-Level Models

abstractThis paper derives closed-form unbiased estimators of central moments in multilevel random-effects models with unbalanced group sizes. In a two-level model, we provide unbiased estimators for the second, third, and fourth central moments under both group-level and observation-level averaging. In a three-level model, we provide unbiased estimators for the second and third central moments. Keywords: Multilevel (hierarchical) models; unbalanced panels; central moments; group-level averaging; observation-level averaging.\\ JEL Classification: C13, C23

Introduction

Multilevel (hierarchical) linear models are widely used in empirical economics, appearing in student--teacher--school assessments and neighborhood--city--region housing markets. While estimation of variance components in multilevel random-effects models is well established, including for unbalanced designs SearleCasellaMcCulloch1992VarComp,PattersonThompson1971REML, there appear to be few closed-form results for finite-sample unbiased estimation of third and fourth central moments. Early ANOVA and cumulant work derives unbiased estimators for certain higher-order component cumulants in variance-component settings, often in balanced designs tukey1957third. More recent work studies third and fourth moment estimation focusing on consistency and asymptotic efficiency rather than explicit finite-sample unbiased within--between decompositions under alternative averaging schemes wu2010orthogonality,wustutezhu2012efficient.

In many economic applications, the third and fourth central moments of latent components (and their standardized counterparts, skewness and kurtosis) contain structural information about efficiency, selection, or risk. For example, work on earnings dynamics finds that income shocks exhibit substantial left-skewness and excess kurtosis guvenen2014nature. More broadly, in consumption/income risk problems and insurance markets, higher moments of persistent and transitory shocks affect welfare, precautionary saving, and pricing of downside risk Kimball1990PrecautionarySaving,MenezesGeissTressler1980DownsideRisk. In firm and establishment data, the distribution of growth and productivity shocks is often non-Gaussian, and higher moments are informative about investment, default risk, and aggregation BottazziSecchi2003TentShaped,Gabaix2011Granular. The estimators in this paper are used in BenMosheGenesoveFrDe in a two-level model and BenMosheGenesoveRegulation in a three-level model.

This paper derives closed-form unbiased estimators of central moments in unbalanced two- and three-level models under two averaging schemes: group-level averaging (weighting groups equally) and observation-level averaging (weighting lowest-level units equally). In unbalanced panels, failing to account for unequal subgroup sizes can bias moment estimators for the latent components. The appropriate weighting depends on the object of interest: group-level averaging is natural when each group is meant to count equally, while observation-level averaging is natural when each lowest-level unit is meant to count equally.

Section (ref) presents the two-level results (second--fourth moments), Section (ref) presents the three-level results (second--third moments), and the Appendix provides the algebraic derivations.

Two-level model

Suppose we observe $y_{ij}$ in the two-level model \[ y_{ij}=u_i+v_{ij},\quad i=1,\dots,n,\quad j=1,\dots,J_i, \] where $\{u_i\}_{i}$ and $\{v_{ij}\}_{i,j}$ are unobserved, mutually independent, and within each level i.i.d., with $\mathbb{E}[u]=\mathbb{E}[v]=0$. We assume $n\geq 3$ and $J_i\geq 3$ for all $i$. Let $\mu_{ku}=\mathbb{E}[u^k]$ and $\mu_{kv}=\mathbb{E}[v^k]$ for $k=2,3,4$, and define sample means (superscripts $\mathrm{g}$ and $\mathrm{o}$ denote group-level and observation-level averaging) as follows, \[ \bar y_i=\frac{1}{J_i}\sum_{j}y_{ij},\qquad \bar y^{\mathrm{g}}=\frac{1}{n}\sum_{i} \bar y_i,\qquad \bar y^{\mathrm{o}}=\frac{1}{N}\sum_{i,j} y_{ij}, \] where $N=\sum_{i} J_i$ (we suppress summation limits where the range is clear). So $J_i$ is the size of group $i$, $n$ is the number of groups, and $N$ is the total number of observations. Then, $\bar y_i=u_i+\bar v_i$, $\bar y^{\mathrm{g}}=\bar u^{\mathrm{g}}+\bar v^{\mathrm{g}}$, and $\bar y^{\mathrm{o}}=\bar u^{\mathrm{o}}+\bar v^{\mathrm{o}}$.

Unbiased estimators of $\mu_{2v}$, $\mu_{3v}$, $\mu_{4v}$ are

align*[align* omitted — 406 chars of source]

The coefficients $a_{11}^v,a_{12}^v,a_{21}^v,a_{22}^v$ are given in Appendix (ref).

Unbiased estimators of $\mu_{2u}$, $\mu_{3u}$, and $\mu_{4u}$ under group-level averaging are

align*[align* omitted — 692 chars of source]

The coefficients $a_{11}^{\mathrm{g}},a_{12}^{\mathrm{g}},a_{21}^{\mathrm{g}},$ and $a_{22}^{\mathrm{g}}$ and the adjustment terms $\widehat T_{4}^{\mathrm{g}}$ and $\widehat T_{22}^{\mathrm{g}}$ are given in Appendix (ref).

Unbiased estimators of $\mu_{2u}$, $\mu_{3u}$, and $\mu_{4u}$ under observation-level averaging are

align*[align* omitted — 853 chars of source]

The coefficients $a_{11}^{\mathrm{o}},a_{12}^{\mathrm{o}},a_{21}^{\mathrm{o}}$, and $a_{22}^{\mathrm{o}}$ and the adjustment terms $\widehat T_{4}^{\mathrm{o}}$ and $\widehat T_{22}^{\mathrm{o}}$ are given in Appendix (ref).

Under balanced designs ($J_i=J$ for all $i$), the group- and observation-level averaging estimators coincide. Under unbalanced designs, the difference between them is weighting: group-level averaging gives each group effect $u_i$ equal weight, while observation-level averaging weights group effects in proportion to $J_i$. Thus, the latter gives more influence to larger groups. This provides the main source of guidance to researchers: group-level averaging should be used when each group is meant to count equally, whereas observation-level averaging should be used when each lowest-level unit is meant to count equally. For example, if $u_i$ is a teacher effect and the goal is to describe the distribution of teacher quality across teachers, group-level averaging is natural. If instead the goal is to describe the distribution of teacher quality as experienced by a randomly sampled student, observation-level averaging is natural, since students are more likely to be assigned to larger classes. Group-level averaging may also be preferable when comparing moments across samples or periods, since otherwise changes in group sizes mechanically change the weights attached to the same group effects.

A second consideration is the variance of the estimator. To see the intuition, consider the second-moment estimators. Both use between-group variation in the sample means $\bar y_i$, but these means are measured with different precision: writing $\bar y_i=u_i+\bar v_i$, we have $\text{Var}(\bar y_i)=\mu_{2u}+\mu_{2v}/J_i$, so smaller groups yield noisier sample means. Observation-level averaging therefore places more weight on larger groups, for which $\mu_{2v}/J_i$ is smaller. This suggests that, when group sizes are very unequal and $\mu_{2v}$ is large relative to $\mu_{2u}$, observation-level averaging may have smaller estimator variance. When $\mu_{2v}$ is small relative to $\mu_{2u}$, however, this variance advantage is attenuated. Because the two averaging schemes correspond to different objects of interest under unbalancedness, estimator variance is secondary to the choice of weighting.

Three-level model

Suppose we observe $y_{ijk}$ in the three-level model,

align*[align* omitted — 103 chars of source]

where $\{u_i\}_{i}$, $\{v_{ij}\}_{i,j}$, and $\{w_{ijk}\}_{i,j,k}$ are unobserved, mutually independent, and within each level i.i.d., with $\mathbb{E}[u]=\mathbb{E}[v]=\mathbb{E}[w]=0$. We assume $n\geq 3$, $J_i\geq 3$, and $K_{ij}\geq 3$ for all $(i,j)$. Let $\mu_{ku}=\mathbb{E}[u^k]$, $\mu_{kv}=\mathbb{E}[v^k]$, and $\mu_{kw}=\mathbb{E}[w^k]$ for $k=2,3$, and define sample means as follows,

align*[align* omitted — 998 chars of source]

where $K_i=\sum_{j}K_{ij}$ and $N=\sum_{i} K_i$. So $K_{ij}$ is the size of group $(i,j)$, $J_i$ is the size of group $i$, $K_i$ is the number of groups in $i$, $n$ is the number of groups overall, and $N$ is the total number of observations. Then $ \bar y_{ij}=u_i+v_{ij}+\bar w_{ij}, $ $\bar y_i^{\mathrm{g}}=u_i+\bar v_i^{\mathrm{g}}+\bar w_i^{\mathrm{g}}, $ $ \bar y_i^{\mathrm{o}}=u_i+\bar v_i^{\mathrm{o}}+\bar w_i^{\mathrm{o}}, $ $ \bar y^{\mathrm{g}}=\bar u^{\mathrm{g}}+\bar v^{\mathrm{g}}+\bar w^{\mathrm{g}}, $ and $ \bar y^{\mathrm{o}}=\bar u^{\mathrm{o}}+\bar v^{\mathrm{o}}+\bar w^{\mathrm{o}}.$

Unbiased estimators of $\mu_{2w}$ and $\mu_{3w}$ are

align*[align* omitted — 229 chars of source]

Unbiased estimators of $\mu_{2v}$, $\mu_{3v}$, $\mu_{2u}$, and $\mu_{3u}$ under group-level averaging are

align*[align* omitted — 971 chars of source]

Unbiased estimators of $\mu_{2v}$, $\mu_{3v}$, $\mu_{2u}$, and $\mu_{3u}$ under observation-level averaging are

align*[align* omitted — 1,518 chars of source]

Conclusion

This paper derives closed-form unbiased estimators for the second, third, and fourth central moments in unbalanced two-level models, and for the second and third central moments in unbalanced three-level models. We provide these results under both group-level and observation-level averaging, allowing researchers to align estimation with their sampling design and population of interest.

The approach extends to richer multilevel designs via a three-step strategy: (i) write centered sample averages as weighted sums of latent components; (ii) apply Lemma (ref) to express expectations of powers and cross-products of these averages in terms of latent moments; and (iii) solve the resulting linear system using sample analogs and previously derived lower-order estimators. Already at the fourth moment this requires systems involving cross-products, so closed-form expressions beyond the cases treated here are best derived case-by-case for the hierarchy and moments of interest.