EconBase
← Back to paper

Bayesian Clustered Coefficients Regression with Auxiliary Covariates Assistant Random Effects

Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.

57,679 characters · 16 sections · 46 citation commands

Rendered from LaTeX for readability, not typeset faithfully. Citation keys are highlighted; maths is left as source; figures, tables and equation environments are summarised rather than reproduced; unrecognised commands are greyed out so nothing is silently dropped. Email addresses are removed.

Bayesian Clustered Coefficients Regression with Auxiliary Covariates Assistant Random Effects

abstractIn regional economics research, a problem of interest is to detect similarities between regions, and estimate their shared coefficients in economics models. In this article, we propose a mixture of finite mixtures (MFM) clustered regression model with auxiliary covariates that account for similarities in demographic or economic characteristics over a spatial domain. Our Bayesian construction provides both inference for number of clusters and clustering configurations, and estimation for parameters for each cluster. Empirical performance of the proposed model is illustrated through simulation experiments, and further applied to a study of influential factors for monthly housing cost in Georgia. Keywords: Housing Cost Data, MCMC, Mixture of Finite Mixture, Spatial Clustering

Introduction

Analysis of spatial data referenced over different locations has received widespread attention in many fields such as environmental science hu2018stat,yang2019bayesian, social science bradley2018computationally, and biostatistics xu2019latent. There are two major approaches to analyzing spatial data. The first approach, where spatial variations in the outcome are accounted for by an additive spatial random effect term at each location, has been studied both for the linear model cressie1992statistics and generalized linear model diggle1998model settings. The second approach, a regression model with spatially varying coefficients, is developed to capture spatial variations within the covariate effects themselves. For the spatially varying coefficients model, there are two major approaches for estimation of the regression coefficients. One is geographically weighted regression brunsdon1996geographically, the basic idea of which is to assign different weights to the observations based on a certain measure of distance between them and the target location. This work also has various extensions in generalized linear regression nakaya2005geographically and analysis of survival data hu2018modified,xue2019geographically, as well as under the Bayesian paradigm ma2019bayesian. It has been further extended to multiscale models that allow kernels of different variables to be on different scales, which greatly enhances its model flexibility fotheringham2017multiscale. Another major approach is to give a Gaussian process prior to the spatially varying coefficients gelfand2003spatial, which provides a natural and flexible way to view the coefficient surface as a realization from a spatial process. This work is universally applied into different models such as Poisson regression model reich2010bayesian and survival models hu2020comparison.

Most recently, heterogeneous covariate effects in many different fields, such as real estate applications, spatial econometrics, and environmental science are receiving increasing attention. For example, a country's big cities and small cities could be put into separate clusters and analyzed, as each subgroup share more similarities in development patterns, and thus similar covariate effects in regression models can be expected. Such clustering information is of great interest to regional economics researchers. Existing frequentist approaches include those based on scan statistics kulldorff1995spatial, two-step spatial hypothesis testing lee2017cluster,leespatial2019, and a penalized method based on minimum spanning tree li2019spatial. Under the Bayesian paradigm, an integrated framework ma2019bayesianspatial to detect clusters in the covariate effects as well as producing the parameter estimates for spatially dependent data are proposed, in which clustering is done via the Dirichlet process mixture model neal2000markov,ishwaran2002exact. The DPM, however, has turned out to produce extremely small clusters and make the estimation for number of clusters inconsistent miller2013simple. The mixture of finite mixture (MFM) model proposed by miller2018mixture provides a remedy to over-clustering problem for Bayesian nonparametric methods. Both DPM and MFM allow for uncertainty in the number of clusters instead of relying on a given number, which needs to be tuned based on certain criteria.

While spatial random effects have been used to account for the influence of geographical proximity on the similarity of outcomes for two neighboring observations, in existing approaches, the correlation between spatial random effect terms only depends on distance, and all other factors are ignored. For improvement in describing spatial correlation, some works have been done to bring in auxiliary information to help the estimation of spatial regression model white2009stochastic,lee2014bayesian,gao2019bayesian. These works focus on the estimation of the edge based on some covariates or spatial structure. The regression relationship between the $p$-dimensional covariance matrix and auxiliary information has been explored by zou2017covariance and liu2020semiparametric, which can help reveal the true correlation structure of spatial data. Given the importance of spatial random effects in a spatial regression model, their covariance structure need to be appropriately specified.

In this work, we propose a Bayesian clustered linear regression model with MFM, which when compared to the DPM, consistently estimates the number of clusters. The estimation of parameters remains precise. To our best knowledge, we firstly introduce the MFM in clustered coefficients regression model. In addition, a weighted average correlation structure of auxiliary covariates information is incorporated in linear mixed effects regression model based on Dirichlet prior.

The remainder of the paper is organized as follows. In Section (ref), we present the spatial clustered linear regression model with MFM. In Section (ref) , a MCMC sampling algorithm based on nimble de2017programming and post MCMC inference are discussed. Extensive simulation studies are performed in Section (ref). For illustration, our proposed methodology is applied to Georgia housing cost data in Section (ref). We conclude this paper with a brief discussion in Section (ref).

Method

Spatial Linear Regression

The basic geostatistical model gelfand2016spatial for observations made over a spatial domain can be written as:

equation[equation omitted — 97 chars of source]

where $\bm{Y} = (Y(s_1),\ldots, Y(s_n))$ denotes the $n$-dimensional vector of spatial responses observed at locations $s_1,\ldots,s_n$, $\bm{X} =

pmatrix[pmatrix omitted — 51 chars of source]

$ denotes the~$n\times p$ matrix of covariates, $\bm{\beta}$ is the vector of coefficients, $\bm{w} = (w(s_1),\ldots, w(s_n))^\top$ is a vector of spatial random effects, and $\bm{\epsilon}\sim MVN(\bm{0}, \tau_y^{-1}\bm{I})$ is the ``nugget effect'' with $\tau_y$ being the precision of the response carlin2014hierarchical. The above spatial regression model can be formulated alternatively as

equation*[equation* omitted — 253 chars of source]

where $\bm{w}$ denotes the spatial structure with a covariance matrix $\bm{\Sigma}_{\bm{w}}$, and N and MVN denote the univariate and multivariate normal distributions, respectively. The covariance matrix $\bm{\Sigma_w}$ is often defined to be $\sigma_w^2\bm{H}$, with $\bm{H}$ constructed using the great circle distance (GCD) matrix among different locations via the following three popular weighting schemes:

equation[equation omitted — 264 chars of source]

where $\phi$ is a bandwidth parameter that controls the spatial correlation.

Instead of using spatial random effects, i.e., location-wise intercepts to account for spatial variations in $\bm{Y}$, the spatially varying coefficients model gelfand2003spatial attributes such effects to variations in the parameters over the spatial domain, i.e., the parameter $\bm{\beta}$ itself varies. Such a model is formulated as:

eqnarray[eqnarray omitted — 100 chars of source]

where $\bm{X}(s_i)$ is vector of covariates at location of the $i$th subject $s_i$, and $\widetilde{\bm{\beta}}(s_i)$ is assumed to be generated from a $p$-variate spatial process model. With observations $(Y(s_i),\bm{X}(s_i))$ for $i=1,\ldots, n$, the model can be written as

equation*[equation* omitted — 77 chars of source]

where $\bm{Y}=(Y(s_1), \ldots, Y(s_n))^\top$, $\bm{X}^\top$ is an $n\times (np)$ block diagonal matrix whose $i$-th diagonal entry is $\bm{X}^\top(s_i)$, $\widetilde{\bm{\beta}} = (\widetilde{\bm{\beta}}(s_1)^\top, \ldots, \widetilde{\bm{\beta}}(s_n)^\top)^\top$, and $\bm{\epsilon}\sim \mbox{MVN}(0,\tau_y^{-1}\bm{I})$ with $\bm{I}$ being the identity matrix. To characterize the $p$-variate spatial process that generates $\widetilde{\bm{\beta}}(s_i)$, we rewrite the model as

equation[equation omitted — 339 chars of source]

where $\bm{\mu}_{\bm{\beta}}$ is a $p \times 1$ vector, $\bm{H}(\phi)$ is an $n\times n$-dimensional matrix measuring spatial correlations between the $n$ observed locations, $\bm{T}$ is a $p \times p$ covariance matrix associated with an observation vector at any spatial location, and $\otimes$ denotes the Kronecker product.

In the above formulation, each location has its own $\bm{\beta}$ vector. However, such a model could be too flexible, as there are certain regions that have very similar $\bm{\beta}$ values. From a modeling perspective, clustering such regions and having them all share one parameter vector encourages a parsimonious model without compromising the model's explanatory power. Another potential drawback of formulation in ((ref)) is that all variations are accounted for by $\widetilde{\bm{\beta}}$, and spatial random effects are ignored. However, the random effects term is rather important, and influenced not only by distance but also other factors such as demographics, transportation, etc. Therefore, a model with clustered coefficients, and also random effects terms that help account for the intricate connections between regions is desired.

Mixture of Finite Mixture Model

Based on the heterogeneity pattern, we focus on the clustering of spatially-varying coefficients. A latent clustering structure can be introduced to accommodate the spatial heterogeneity on parameters of sub-areas. Let us denote the cluster belongings of the $i$th observation as $z_i$ for $i=1,\ldots, n$. The Dirichlet process ferguson1973bayesian offers a nonparametric approach for capturing heterogeneity effects in the data. The DP prior for the cluster belonging of the $i$th observation can be written as

equation[equation omitted — 219 chars of source]

where $k \rightarrow \infty$, $\pi_h$ denotes the random probability weight, $\delta_h$ is the Dirac $\delta$ with point mass at $h$, and $\alpha$ is the concentration parameter. The first equation in (ref) can be expressed equivalently as a multinomial distribution:

equation*[equation* omitted — 112 chars of source]

and we will use the $\sum_{h=1}^k \pi_h \delta_{h}$ notation for simplicity for the rest of this paper. The joint distribution for $z_1,\cdots,z_n$ can also be written as a conditional distribution, known as the Chinese restaurant process pitman1995exchangeable, neal2000markov. The distribution of $z_i$ is marginally represented by the stick-breaking construction of sethuraman1994constructive as

equation[equation omitted — 186 chars of source]

miller2013simple showed that the posterior distribution on the number of clusters does not converge to the true number of components, and extraneous clusters are often produced by the CRP. Later, miller2018mixture proposed a modification of the CRP called a mixture of finite mixtures (MFM) model to circumvent this issue, which can be formulated as

eqnarray[eqnarray omitted — 235 chars of source]

where $p(\cdot)$ is a proper probability mass function (p.m.f) on $\{1, 2, \ldots\}$. A default choice of $p(\cdot)$ is a $\mbox{Poisson}(1)$ distribution truncated to be positive miller2018mixture, which is assumed through the rest of the paper. Analogous to the stick-breaking representation in (ref), the MFM also has a similar construction. If we choose $k-1 \sim \mbox{Poisson}(\lambda)$ and $\gamma=1$ in (ref), the mixture weights $\pi_1,\cdots,\pi_k$ can be constructed as:

enumerate• Generate $\eta_1,\eta_2,\cdots \overset{\text{iid}}{\sim} \text{Exp}(\lambda)$, • $k=\min\{j:\sum_{i=1}^j \eta_i\geq 1\}$, • $\pi_i=\eta_i$, for $i=1,\cdots,k-1$, • $\pi_k=1-\sum_{i}^{k-1}\pi_i$.

Gibbs samplers are easily constructed in stick-breaking framework ishwaran2001gibbs. For ease of exposition, we refer to the formulation in (ref) as $\text{MFM}(\gamma,\lambda)$.

Auxiliary Covariates Assistant Covariance Matrix

In the regression model (ref) where spatial random effects are present, their covariance structure often depend on the geographical distance between pairs of locations, which in general indicates that closer locations have stronger correlation, and is in accordance with Tobler's first law of geography that “everything is related to everything else, but near things are more related than distant things”. In most economics problems, however, spatial proximity might not be the sole indicator for similarity, as there can be geographically distant locations that share similar demographical characteristics. For example, while the GCD between New York City and Albany is only 135 miles, which is far less than the 2569 miles between New York City and San Francisco (calculated using ggmap and geosphere packages in R), the population density of Albany is only 4525.3 per square mile, which is far smaller than those of New York City and San Francisco, which are, respectively, 27,709.4 and 19,104.4 per square mile worldpopulation2020. To incorporate such similarities into the covariance structure for random effects, motivated by covariance regression zou2017covariance and Bayesian model averaging raftery1997bayesian, we propose the following auxiliary covariates assistant covariance (ACAC) matrix for random effects in a mixture regression model:

equation[equation omitted — 255 chars of source]

where $\sigma^2$ is a constant accounting for the overall magnitude of variance, $\bm{w}=(w(s_1),\cdots,w(s_n))^\top$, and $\bm{W}(\bm{Z}_j),j=1,\cdots,J$ is the similarity matrix of the $j$th auxiliary covariate. Entries of the similarity matrix have values between 0 and 1, and are usually decreasing with respect to the absolute difference between values of the auxiliary covariates. The three aforementioned weighting schemes in (ref) can be used to define $\bm{W}(\bm{Z}_j)$. For example, an exponential decay similarity matrix $\bm{W}(\bm{Z}_j)$ can be constructed so that its $(\ell, \ell^{'})$-th element is

equation[equation omitted — 89 chars of source]

where $\kappa_j>0$ is the range parameter for the exponential kernel, and $|\cdot|$ denotes the Euclidean distance. In order to solve the identifiability issue, we set a constraint for $\alpha_0,\alpha_1,\cdots,\alpha_J$:

equation[equation omitted — 147 chars of source]
PropositionIf we have $J$ $n\times n$ positive definite matrices $\bm{\Sigma}_1,\ldots,$ $\bm{\Sigma}_J$, and a sequence of positive numbers $\alpha_0,\ldots,\alpha_J$ which satisfy $\sum_{j=0}^J \alpha_j=1$ and $0\leq \alpha_j \leq 1$ for $j=0,1,\cdots,J$, then the matrix $\bm{\Sigma}=\alpha_0\bm{I}_n+ \sum_{i=1}^J \alpha_i\bm{\Sigma}_i$ is positive definite.

Proof for this proposition is directed to Supplemental Section S.1.

Based on the constraint in (ref), a Dirichlet prior is assigned to $\alpha_0,\cdots,$ $\alpha_J$. The prior distribution of $\alpha_0,\alpha_1,\cdots,\alpha_J$ is given as

equation[equation omitted — 98 chars of source]

where $\text{Dirichlet}(\nu)$ is the Dirichlet distribution with parameter $\nu$.

Spatial MFM Clustered Regression with ACAC

Combining the MFM and ACAC matrix, we have our final spatial MFM clustered regression model with ACAC hierarchically as follows, for $i = 1, \cdots, n$:

equation[equation omitted — 790 chars of source]

where $\bm{w} = (w(s_1), \cdots, w(s_n))^\top$, $\bm{\beta}_{z_i} = (\beta_{z_i1}, \cdots, \beta_{z_ip})^\top$ with $p$ being the dimension of the covariates $\bm{X}(s_i)$, $\bm{W}(\cdot)$ is the similarity matrix of the corresponding auxiliary covariate defined in ((ref)), and MFM the clustering method introduced in Section (ref). The choice of hyperparameters will be discussed in Section (ref).

Bayesian Inference

Bayesian Computation

Let $\bm{\theta}= \{(\tau_y, \mu_{z_i\ell}, \tau_{z_i\ell}, \sigma^2, \lambda, \kappa_j, \bm{\alpha}): i = 1,\cdots,n; \ell = 1,\cdots,p; j=1,\cdots,J\}$ denote the set of unknown parameters in the proposed model, and we assume that they are independent a priori. Therefore, we assign commonly used priors for these parameters: $\tau_y \sim \text{Gamma}(1,1)$, $\mu_{z_i\ell} \sim \mbox{N}(0, 1)$, $\tau_{z_i\ell} \sim \text{Gamma}(1,1)$, $\sigma^2 \sim \mbox{InverseGamma(1, 1)}$, $\lambda \sim \text{log-normal}(0, 1)$, $1/\kappa_j \sim \text{Gamma}(1, 1)$, and $\bm{\alpha} \sim \text{Dirichlet}(1,$ $1, \cdots)$. With the prior distributions specified above, the posterior distribution of these unknown parameters based on the data $D = \{Y(s_i), \bm{X}(s_i),$ $\bm{Z}_j\}$ is given by

align*[align* omitted — 277 chars of source]

The analytical form of the posterior distribution of $\bm{\theta}$ is unavailable. Therefore, we employ the Markov chain Monte Carlo (MCMC) sampling algorithm to sample from the posterior distribution, and then obtain the posterior estimates for the unknown parameters. Computation is facilitated by the nimble package in R, which uses syntax similar to WinBUGS and JAGS, but generates C++ code for faster computation. With the nimble package, sampling algorithms for the parameters are default samplers. For parameters $\bm{\alpha}$, a random-walk Dirichlet sampler is used. For $\bm{\beta}_{z_i}$, a random-walk block sampler is used. The same sampler is used for parameter $\bm{w}$. The conjugate sampler is used for $\tau_y$ and a categorical sampler is used for $z_i$, while for the other parameters, a random-walk sampler is applied.

Posterior Inference and Diagnostic

In the proposed spatial regression model, since the covariance matrix of the spatial random effects can be constructed in different ways, including the unity, exponential, and Gaussian weighting schemes in (ref), a model selection criterion needs to be used for deciding which form of the covariance matrix is the most suitable for the data. A commonly used Bayesian model selection criterion, logarithm of the pseudo-marginal likelihood ibrahim2013bayesian can be used for this purpose. The LPML can be obtained through the conditional predictive ordinate (CPO) values, which are the Bayesian estimates for the probability of observing $Y_i$ in the future after other observations are made. Let $Y^*_{(-i)} = \{Y_j: j = 1, \cdots, i-1, i+1, \cdots, n\}$ denote the observations with the $i$th subject response removed. The CPO for the $i$th subject is defined as:

equation[equation omitted — 230 chars of source]

where

align*[align* omitted — 247 chars of source]

with $c(Y^*_{(-i)})$ being the normalizing constant. As discussed in chen2012monte, $\mbox{CPO}_i$ is also called the cross-validated predictive density, and Equation (ref) is essentially integrating the predictive distribution of $y(s_i)$ given the rest of the observations. It is a useful quantity for model checking, as it describes how much the observation at location $s_i$ supports the model. An equivalent expression for $\mbox{CPO}_i$ is:

equation[equation omitted — 147 chars of source]

where $\bm{\theta}$ denote the parameters of the model. Let $\{\bm{\theta}_t,~t=1,\ldots,T\}$ denote a Gibbs sample of $\bm{\theta}$ from $p(\bm{\theta\mid \bm{y}})$, using Equation (ref), a Monte Carlo estimate of the CPO can be obtained as:

equation[equation omitted — 171 chars of source]

where $T$ is the total number of Monte Carlo iterations. Based on $\widehat{\mbox{CPO}_i}$, the LPML can be estimated as:

equation[equation omitted — 106 chars of source]

A larger LPML value indicates better model fit.

Similar to ma2019bayesianspatial, we use the Rand index rand1971objective to evaluate the clustering performance, i.e., whether the final inferred clusters align well with the truth. Consider two partitions of $\{1,2,\ldots,n\}$, denoted as $\mathcal{C}_1 = \{A_1,\ldots,A_r\}$ and $\mathcal{C}_2 = \{ B_1,\ldots, B_s\}$. Out of all $n \choose 2$ pairs of observations, denote:

itemize$a =$ the number of pairs that are in the same set in $\mathcal{C}_1$ and in the same set in $\mathcal{C}_2$$b =$ the number of pairs that are in different sets in $\mathcal{C}_1$ and in different sets in $\mathcal{C}_2$$c=$ the number of pairs that are in the same set in $\mathcal{C}_1$ but different sets in $\mathcal{C}_2$$d=$ the number of pairs that are in different sets in $\mathcal{C}_1$ but the same set set in $\mathcal{C}_2$.

With the above specifications, the RI is calculated as

equation[equation omitted — 72 chars of source]

It can be seen that the RI ranges from 0 to 1, with a larger value suggesting better concordance between two clustering partitions. Computation of the RI is done using the R package fossil Rpkg:fossil.

Simulation

Simulation Settings and Evaluation Metrics

We study the estimation performance as well as the clustering performance in this section. Two designs of true cluster configuration of Georgia counties are considered. The first case is similar to in ma2019bayesianspatial, where there are, respectively, 51, 49, and 59 counties in each cluster. The second is less balanced with 26, 44, and 89 counties in each cluster. The two partition schemes used in designing the simulation study are visualized in Figure (ref).

figure[figure omitted — 231 chars of source]

We consider the following data generation model:

equation[equation omitted — 100 chars of source]

where $\bm{w}$ is the distance- and auxiliary covariates-dependent vector of spatial random effects such that $$\bm{w}\sim \mbox{MVN}(\bm{0}, 0.25(0.81\bm{I} + 0.04\exp(-\mbox{GCD} / 4) + 0.05\bm{W}(\bm{Z}_1) + 0.1\bm{W}(\bm{Z}_2)),$$ with $\bm{Z}_1$ and $\bm{Z}_2$ being the two auxiliary covariates.

The two similarity matrices $\bm{W}(\bm{Z}_1)$ and $\bm{W}(\bm{Z}_2)$ are constructed using (ref) with $\kappa_1 =5$ and $\kappa_2 = 3$. The true parameters for the similarity matrices are set to relatively small values compared to $\alpha_0$ following zou2017covariance. For both partition schemes shown in Figure (ref), the true parameter vector for cluster 1 is set to $(4,1,-2)$, for cluster 2 $(1, 1, 0)$, and for cluster 3 $(1, -2, -1)$. For each partition shown in Figure (ref), a total of 100 datasets are generated.

In addition to the proposed model, to verify that identifying clusters do help with better estimation of the underlying coefficients, two additional models are fitted. The first alternative model is a Bayesian regression model either without clusters or spatial random effects, but includes the auxiliary covariates as main effects. It can be written hierarchically as

equation[equation omitted — 277 chars of source]

where $\widetilde{\bm{X}}(s_i)$ in this case becomes $\widetilde{\bm{X}}(s_i) = \left(X_1(s_i), X_2(s_i), X_3(s_i), Z_1(s_i), Z_2(s_i)\right)^\top$, and $\bm{\beta}\in\mathbb{R}^5$. We set $\sigma_\beta^2=100$ to induce a non-informative prior for $\bm{\beta}$.

The second alternative model is the Bayesian mixed model with spatial random effects but without clustering, which can be written as

equation[equation omitted — 391 chars of source]

Again, the parameter $\sigma_\beta^2$ is set to 100 to make a noninformative prior for $\bm{\beta}$.

The proposed approach and the two alternative models are evaluated in terms of parameter estimation. For estimation of the vector of coefficients, $\bm{\beta}$, we employ the mean absolute bias (MAB), mean standard deviation (MSD), mean of mean squared error (MMSE), and mean coverage rate (MCR) for assessment:

align[align omitted — 621 chars of source]

where $\widehat{\beta}_{\ell m r}$ denotes the posterior estimate for the $m$th coefficient of county $\ell$ in the $r$th replicate, $\overline{\widehat{\beta}}_{\ell m} = \frac{1}{100}\sum_{r=1}^{100} \widehat{\beta}_{\ell m r}$ , $\beta_{\ell m}$ is the true underlying parameter value, $\mbox{HPD}_{{\widehat{\beta}_{\ell m r }}}$ is the 95% highest posterior density interval for $\beta_{\ell m}$ in the $r$th replicate, and $1(\cdot)$ denotes the indicator function. Also, note that for the first alternative model, as we are primarily interested in estimation of the three true main effects, we omit the performance measures for the coefficients for the two auxiliary variables.

For each replicate, we set the chain length to 25,000 with thinning interval 2. The first 9,500 of retained samples are discarded as burn-in, and we use the remaining 3,000 iterations for posterior inference. The final cluster belonging inferred for each county is taken as the first mode of the posterior samples for $z_i$, $i=1,\ldots, 159.$

Simulation Results

figure[figure omitted — 218 chars of source]

First we check the estimation performance using the four performance measures defined above. For ease of reference, we name the three competitive models as Alternative 1, Alternative 2, and proposed. It can be seen from the first row that with the incorporation of different clusters, each cluster of locations are allowed to have their own parameter vector. This additional flexibility of the proposed model enables less biased parameter estimation. As the proposed model includes clustering process, the chains for each parameter may jump between several underlying clusters, which causes their MSD to be larger than those for Alternatives 1 and 2, which restrict that all locations have the same set of parameters. However, with improved MAB, parameter estimates produced by the proposed model still have smaller MMSE than the other two models. Finally, as Alternatives 1 and 2 do not allow for clusters of coefficients, their parameter estimates are essentially close to the average of parameters over the 159 locations, which leads to their very low MCR.

figure[figure omitted — 316 chars of source]

The clustering performance of the proposed approach is presented in Figure (ref). Comparing across the two panels, it can be seen that under Design 1 there are more replicates where $K$ is correctly inferred, while under Design 2 there are more under-clustering replicates, which is due to its class imbalance. The average Rand index (ARI)'s turned out to be 0.703 and 0.752 for the two cases, respectively.

Finally, to verify that LPML is capable of reflecting the degree of fitness of the model to the data, for each simulation replicate, the LPML values of the three models are calculated. A boxplot of the 100 LPML values for each model under Designs 1 and 2 is given in Figure (ref). As discussed before, larger LPML values indicate better model fit. As clearly seen in the figure, the proposed model has overall much larger LPML values than the two alternatives, indicating that LPML is indeed capable of identifying a more suitable model in the scope of the research problem considered here.

figure[figure omitted — 152 chars of source]

Real Data Analysis

Georgia Housing Cost Data

The Georgia monthly housing dataset can be accessed at https://github.com/ys-xue/Bayesian-clustered-coefficients-regression -ACAC in .csv format. The original data source is www.healthanalytics.gatech.edu, which contains visualizations of data concerning multiple dimensions of Georgia. For each of the 159 counties, the median monthly housing cost for occupied housing units is observed. In addition, several independent variables are available: the unemployment percentage for adults between 18 and 64 years of age ($X_1$), the average per individual real and personal property taxes ($X_2$), the median home market value in thousand dollars ($X_3$), the White race population percentage ($Z_1$), the median age ($Z_2$), and population size in thousands ($Z_3$).

In our analysis, the first three economy-related covariates, $X_1$, $X_2$ and $X_3$, are used in the spatial regression part, while the remaining three demographic covariates are used in constructing the covariance matrix of spatial random effects. The final model is written as, for $i=1,\cdots, 159$,

equation*[equation* omitted — 619 chars of source]

where the $(k,k')$-th element of $W(\bm{Z}_j)$ for $(j = 1, 2, 3)$ is $\exp(- \kappa_j |Z_j(s_k) - Z_j(s_k')|)$, respectively, while for $W(\bm{Z}_4)$, the entry is $\text{exp}(-\kappa_4 \cdot \mbox{GCD})$. The priors of the unknown parameters are assigned as mentioned in Section (ref). Similar to in the simulation study, after burning in the first 9,500 of 12,500 iterations, 3,000 MCMC samples are collected the parameters. Similar to in the simulation studies, the final cluster configuration is obtained as the first mode from the posterior samples in the chains corresponding to $z_1,\ldots,z_{159}$.

Analysis Results

We firstly apply the LPML to select the most suitable covariance structure of spatial effects $\bm{\Sigma}_{\bm{w}}$ for the model. The LPML values of the proposed auxiliary covariates assistant covariance matrix, the unity scheme, the exponential scheme and the Gaussian scheme are shown in Table (ref). Comparison of the LPML values leads to the conclusion that the proposed auxiliary covariates assisted covariance matrix provides the most suitable approximation for the covariance structure of the spatial random effects for this dataset, as it has the largest LPML value among the candidate covariance structures. Therefore the auxiliary covariates assisted covariance matrix is used in all subsequent analyses. The two alternative models we considered in the simulation studies are also examined, and their LPML values are also included in Table (ref). Among the candidate models considered, the proposed model that employs the ACAC has the largest LPML model, indicating that it is the most suitable choice to capture the heterogeneity in the Georgia housing cost data.

table[table omitted — 309 chars of source]

Three clusters of the coefficients in the spatial regression part $\left\{\beta_\ell(\bm{s})\right\}_{\ell=1}^p$ are identified through the MFM approach, whose posterior estimates are shown in Table (ref) and the cluster belongings of the 159 counties are visualized in Figure (ref). In addition, the traceplot for the number of clusters, $k$, is included in the supplemental material to verify convergence of the results. Convergence is further verified with Dahl's method dahl2006model in Section S2 of the supplemental material. Cluster 1 includes 10 counties and cluster 3 consists of 5 counties, while the rest 144 counties all fall within cluster 2. Taking a closer look, cluster 1 consists of Fulton, Douglas, Paulding, Henry, Newton, Barrow, Chattahoochee Lee, Effingham and Liberty, which are all relatively economically developed counties in terms of per capita income (among the top 50 according to 2015 United States Census Data and the 2006-2010 American Community Survey 5-Year Estimates) except Liberty. Cluster 3 consists of Fannin, Union, Towns, Rabun, and Clay. Both clusters include neighboring counties and non-adjacent counties, which again echos the finding in our simulation study that the proposed method takes into consideration both spatial adjacency and the inherent similarity between covariates that influence the spatial random effects.

table[table omitted — 839 chars of source]
figure[figure omitted — 166 chars of source]

From Table (ref), for counties belonging to cluster 2, the percentage of unemployment and the median house market price can help explain the change of median monthly housing cost. However, for the other counties, neither the factors we selected has impact on the dependent variable. Also, the intercept term for cluster 2 is noticeably negative, indicating a difference in the overall level of housing cost between counties in cluster 2 and those in the other two clusters.

Table (ref) shows the posterior estimates of the overall variance term of spatial random effects, $\sigma^2$, and coefficients for the similarity matrices. By comparing the posterior estimates of $\alpha_j (j = 0, \cdots, 4)$ in the auxiliary covariates assisted covariance matrix of the spatial effects, we can see that the similarity matrices defined by the size of population and the percentage of White race population have greater impact on the covariance matrix of spatial effects.

table[table omitted — 650 chars of source]

Discussion

In this paper, we propose a Bayesian clustered coefficients regression model with auxiliary covariates assistant random effects. Our proposed model has two practical merits. First, our model simultaneously estimates the number of clusters and clustering configurations of regression coefficients. Second, auxiliary covariates information are included in our random effects model. The usage of proposed method is illustrated in simulation studies, where it shows accurate estimation and clustering performance. For Georgia housing cost data, our method dominates the other benchmark methods in terms of LPML.

In addition, three topics beyond the scope of this paper are worth further investigation. First, in our real data application, auxiliary covariates are selected based on their natures, which is not always available or clearly categorized in all possible applications. Proposing a quantitative criterion for auxiliary covariates determination is an interesting future work. Furthermore, different clusters may have different sparsity patterns of the covariates. Incorporating different sparsity structure of regression coefficients into the model will enable selection and identification of most important covariates. Finally, considering geographical information for clustering detection hu2020bayesian,zhao2020bayesian,geng2020bayesian is also devoted to future research.

thebibliography{46} \expandafter\ifx\csname urlstyle\endcsname\relax \else \fi \bibitem[Bradley et al.(2018)Bradley, Holan, Wikle, et al.]{bradley2018computationally} {\rm Bradley, J. R., Holan, S. H., Wikle, C. K., et al.} (2018). \newblock Computationally efficient multivariate spatio-temporal models for high-dimensional count-valued data (with discussion). \newblock Bayesian Analysis, {\bf 13}\penalty0 (1), \penalty0 253--310. \bibitem[Brunsdon et al.(1996)Brunsdon, Fotheringham, and Charlton]{brunsdon1996geographically} {\rm Brunsdon, C., Fotheringham, A. S., {\rm and} Charlton, M. E.} (1996). \newblock Geographically weighted regression: a method for exploring spatial nonstationarity. \newblock Geographical Analysis, {\bf 28}\penalty0 (4), \penalty0 281--298. \bibitem[Carlin et al.(2014)Carlin, Gelfand, and Banerjee]{carlin2014hierarchical} {\rm Carlin, B. P., Gelfand, A. E., {\rm and} Banerjee, S.} (2014). \newblock Hierarchical Modeling and Analysis for Spatial Data. \newblock Chapman and Hall/CRC. \bibitem[Chen et al.(2012)Chen, Shao, and Ibrahim]{chen2012monte} {\rm Chen, M.-H., Shao, Q.-M., {\rm and} Ibrahim, J. G.} (2012). \newblock Monte Carlo Methods in {B}ayesian computation. \newblock Springer Science & Business Media. \bibitem[Cressie(1992)]{cressie1992statistics} {\rm Cressie, N.} (1992). \newblock Statistics for spatial data. \newblock Terra Nova, {\bf 4}\penalty0 (5), \penalty0 613--617. \bibitem[Dahl(2006)]{dahl2006model} {\rm Dahl, D. B.} (2006). \newblock Model-based clustering for expression data via a {D}irichlet process mixture model. \newblock Bayesian Inference for Gene Expression and Proteomics, {\bf 4}, \penalty0 201--218. \bibitem[de Valpine et al.(2017)de Valpine, Turek, Paciorek, Anderson-Bergman, Lang, and Bodik]{de2017programming} {\rm de Valpine, P., Turek, D., Paciorek, C. J., Anderson-Bergman, C., Lang, D. T., {\rm and} Bodik, R.} (2017). \newblock Programming with models: writing statistical algorithms for general model structures with {NIMBLE}. \newblock \emph{Journal of Computational and Graphical Statistics}, {\bf 26}\penalty0 (2), \penalty0 403--413. \bibitem[Diggle et al.(1998)Diggle, Tawn, and Moyeed]{diggle1998model} {\rm Diggle, P. J., Tawn, J. A., {\rm and} Moyeed, R.} (1998). \newblock Model-based geostatistics. \newblock \emph{Journal of the Royal Statistical Society: Series C (Applied Statistics)}, {\bf 47}\penalty0 (3), \penalty0 299--350. \bibitem[Ferguson(1973)]{ferguson1973bayesian} {\rm Ferguson, T. S.} (1973). \newblock A {B}ayesian analysis of some nonparametric problems. \newblock \emph{Annals of Statistics}, {\bf 1}\penalty0 (2), \penalty0 209--230. \bibitem[Fotheringham et al.(2017)Fotheringham, Yang, and Kang]{fotheringham2017multiscale} {\rm Fotheringham, A. S., Yang, W., {\rm and} Kang, W.} (2017). \newblock Multiscale geographically weighted regression {(mgwr)}. \newblock \emph{Annals of the American Association of Geographers}, {\bf 107}\penalty0 (6), \penalty0 1247--1265. \bibitem[Gao and Bradley(2019)]{gao2019bayesian} {\rm Gao, H. {\rm and} Bradley, J. R.} (2019). \newblock {B}ayesian analysis of areal data with unknown adjacencies using the stochastic edge mixed effects model. \newblock \emph{Spatial Statistics}, {\bf 31}, \penalty0 100357. \bibitem[Gelfand and Schliep(2016)]{gelfand2016spatial} {\rm Gelfand, A. E. {\rm and} Schliep, E. M.} (2016). \newblock Spatial statistics and {G}aussian processes: A beautiful marriage. \newblock \emph{Spatial Statistics}, {\bf 18}, \penalty0 86--104. \bibitem[Gelfand et al.(2003)Gelfand, Kim, Sirmans, and Banerjee]{gelfand2003spatial} {\rm Gelfand, A. E., Kim, H.-J., Sirmans, C., {\rm and} Banerjee, S.} (2003). \newblock Spatial modeling with spatially varying coefficient processes. \newblock \emph{Journal of the American Statistical Association}, {\bf 98}\penalty0 (462), \penalty0 387--396. \bibitem[Geng and Hu(2021)]{geng2020bayesian} {\rm Geng, L. {\rm and} Hu, G.} (2021). \newblock Bayesian spatial homogeneity pursuit for survival data with an application to the {SEER} respiration cancer. \newblock \emph{Biometrics}. \newblock Forthcoming. \bibitem[Hu and Bradley(2018)]{hu2018stat} {\rm Hu, G. {\rm and} Bradley, J.} (2018). \newblock A {B}ayesian spatial-temporal model with latent multivariate log-gamma random effects with application to earthquake magnitudes. \newblock \emph{Stat}, {\bf 7}\penalty0 (1), \penalty0 e179. \newblock e179 sta4.179. \bibitem[Hu and Huffer(2020)]{hu2018modified} {\rm Hu, G. {\rm and} Huffer, F.} (2020). \newblock Modified {K}aplan--{M}eier estimator and {N}elson--{A}alen estimator with geographical weighting for survival data. \newblock \emph{Geographical Analysis}, {\bf 52}\penalty0 (1), \penalty0 28--48. \bibitem[Hu et al.(2020{a})Hu, Geng, Xue, and Sang]{hu2020bayesian} {\rm Hu, G., Geng, J., Xue, Y., {\rm and} Sang, H.} (2020{a}). \newblock {B}ayesian spatial homogeneity pursuit of functional data: an application to the {U.S.} income distribution. \newblock \emph{arXiv preprint arXiv:2002.06663}. \bibitem[Hu et al.(2020{b})Hu, Xue, and Huffer]{hu2020comparison} {\rm Hu, G., Xue, Y., {\rm and} Huffer, F.} (2020{b}). \newblock A comparison of {B}ayesian accelerated failure time models with spatially varying coefficients. \newblock \emph{Sankhya B}. \newblock Forthcoming. \bibitem[Ibrahim et al.(2013)Ibrahim, Chen, and Sinha]{ibrahim2013bayesian} {\rm Ibrahim, J. G., Chen, M.-H., {\rm and} Sinha, D.} (2013). \newblock \emph{{B}ayesian Survival Analysis}. \newblock Springer Science & Business Media. \bibitem[Ishwaran and James(2001)]{ishwaran2001gibbs} {\rm Ishwaran, H. {\rm and} James, L. F.} (2001). \newblock {G}ibbs sampling methods for stick-breaking priors. \newblock \emph{Journal of the American Statistical Association}, {\bf 96}\penalty0 (453), \penalty0 161--173. \bibitem[Ishwaran and Zarepour(2002)]{ishwaran2002exact} {\rm Ishwaran, H. {\rm and} Zarepour, M.} (2002). \newblock Exact and approximate sum representations for the {D}irichlet process. \newblock \emph{Canadian Journal of Statistics}, {\bf 30}\penalty0 (2), \penalty0 269--283. \bibitem[Kulldorff and Nagarwalla(1995)]{kulldorff1995spatial} {\rm Kulldorff, M. {\rm and} Nagarwalla, N.} (1995). \newblock Spatial disease clusters: detection and inference. \newblock \emph{Statistics in Medicine}, {\bf 14}\penalty0 (8), \penalty0 799--810. \bibitem[Lee et al.(2014)Lee, Rushworth, and Sahu]{lee2014bayesian} {\rm Lee, D., Rushworth, A., {\rm and} Sahu, S. K.} (2014). \newblock A {B}ayesian localized conditional autoregressive model for estimating the health effects of air pollution. \newblock \emph{Biometrics}, {\bf 70}\penalty0 (2), \penalty0 419--429. \bibitem[Lee et al.(2017)Lee, Gangnon, and Zhu]{lee2017cluster} {\rm Lee, J., Gangnon, R. E., {\rm and} Zhu, J.} (2017). \newblock Cluster detection of spatial regression coefficients. \newblock \emph{Statistics in Medicine}, {\bf 36}\penalty0 (7), \penalty0 1118--1133. \bibitem[Lee et al.(2019)Lee, Sun, and Chang]{leespatial2019} {\rm Lee, J., Sun, Y., {\rm and} Chang, H. H.} (2019). \newblock Spatial cluster detection of regression coefficients in a mixed-effects model. \newblock \emph{Environmetrics}, page e2578. \bibitem[Li and Sang(2019)]{li2019spatial} {\rm Li, F. {\rm and} Sang, H.} (2019). \newblock Spatial homogeneity pursuit of regression coefficients for large datasets. \newblock \emph{Journal of the American Statistical Association}, {\bf 114}\penalty0 (527), \penalty0 1050--1062. \bibitem[Liu et al.(2020)Liu, Ma, and Wang]{liu2020semiparametric} {\rm Liu, J., Ma, Y., {\rm and} Wang, H.} (2020). \newblock Semiparametric model for covariance regression analysis. \newblock \emph{Computational Statistics & Data Analysis}, {\bf 142}, \penalty0 106815. \bibitem[Ma et al.(2020{a})Ma, Xue, and Hu]{ma2019bayesian} {\rm Ma, Z., Xue, Y., {\rm and} Hu, G.} (2020{a}). \newblock Geographically weighted regression analysis for spatial economics data: A {B}ayesian recourse. \newblock \emph{International Regional Science Review}. \newblock Forthcoming. \bibitem[Ma et al.(2020{b})Ma, Xue, and Hu]{ma2019bayesianspatial} {\rm Ma, Z., Xue, Y., {\rm and} Hu, G.} (2020{b}). \newblock Heterogeneous regression models for clusters of spatial dependent data. \newblock \emph{Spatial Economic Analysis}, pages 1--17. \newblock Forthcoming. \bibitem[Miller and Harrison(2013)]{miller2013simple} {\rm Miller, J. W. {\rm and} Harrison, M. T.} (2013). \newblock A simple example of {D}irichlet process mixture inconsistency for the number of components. \newblock In \emph{Advances in Neural Information Processing Systems}, pages 199--206. \bibitem[Miller and Harrison(2018)]{miller2018mixture} {\rm Miller, J. W. {\rm and} Harrison, M. T.} (2018). \newblock Mixture models with a prior on the number of components. \newblock \emph{Journal of the American Statistical Association}, {\bf 113}\penalty0 (521), \penalty0 340--356. \bibitem[Nakaya et al.(2005)Nakaya, Fotheringham, Brunsdon, and Charlton]{nakaya2005geographically} {\rm Nakaya, T., Fotheringham, A. S., Brunsdon, C., {\rm and} Charlton, M.} (2005). \newblock Geographically weighted {P}oisson regression for disease association mapping. \newblock \emph{Statistics in Medicine}, {\bf 24}\penalty0 (17), \penalty0 2695--2717. \bibitem[Neal(2000)]{neal2000markov} {\rm Neal, R. M.} (2000). \newblock {M}arkov chain sampling methods for {D}irichlet process mixture models. \newblock \emph{Journal of Computational and Graphical Statistics}, {\bf 9}\penalty0 (2), \penalty0 249--265. \bibitem[Pitman(1995)]{pitman1995exchangeable} {\rm Pitman, J.} (1995). \newblock Exchangeable and partially exchangeable random partitions. \newblock \emph{Probability Theory and Related Fields}, {\bf 102}\penalty0 (2), \penalty0 145--158. \bibitem[Raftery et al.(1997)Raftery, Madigan, and Hoeting]{raftery1997bayesian} {\rm Raftery, A. E., Madigan, D., {\rm and} Hoeting, J. A.} (1997). \newblock {B}ayesian model averaging for linear regression models. \newblock \emph{Journal of the American Statistical Association}, {\bf 92}\penalty0 (437), \penalty0 179--191. \bibitem[Rand(1971)]{rand1971objective} {\rm Rand, W. M.} (1971). \newblock Objective criteria for the evaluation of clustering methods. \newblock \emph{Journal of the American Statistical Association}, {\bf 66}\penalty0 (336), \penalty0 846--850. \bibitem[Reich et al.(2010)Reich, Fuentes, Herring, and Evenson]{reich2010bayesian} {\rm Reich, B. J., Fuentes, M., Herring, A. H., {\rm and} Evenson, K. R.} (2010). \newblock {B}ayesian variable selection for multivariate spatially varying coefficient regression. \newblock \emph{Biometrics}, {\bf 66}\penalty0 (3), \penalty0 772--782. \bibitem[Sethuraman(1991)]{sethuraman1994constructive} {\rm Sethuraman, J.} (1991). \newblock A constructive definition of {D}irichlet priors. \newblock \emph{Statistics Sinica}, {\bf 4}\penalty0 (2), \penalty0 639--650. \bibitem[Vavrek(2011)]{Rpkg:fossil} {\rm Vavrek, M. J.} (2011). \newblock {fossil}: Palaeoecological and palaeogeographical analysis tools. \newblock \emph{Palaeontologia Electronica}, {\bf 14}\penalty0 (1), \penalty0 1T. \newblock {R} package version 0.3.0. \bibitem[White and Ghosh(2009)]{white2009stochastic} {\rm White, G. {\rm and} Ghosh, S. K.} (2009). \newblock A stochastic neighborhood conditional autoregressive model for spatial data. \newblock \emph{Computational Statistics & Data Analysis}, {\bf 53}\penalty0 (8), \penalty0 3033--3046. \bibitem[{World Population Review}(2020)]{worldpopulation2020} {\rm {World Population Review}} (2020). \newblock The 200 largest cities in the {U}nited {S}tates by population 2020. \newblock \texttt{https://worldpopulationreview.com/us-cities}. \newblock Online; accessed Dec 1, 2020. \bibitem[Xu et al.(2019)Xu, Bradley, and Sinha]{xu2019latent} {\rm Xu, Z., Bradley, J. R., {\rm and} Sinha, D.} (2019). \newblock Latent multivariate log-gamma models for high-dimensional multi-type responses with application to daily fine particulate matter and mortality counts. \newblock \emph{arXiv preprint arXiv:1909.02528}. \bibitem[Xue et al.(2020)Xue, Schifano, and Hu]{xue2019geographically} {\rm Xue, Y., Schifano, E. D., {\rm and} Hu, G.} (2020). \newblock Geographically weighted {C}ox regression for prostate cancer survival data in {L}ouisiana. \newblock \emph{Geographical Analysis}, {\bf 52}\penalty0 (4), \penalty0 570--587. \bibitem[Yang et al.(2019)Yang, Hu, and Chen]{yang2019bayesian} {\rm Yang, H.-C., Hu, G., {\rm and} Chen, M.-H.} (2019). \newblock Bayesian variable selection for {P}areto regression models with latent multivariate log gamma process with applications to earthquake magnitudes. \newblock \emph{Geosciences}, {\bf 9}\penalty0 (4), \penalty0 169. \bibitem[Zhao et al.(2020)Zhao, Yang, Dey, and Hu]{zhao2020bayesian} {\rm Zhao, P., Yang, H.-C., Dey, D. K., {\rm and} Hu, G.} (2020). \newblock {B}ayesian spatial homogeneity pursuit regression for count value data. \newblock \emph{arXiv preprint arXiv:2002.06678}. \bibitem[Zou et al.(2017)Zou, Lan, Wang, and Tsai]{zou2017covariance} {\rm Zou, T., Lan, W., Wang, H., {\rm and} Tsai, C.-L.} (2017). \newblock Covariance regression analysis. \newblock \emph{Journal of the American Statistical Association}, {\bf 112}\penalty0 (517), \penalty0 266--281.