962
Views
0
CrossRef citations to date
0
Altmetric
Articles

Testing for Unobserved Heterogeneity via k-means Clustering

&
Pages 737-751 | Published online: 24 May 2022
 

Abstract

Clustering methods such as k-means have found widespread use in a variety of applications. This article proposes a split-sample testing procedure to determine whether a null hypothesis of a single cluster, indicating homogeneity of the data, can be rejected in favor of multiple clusters. The test is simple to implement, valid under mild conditions (including nonnormality, and heterogeneity of the data in aspects beyond those in the clustering analysis), and applicable in a range of contexts (including clustering when the time series dimension is small, or clustering on parameters other than the mean). We verify that the test has good size control in finite samples, and we illustrate the test in applications to clustering vehicle manufacturers and U.S. mutual funds.

Supplementary Materials

The supplemental appendix contains additional theoretical and simulation results.

Acknowledgments

For helpful comments we thank the editor and two referees, as well as Tim Bollerslev and Jia Li.

Notes

1 Note that c depends on a variety of features of the problem: the true number of clusters (G), the number of clusters used in the alternative (G˜), the separation of the true cluster means (c), the dimension of the data (d), and, for d>1, the within-variable correlation of the data (Σi), which can vary across i=1,,n.

2 An alternative approach for choosing a value of G to use in the alternative hypothesis is via cross-validation. In this approach, the sample is split into three subsamples: the first for estimation of cluster assignments across a range of values of G; the second for choosing the optimal value Ĝ; the third for testing G = 1 versus G=Ĝ. Such an approach avoids the need for a Bonferroni adjustment, which can cost power, but involves using splitting the data across three subsamples rather than two, which can also cost power. We leave a detailed investigation of such an approach for future research.

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 61.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 123.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.