Model-free feature screening for ultrahigh dimensional data via a Pearson chi-square based index

Abstract

For ultrahigh dimensional data, we propose a model-free marginal feature screening procedure, which can handle continuous, categorical and discrete response variables, based on the integral Pearson chi-square (IPC) index. The IPC index can be regarded as an extension of the AD index studied by He et al. [A modified mean-variance feature-screening procedure for ultrahigh-dimensional discriminant analysis. Comput Stat Data Anal. 2019;137:155–169]. When the response variable is categorical, we extend He et al.'s work to the case of allowing a diverging number of response categories. However, the IPC index is difficult to estimate when the response is continuous. Thus we modify it and define the fused IPC index using the slice-and-fuse technique. Our feature screening procedure ranking the IPC or fused IPC index is robust to heavy-tailed features and outliers. The sure screening properties and the ranking consistency properties are established for both categorical and continuous responses under mild conditions. The finite sample performance of the proposed procedure is demonstrated through various numerical simulations and two real data applications.

Keywords:

• Feature screening
• sure screening property
• ranking consistency property
• slicing method
• ultrahigh dimensional data

Disclosure statement

The authors report there are no competing interests to declare.

Additional information

Funding

This work was supported by National Natural Science Foundation of China [grant numbers 11771241 and 11931001].