Robust transfer learning for high-dimensional regression with linear constraints

Abstract

Transfer learning is a method to improve the estimation and prediction accuracy of the target model by transferring the source data when the available data of the target data is relatively few. However, existing transfer learning methods tend to ignore the heterogeneity and heavy-tailedness of high-dimensional data. So we consider the Huber regression, which is robust to thick-tailed distributed data and outliers. Based on the high-dimensional model, this paper adds the constraint conditions of prior information, carries out the research of robust transfer learning and uses Huber regression to estimate the coefficients of the target model. In this paper, we design corresponding transfer learning algorithms for known and unknown transferable sources, and prove the effectiveness of this method through simulation experiments and actual cases.

Keywords:

• Linear constraints
• Huber regression
• robust
• transfer learning

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work was supported by National Key Research and Development Program of China (2021YFA1000102), Fundamental Research Funds for the Central Universities (No. 23CX03012A).