Incremental modelling for compositional data streams

ABSTRACT

Incremental modelling of data streams is of great practical importance, as shown by its applications in advertising and financial data analysis. We propose two incremental covariance matrix decomposition methods for a compositional data type. The first method, exact incremental covariance decomposition of compositional data (C-EICD), gives an exact decomposition result. The second method, covariance-free incremental covariance decomposition of compositional data (C-CICD), is an approximate algorithm that can efficiently compute high-dimensional cases. Based on these two methods, many frequently used compositional statistical models can be incrementally calculated. We take multiple linear regression and principle component analysis as examples to illustrate the utility of the proposed methods via extensive simulation studies.

KEYWORDS:

• Compositional data
• Covariance matrix
• Eigen decomposition
• Data stream

Acknowledgments

This research is supported partly by the National Natural Science Foundation of China (Grant No. 71420107025, 11701023).

Funding

National Natural Science Foundation of China ID: 11701023,71420107025.