A two-step machine learning approach to predict S&P 500 bubbles

References

• S. Astill, D.I. Harvey, S.J. Leybourne, and A.R. Taylor, Tests for an end-of-sample bubble in financial time series, Econom. Rev. 36 (2017), pp. 651–666. doi: https://doi.org/10.1080/07474938.2017.1307490
   Web of Science ®Google Scholar
• K. Zbikowski, Using volume weighted support vector machines with walk forward testing and feature selection for the purpose of creating stock trading strategy, Expert. Syst. Appl. 42 (2015), pp. 1797–1805. doi: https://doi.org/10.1016/j.eswa.2014.10.001
   Web of Science ®Google Scholar
• B.E. Boser, I.M. Guyon, and V.N. Vapnik, A training algorithm for optimal margin classifiers, in Proceedings of the Fifth Annual Workshop on Computational Learning Theory, ACM, 1992, pp. 144–152.
   Google Scholar
• L. Breiman, J. Friedman, C.J. Stone, and R.A. Olshen, Classification and Regression Trees, Wadsworth, Belmont, CA, 1984.
   Google Scholar
• Y. Chen and Y. Hao, A feature weighted support vector machine and k-Nearest neighbor algorithm for stock market indices prediction, Expert. Syst. Appl. 80 (2017), pp. 340–355. doi: https://doi.org/10.1016/j.eswa.2017.02.044
   Web of Science ®Google Scholar
• E. Chong, C. Han, and F.C. Park, Deep learning networks for stock market analysis and prediction: methodology, data representations, and case studies, Expert. Syst. Appl. 83 (2017), pp. 187–205. doi: https://doi.org/10.1016/j.eswa.2017.04.030
   Web of Science ®Google Scholar
• U. Dellepiane, M. Di Marcantonio, E. Laghi, and S. Renzi, Bankruptcy prediction using support vector machines and feature selection during the recent financial crisis, Int. J. Econ. Financ. 7 (2015), pp. 182–195. doi: https://doi.org/10.5539/ijef.v7n8p182
   Google Scholar
• E. Dimitriadou, K. Hornik, F. Leisch, D. Meyer, A. Weingessel, and M.F. Leisch, Package “e1071”. R Software package. 2009. Available at http://cran.rproject.org/web/packages/e1071/index.html.
   Google Scholar
• C. Gilles and S.F. LeRoy, Asset Price Bubbles, The New Palgrave Dictionary of Money and Finance, Macmillan Reference, London, 1992, pp. 573–577.
   Google Scholar
• D.I. Harvey, S.J. Leybourne, R. Sollis, and A.M.R. Taylor, Tests for explosive financial bubbles in the presence of non-stationary volatility, J. Empirical Financ. 38 (2016), pp. 548–574. doi: https://doi.org/10.1016/j.jempfin.2015.09.002
   Web of Science ®Google Scholar
• T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining Inference and Prediction, Springer Science & Business Media, New York, 2009.
   Google Scholar
• B.M. Henrique, V.A. Sobreiro, and H. Kimura, Stock price prediction using support vector regression on daily and up to the minute prices, J. Financ. Data Sci. 4 (2018), pp. 183–201. doi: https://doi.org/10.1016/j.jfds.2018.04.003
   Google Scholar
• W. Huang, Y. Nakamori, and S.Y. Wang, Forecasting stock market movement direction with support vector machine, Comput. Oper. Res. 32 (2005), pp. 2513–2522. doi: https://doi.org/10.1016/j.cor.2004.03.016
   Web of Science ®Google Scholar
• D.W. Hosmer Jr, S. Lemeshow, and R.X. Sturdivant, Applied Logistic Regression, Vol. 398, John Wiley & Sons, New York, 2013.
   Google Scholar
• Y. Kara, M.A. Boyacioglu, and K. Baykan, Predicting direction of stock price index movement using artificial neural networks and support vector machines: the sample of the istanbul stock exchange, Expert. Syst. Appl. 38 (2011), pp. 5311–5319. doi: https://doi.org/10.1016/j.eswa.2010.10.027
   Web of Science ®Google Scholar
• K.J. Kim, Financial time series forecasting using support vector machines, Neurocomputing 55 (2003), pp. 307–319. doi: https://doi.org/10.1016/S0925-2312(03)00372-2
   Web of Science ®Google Scholar
• M. Kuhn, Building predictive models in R using the caret package, J. Stat. Softw. 28 (2008), pp. 1–26. available at https://cran.r-project.org/package=caret. doi: https://doi.org/10.18637/jss.v028.i05
   PubMed Web of Science ®Google Scholar
• M.P. Kumar, A. Zisserman, and P.H. Torr, Efficient discriminative learning of parts-based models, in IEEE 12th International Conference on Computer Vision, 2009, pp. 552–559.
   Google Scholar
• J.R. Landis and G.G. Koch, The measurement of observer agreement for categorical data, Biometrics 33 (1977), pp. 159–174. doi: https://doi.org/10.2307/2529310
   PubMed Web of Science ®Google Scholar
• M.C. Lee, Using support vector machine with a hybrid feature selection method to the stock trend prediction, Expert. Syst. Appl. 36 (2009), pp. 10896–10904. doi: https://doi.org/10.1016/j.eswa.2009.02.038
   Web of Science ®Google Scholar
• T.K. Lee, J.H. Cho, D.S. Kwon, and S.Y. Sohn, Global stock market investment strategies based on financial network indicators using machine learning techniques, Expert. Syst. Appl. 117 (2019), pp. 228–242. doi: https://doi.org/10.1016/j.eswa.2018.09.005
   Web of Science ®Google Scholar
• W.Y. Lin, Y.H. Hu, and C.F. Tsai, Machine learning in financial crisis prediction: A survey, IEEE Trans. Syst. Man Cybernetics, Part C (Appl. Rev.) 42 (2012), pp. 421–436. doi: https://doi.org/10.1109/TSMCC.2011.2170420
   Web of Science ®Google Scholar
• L. Luo and X. Chen, Integrating piecewise linear representation and weighted support vector machine for stock trading signal prediction, Appl. Soft. Comput. 13 (2013), pp. 806–816. doi: https://doi.org/10.1016/j.asoc.2012.10.026
   Web of Science ®Google Scholar
• I. Markovi, M. Stojanovi, J. Stankovi, and M. Stankovi, Stock market trend prediction using AHP and weighted kernel LS-SVM, Soft. Comput. 21 (2017), pp. 5387–5398. doi: https://doi.org/10.1007/s00500-016-2123-0
   Web of Science ®Google Scholar
• J.H. Min and Y.C. Lee, Bankruptcy prediction using support vector machine with optimal choice of kernel function parameters, Expert Syst. Appl. 28 (2005), pp. 603–614. doi: https://doi.org/10.1016/j.eswa.2004.12.008
   Web of Science ®Google Scholar
• S.H. Min, J. Lee, and I. Han, Hybrid genetic algorithms and support vector machines for bankruptcy prediction, Expert Syst. Appl. 31 (2006), pp. 652–660. doi: https://doi.org/10.1016/j.eswa.2005.09.070
   Web of Science ®Google Scholar
• S. Mukherjee, E. Osuna, and F. Girosi, Non-linear prediction of chaotic time series using support vector machines, in Neural Networks for Signal Processing VII, Proceedings of the 1997 IEEE Signal Processing Society Workshop, IEEE, 1997, pp. 511–520.
   Google Scholar
• M.K. Okasha, Using support vector machines in financial time series forecasting, Int. J. Stat. Appl. 4 (2004), pp. 28–39.
   Google Scholar
• P.C.B. Phillips and S. Shi, Real time monitoring of asset markets: bubbles and crises, in Handbook of Statistics, Elsevier, Available at https://doi.org/https://doi.org/10.1016/bs.host.2018.12.002, 2019.
   Google Scholar
• P.C.B. Phillips, S. Shi, and J. Yu, Testing for multiple bubbles: historical episodes of exuberance and collapse in the S&P 500, Int. Econ. Rev. (Philadelphia) 56 (2015a), pp. 1043–1078. doi: https://doi.org/10.1111/iere.12132
   Google Scholar
• P.C.B. Phillips, S. Shi, and J. Yu, Testing for multiple bubbles: limit theory of real time detectors, Int. Econ. Rev. (Philadelphia) 56 (2015b), pp. 1079–1134. doi: https://doi.org/10.1111/iere.12131
   Web of Science ®Google Scholar
• M. Qiu and Y. Song, Predicting the direction of stock market index movement using an optimized artificial neural network model, PLoS One 11 (2016), pp. e0155133. doi: https://doi.org/10.1371/journal.pone.0155133
   PubMed Web of Science ®Google Scholar
• L. Rokach and O.Z. Maimon, Data Mining with Decision Trees: Theory and Applications, Vol. 69, World Scientific, Singapore, 2008.
   Google Scholar
• L. Ryll and S. Seidens, Evaluating the performance of machine learning algorithms in financial markets forecasting: a comprehensive survey. Available at arXiv:1906.07786v2.
   Google Scholar
• R.J. Shiller, Homepage of R. J. Shiller. Available at http://www.econ.yale.edu/shiller/data.htm
   Google Scholar
• K.S. Shin, T.S. Lee, and H.J. Lee, An application of support vector machines in bankruptcy prediction model, Expert Syst. Appl. 28 (2005), pp. 127–135. doi: https://doi.org/10.1016/j.eswa.2004.08.009
   Web of Science ®Google Scholar
• Y. Shynkevich, T.M. McGinnity, S.A. Coleman, A. Belatreche, and Y. Li, Forecasting price movements using technical indicators: investigating the impact of varying input window length, Neurocomputing 264 (2017), pp. 71–88. doi: https://doi.org/10.1016/j.neucom.2016.11.095
   Web of Science ®Google Scholar
• F.E. Tay and L. Cao, Application of support vector machines in financial time series forecasting, Omega 29 (2001), pp. 309–317. doi: https://doi.org/10.1016/S0305-0483(01)00026-3
   Web of Science ®Google Scholar
• H.H. Tang, L.S. Zhang, and H. Wang, Predicting the direction of stock markets using optimized neural networks with google trends, Neurocomputing 285 (2018), pp. 188–195. doi: https://doi.org/10.1016/j.neucom.2018.01.038
   Web of Science ®Google Scholar
• S. Thirumuruganathan, A detailed introduction to K-Nearest Neighbor (KNN) algorithm (2010). https://saravananthirumuruganathan.wordpress.com/2010/05/17/a-detailed-introduction-to-k-nearest-neighbor-knnalgorithm/.
   Google Scholar
• V.N. Vapnik, The Nature of Statistical Learning Theory, Springer Science & Business Media, NewYork, 1995.
   Google Scholar
• V.N. Vapnik and A.J. Lerner, Generalized portrait method for pattern recognition, Autom. Remote Control 24 (1963), pp. 774–780.
   Google Scholar
• Y. Wang and I.C. Choi, Market index and stock price direction prediction using machine learning techniques: an empirical study on the KOSPI and HSI, preprint (2013). Available at arXiv:1309.7119.
   Google Scholar
• U. Yolcu, C.H. Aladag, E. Egrioglu, and V.R. Uslu, Time-series forecasting with a novel fuzzy time-series approach: an example for Istanbul stock market, J. Stat. Comput. Simul. 83 (2013), pp. 599–612. doi: https://doi.org/10.1080/00949655.2011.630000
   Web of Science ®Google Scholar
• X.-d. Zhang, A. Li, and R. Pan, Stock trend prediction based on a new status box method and AdaBoost probabilistic support vector machine, Appl. Soft. Comput. 49 (2016), pp. 385–398. doi: https://doi.org/10.1016/j.asoc.2016.08.026
   Web of Science ®Google Scholar
• J.M. Zurada, Introduction to Artificial Neural Systems, Vol. 8, West Publishing Company, St. Paul, 1992.
   Google Scholar