A hybrid model based on bidirectional long short-term memory neural network and Catboost for short-term electricity spot price forecasting

References

• Amjady, N., & Keynia, F. (2011). A new prediction strategy for price spike forecasting of day-ahead electricity markets. Applied Soft Computing Journal, 11(6), 4246–4256. https://doi.org/https://doi.org/10.1016/j.asoc.2011.03.024
   Web of Science ®Google Scholar
• Anbazhagan, S., & Kumarappan, N. (2013). Day-ahead deregulated electricity market price forecasting using recurrent neural network. Systems Journal, IEEE, 7(4), 866–872. https://doi.org/https://doi.org/10.1109/JSYST.2012.2225733
   Web of Science ®Google Scholar
• Baldi, P., Brunak, S., Frasconi, P., Soda, G., & Pollastri, G. (1999). Exploiting the past and the future in protein secondary structure prediction. Bioinformatics, 15(11), 937–946. https://doi.org/https://doi.org/10.1093/bioinformatics/15.11.937
   PubMed Web of Science ®Google Scholar
• Barnes, P. M. (2017). The politics of nuclear energy in the European Union: Framing the discourse. Barbara Budrich Publishers.
   Google Scholar
• Bengio, Y., Simard, P., & Frasconi, P. (1994). Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks, 5(2), 157–166. https://doi.org/https://doi.org/10.1109/72.279181
   PubMed Web of Science ®Google Scholar
• Berglund, S. (2009). Putting politics into perspective: A study of the implementation of EU public utilities directives. Eburon Uitgeverij B.V., 2009 – European Union countries.
   Google Scholar
• Cabero, J., Baillo, A., Cerisola, S., Ventosa, M., Garcia-Alcalde, A., Peran, F., & Relano, G. (2005). A medium-term integrated risk management model for a hydrothermal generation company. IEEE Transactions on Power Systems, 20(3), 1379–1388. https://doi.org/https://doi.org/10.1109/TPWRS.2005.851934
   Web of Science ®Google Scholar
• Cestnik, B. (1990). Estimating probabilities: A crucial task in machine learning. In ECAI’90: Proceedings of the 9th European Conference on Artificial Intelligence January (pp. 147–149).
   Google Scholar
• Chen, T., Carlos, G. (2016). XGBoost: A Scalable Tree Boosting System. In Publication:KDD ’16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining August (pp. 785–794). https://doi.org/https://doi.org/10.1145/2939672.2939785
   Google Scholar
• Chevillon, G. (2007). Direct multi-step estimation and forecasting. Journal of Economic Surveys, 21(4), 746–785. https://doi.org/https://doi.org/10.1111/j.1467-6419.2007.00518.x
   Web of Science ®Google Scholar
• Ching-Kang, I. (2003). Multistep prediction in autoregressive processes. Econometric Theory, 19(02), 254–279. https://doi.org/https://doi.org/10.1017/S0266466603192031
   Web of Science ®Google Scholar
• Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., Bengio, Y. (2014). Learning phrase representations using RNN encoder-decoder for statistical machine translation. http://arxiv.org/abs/1406.1078
   Google Scholar
• Cui, Z., & Wang, Y. (2018). Deep stacked bidirectional and unidirectional LSTM recurrent neural network for network-wide traffic speed prediction. In 23rd ACM SIGKDD conference on knowledge discovery and data mining (KDD) (pp. 22–25). New York, NY, United States: Association for Computing Machinery.
   Google Scholar
• Deb, C., Zhang, F., Yang, J., Eang, S., & Wei, K. (2017). A review on time series forecasting techniques for building energy consumption. Renewable and Sustainable Energy Reviews, 74(February), 902–924. https://doi.org/https://doi.org/10.1016/j.rser.2017.02.085
   Web of Science ®Google Scholar
• Diebold, F. X., & Mariano, R. S. (2012). Comparing predictive accuracy. Journal of Business & Economic Statistics, 13(3), 253–263. https://doi.org/https://doi.org/10.1080/07350015.1995.10524599
   Google Scholar
• Dorogush, A. V., Ershov, V., & Gulin, A. (2018). CatBoost: Gradient boosting with categorical features support, arXiv:1810.11363.
   Google Scholar
• Fragkioudaki, A., Marinakis, A., & Cherkaoui, R. (2015). Forecasting price spikes in European day-ahead electricity markets using decision trees. International Conference on the European Energy Market, EEM, 2015-August. https://doi.org/https://doi.org/10.1109/EEM.2015.7216672
   Google Scholar
• Freund, Y., & Schapire, R. (1997). A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55(1), 119–139. https://doi.org/https://doi.org/10.1006/jcss.1997.1504
   Web of Science ®Google Scholar
• Friedman, J. H. (2002). Stochastic gradient boosting. Computational Statistics & Data Analysis, 38(4), 367–378. https://doi.org/https://doi.org/10.1016/S0167-9473(01)00065-2
   Web of Science ®Google Scholar
• Girish, G. P., & Vijayalakshmi, S. (2015). Role of energy exchanges for power trading in India. International Journal of Energy Economics and Policy, 5(3), 673–676.
   Google Scholar
• Graves, A., & Schmidhuber, J. (2005). Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Networks: The Official Journal of the International Neural Network Society, 18(5-6), 602–610. https://doi.org/https://doi.org/10.1016/j.neunet.2005.06.042
   PubMed Web of Science ®Google Scholar
• Graves, A., Jaitly, N., & Mohamed, A. (2013). Hybrid speech recognition with Deep Bidirectional LSTM. In 2013 IEEE Workshop on Automatic Speech Recognition and Understanding (pp. 273–278). https://doi.org/https://doi.org/10.1109/ASRU.2013.6707742
   Google Scholar
• Hochreiter, S. (1991). Untersuchungen zu dynamischen neuronalen netzen. Diploma, Technische Universitat Munchen.
   Google Scholar
• Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735–1780. https://doi.org/https://doi.org/10.1162/neco.1997.9.8.1735
   PubMed Web of Science ®Google Scholar
• Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q., & Liu, T. (2017). LightGBM: A highly efficient gradient boosting decision tree. In NIPS’17: Proceedings of the 31st International Conference on Neural Information Processing Systems (pp. 3149–3157). Curran Associates Inc.
   Google Scholar
• Kuo, P.-H., & Huang, C.-J. (2018). An electricity price forecasting model by hybrid structured deep neural networks. Sustainability, 10(4), 1280. https://doi.org/https://doi.org/10.3390/su10041280
   Web of Science ®Google Scholar
• Lago, J., De Ridder, F., & De Schutter, B. (2018). Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms. Applied Energy, 221(February), 386–405. https://doi.org/https://doi.org/10.1016/j.apenergy.2018.02.069
   Web of Science ®Google Scholar
• Manner, H., Türk, D., & Eichler, M. (2016). Modeling and forecasting multivariate electricity price spikes. Energy Economics, 60, 255–265. https://doi.org/https://doi.org/10.1016/j.eneco.2016.10.006
   Web of Science ®Google Scholar
• Micci-Barreca, D. (2001). A preprocessing scheme for high-cardinality categorical attributes in classification and prediction problems. ACM SIGKDD Explorations Newsletter, 3(1), 27–32. https://doi.org/https://doi.org/10.1145/507533.507538
   Google Scholar
• Mirikitani, D., & Nikolaev, N. (2011). Nonlinear maximum likelihood estimation of electricity spot prices using recurrent neural networks. Neural Computing and Applications, 20(1), 79–89. https://doi.org/https://doi.org/10.1007/s00521-010-0344-1
   Web of Science ®Google Scholar
• Nord Pool Historical Market Data. (n.d.). Nord Pool. Retrieved November 5, 2020, from https://www.nordpoolgroup.com/historical-market-data/
   Google Scholar
• Nord Pool Website. (2015). Nord Pool. Retrieved November 5, 2020, from https://www.nordpoolgroup.com/
   Google Scholar
• Olah, C. (2015). Understanding LSTM networks. Retrieved November 5, 2020, from http://colah.github.io/posts/2015-08-Understanding-LSTMs/
   Google Scholar
• Pandey, N., & Upadhyay, K. G. (2016). Different price forecasting techniques and their application in deregulated electricity market: A comprehensive study. 2016 International Conference on Emerging Trends in Electrical Electronics & Sustainable Energy Systems (ICETEESES) (pp. 1–4). https://doi.org/https://doi.org/10.1109/ICETEESES.2016.7581342
   Google Scholar
• Pezzutto, S., Grilli, G., Zambotti, S., & Dunjic, S. (2018). Forecasting electricity market price for end users in EU28 until 2020—Main factors of influence. Energies, 11(6), 1418–1460. https://doi.org/https://doi.org/10.3390/en11061460
   Web of Science ®Google Scholar
• Prokhorenkova, L., Gusev, G., Vorobev, A., Dorogush, A. V., & Gulin, A. (2018). CatBoost: Unbiased boosting with categorical features. In NIPS'18: Proceedings of the 32nd International Conference on Neural Information Processing Systems, December 2018 (pp. 6639–6649). ACM.
   Google Scholar
• Sandhu, H. S., Fang, L., & Guan, L. (2016). Forecasting day-ahead price spikes for the Ontario electricity market. Electric Power Systems Research, 141, 450–459. https://doi.org/https://doi.org/10.1016/j.epsr.2016.08.005
   Web of Science ®Google Scholar
• Schuster, M., & Paliwal, K. K. (1997). Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing, 45(11), 2673–2681. https://doi.org/https://doi.org/10.1109/78.650093
   Web of Science ®Google Scholar
• Sulehria, H. K., & Zhang, Y. (2007). Hopfield neural networks: A survey. In AIKED’07 Proceedings of the 6th Conference on 6th WSEAS Int. Conf. on Artificial Intelligence, Knowledge Engineering and Data Bases (Vol. 6, pp. 125–130).
   Google Scholar
• Ugurlu, U., Oksuz, I., & Tas, O. (2018). Electricity price forecasting using recurrent neural networks. Energies, 11(5), 1255. https://doi.org/https://doi.org/10.3390/en11051255
   Web of Science ®Google Scholar
• Vardhan, N. H., & Chintham, V. (2015). Electricity price forecasting of deregulated market using Elman neural network. In 2015 Annual IEEE India Conference (INDICON) (pp. 1–5). https://doi.org/https://doi.org/10.1109/INDICON.2015.7443460
   Google Scholar
• Ventosa, M., Baı́llo, Á., Ramos, A., & Rivier, M. (2005). Electricity market modeling trends. Energy Policy, 33(7), 897–913. https://doi.org/https://doi.org/10.1016/j.enpol.2003.10.013
   Web of Science ®Google Scholar
• Voronin, S., & Partanen, J. (2013). Price forecasting in the day-ahead energy market by an iterative method with separate normal price and price spike frameworks. Energies, 6(11), 5897–5920. https://doi.org/https://doi.org/10.3390/en6115897
   Web of Science ®Google Scholar
• Wang, L., Member, S., Zhang, Z., & Chen, J. (2017). Short-term electricity price forecasting with stacked denoising autoencoders. IEEE Transactions on Power Systems, 32(4), 2673–2681. https://doi.org/https://doi.org/10.1109/TPWRS.2016.2628873
   Web of Science ®Google Scholar
• Wang, Y., Wang, J., Lin, H., Zhang, S., & Li, L. (2017). Biomedical event trigger detection based on bidirectional LSTM and CRF. In 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) (pp. 445–450). https://doi.org/https://doi.org/10.1109/BIBM.2017.8217689
   Google Scholar
• Weron, R. (2014). Electricity price forecasting: A review of the state-of-the-art with a look into the future. International Journal of Forecasting, 30(4), 1030–1081. https://doi.org/https://doi.org/10.1016/j.ijforecast.2014.08.008
   Web of Science ®Google Scholar
• Xu, C., Xie, L., & Xiao, X. (2018). A bidirectional LSTM approach with word embeddings for sentence boundary detection. Journal of Signal Processing Systems, 90(7), 1063–1075. https://doi.org/https://doi.org/10.1007/s11265-017-1289-8
   Web of Science ®Google Scholar
• Xue, H. Q., Huynh, D., & Reynolds, M. (2017). Bi-prediction: Pedestrian trajectory prediction based on bidirectional LSTM classification. In 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA) (pp. 1–8). https://doi.org/https://doi.org/10.1109/DICTA.2017.8227412
   Google Scholar
• Yildirim, Ö. (2018). A novel wavelet sequence based on deep bidirectional LSTM network model for ECG signal classification. Computers in Biology and Medicine, 96(March), 189–202. https://doi.org/https://doi.org/10.1016/j.compbiomed.2018.03.016
   PubMed Web of Science ®Google Scholar
• Zeyer, A., Doetsch, P., Voigtlaender, P., & Schlüter, R. (2017). A comprehensive study of deep bidirectional LSTM RNNS for acoustic modeling in speech recognition. In 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 2462–2466). https://doi.org/https://doi.org/10.1109/ICASSP.2017.7952599
   Google Scholar
• Zhang, F., & Fleyeh, H. (2019). A review of single artificial neural network models for electricity spot price forecasting. In 2019 16th International Conference on the European Energy Market (EEM) (pp. 1–6). https://doi.org/https://doi.org/10.1109/EEM.2019.8916423
   Google Scholar
• Zhao, J. H., Dong, Z. Y., Li, X., & Wong, K. P. (2007). A framework for electricity price spike analysis with advanced data mining methods. IEEE Transactions on Power Systems, 22(1), 376–385. https://doi.org/https://doi.org/10.1109/TPWRS.2006.889139
   Web of Science ®Google Scholar
• Zhao, Y., Yang, R., Chevalier, G., Shah, R. C., & Romijnders, R. (2018). Optik applying deep bidirectional LSTM and mixture density network for basketball trajectory prediction. Optik – International Journal for Light and Electron Optics, 158, 266–272. https://doi.org/https://doi.org/10.1016/j.ijleo.2017.12.038
   Google Scholar
• Zheng, D., Chen, Z., Wu, Y., & Yu, K. (2016). Directed automatic speech transcription error correction using bidirectional LSTM. In 2016 10th International Symposium on Chinese Spoken Language Processing (ISCSLP) (pp. 1–5). https://doi.org/https://doi.org/10.1109/ISCSLP.2016.7918446
   Google Scholar