Explore deep auto-coder and big data learning to hard drive failure prediction: a two-level semi-supervised model

References

• Backblaze (2020). https://www.backblaze.com/b2/hard-drive-test-data.html.
   Google Scholar
• Chaves, I. C., de Paula, M. R. P., de Moura Leite, L. G., Gomes, J. P. P., & Machado, J. C. (2018, July 8–13). Hard disk drive failure prediction method based on a bayesian network. In 2018 International Joint Conference on Neural Networks, IJCNN 2018 (pp. 1–7). IEEE.
   Google Scholar
• Hamerly, G., & Elkan, C. (2001, June 28–July 1). Bayesian approaches to failure prediction for disk drives. In Proceedings of the Eighteenth International Conference on Machine Learning (ICML 2001) (pp. 202–209). Morgan Kaufmann.
   Google Scholar
• Han, S., Wu, J., Xu, E., He, C., Lee, P. P., Qiang, Y., Zheng, Q., Huang, T., Huang, Z., & Li, R. (2019). Robust data preprocessing for machine-learning-based disk failure prediction in cloud production environments. CoRR abs/1912.09722. http://arxiv.org/abs/1912.09722.
   Google Scholar
• Haykin, S. O. (1999). Neural networks: A comprehensive foundation (2nd ed.). Prentice Hall.
   Google Scholar
• Henry, R. K. (2005). Monitoring pc hardware sounds in linux systems using the daubechies d4 wavelet [Unpublished master's thesis]. East Tennessee State University.
   Google Scholar
• Hilbert, M., & López, P. (2011). The world's technological capacity to store, communicate, and compute information. Science (New York, N.Y.), 60(332), 60–65. https://doi.org/10.1126/science.1200970
   Google Scholar
• Hughes, G. F., Murray, J. F., Kreutz-Delgado, K., & Elkan, C. (2002). Improved disk-drive failure warnings. IEEE Transactions on Reliability, 51(3), 350–357. https://doi.org/10.1109/TR.2002.802886
   Web of Science ®Google Scholar
• Jiang, T., Huang, P., & Zhou, K. (2020). Cost-efficiency disk failure prediction via threshold-Moving. Concurrency and Computation-Practice & Experience, 32(14), 1–14. https://doi.org/10.1002/cpe.v32.14
   Google Scholar
• Lehmann, E. L., & D'Abrera, H. (2010). Nonparametrics: Statistical methods based on ranks. Springer.
   Google Scholar
• Li, J., Ji, X., Jia, Y., Zhu, B., Wang, G., Li, Z., & Liu, X. (June 23–26, 2014). Hard drive failure prediction using classification and regression trees. In 44th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2014 (pp. 383–394). IEEE Computer Society.
   Google Scholar
• Li, J., Stones, R. J., Wang, G., Liu, X., Li, Z., & Xu, M. (2017). Hard drive failure prediction using decision trees. Reliability Engineering and System Safety, 164(1), 55–65. https://doi.org/10.1016/j.ress.2017.03.004
   Google Scholar
• Li, Y., Wang, X., Wang, W., Zhang, Z., Wang, J., Luo, X., & Xie, S. (2020). Learning adversarial policy in multiple scenes environment via multi-agent reinforcement learning. Connection Science, 33(3), 407–426. https://doi.org/10.1080/09540091.2020.1832961
   Google Scholar
• Liang, W., Fan, Y., Li, K., Zhang, D., & Gaudiot, J. (2020). Secure data storage and recovery in Industrial blockchain network environments. IEEE Transactions on Industrial Informatics, 16(10), 6543–6552. https://doi.org/10.1109/TII.9424
   Web of Science ®Google Scholar
• Liang, W., Huang, W., Long, J., Zhang, K., Li, K., & Zhang, D. (2020). Deep reinforcement learning for resource protection and real-time detection in loT environment. IEEE Internet of Things Journal, 7(7), 6392–6401. https://doi.org/10.1109/JIoT.6488907
   Web of Science ®Google Scholar
• Liang, W., Zhang, D., Lei, X., Tang, M., & Zomaya, A. (2020). Circuit copyright blockchain: Blockchain-based homomorphic encryption for IP circuit protection. IEEE Transactions on Emerging Topics in Computing, PP(99), 1–1. https://doi.org/10.1109/TETC.2020.2993032
   Google Scholar
• Lordo, R. A. (2001). Learning from data: Concepts, theory, and methods. Technometrics, 43(1), 105–106. https://doi.org/10.1198/tech.2001.s558
   Google Scholar
• Murray, J. F., Hughes, G. F., & Kreutz-Delgado, K. (n.d.). Hard drive failure prediction using non-parametric statistical methods. In Proceedings of Icann/Iconip 2003. Springer.
   Google Scholar
• Murray, J. F., Hughes, G. F., & Kreutz-Delgado, K. (2005). Machine learning methods for predicting failures in hard drives: A multiple-instance application. Journal of Machine Learning Research, 6(27), 783–816. https://doi.org/10.1002/cem.944
   Google Scholar
• Sarode, R. P., Poudel, M., Shrestha, S., & Bhalla, S. (2021). Blockchain for committing peer-to-peer transactions using distributed Ledger technologies. International Journal of Computational Science and Engineering, 24(3), 215–227. https://doi.org/10.1504/IJCSE.2021.115651
   Web of Science ®Google Scholar
• Schroeder, B., & Gibson, G. A. (February 13–16, 2007). Disk failures in the real world: What does an MTTF of 1, 000, 000 hours mean to you? In A.C. Arpaci-Dusseau and R.H. Arpaci-Dusseau (Eds.), 5th USENIX Conference on File and Storage Technologies, FAST 2007 (pp. 1–16). USENIX.
   Google Scholar
• Theodoridis, S., & Koutroumbas, K. (2006). Pattern recognition (3rd ed.). Academic Press (Elsevier).
   Google Scholar
• Vapnik, V. N. (2000). The nature of statistical learning theory (2nd ed.). Springer.
   Google Scholar
• Wang, Y., Miao, Q., Ma, E. W. M., Tsui, K., & Pecht, M. G. (2013). Online anomaly detection for hard disk drives based on mahalanobis distance. IEEE Transactions on Reliability, 62(1), 136–145. https://doi.org/10.1109/TR.2013.2241204
   Web of Science ®Google Scholar
• Wang, Y., Miao, Q., & Pecht, M. (2011, May 24–25). Health monitoring of hard disk drive based on mahalanobis distance. In Proceedings of 2011 Prognostics and System Health Managment Conference. IEEE.
   Google Scholar
• Xu, Y., Sui, K., Yao, R., Zhang, H., Lin, Q., Dang, Y., Li, P., Jiang, K., Zhang, W., J. G. Lou, & Chintalapati, M. (2018, July 11–13). Improving service availability of cloud systems by predicting disk error. In 2018 USENIX Annual Technical Conference, USENIX ATC 2018 (pp. 481–494). USENIX Association.
   Google Scholar
• Zhang, S., Yao, T., Sandor, V. K. A., Weng, T. H., Liang, W., & Su, J. (2021). A novel blockchain-based privacy-preserving framework for online social networks. Connection Science, 33(3), 555–575. https://doi.org/10.1080/09540091.2021.1985968
   Web of Science ®Google Scholar
• Zhang, Y., Bai, Y., He, M., Lv, Z., & Li, Y. (2019). Big data automatic analysis system and its applications in rockburst experiment. International Journal of Computational Science and Engineering, 18(4), 321–331. https://doi.org/10.1504/IJCSE.2019.099070
   Web of Science ®Google Scholar
• Zhao, Y., Liu, X., Gan, S., & Zheng, W. (2010, July 12–14). Predicting disk failures with hmm- and hsmm-based approaches. In Proceedings of 10th Industrial Conference on Advances in Data Mining. Applications and Theoretical Aspects, ICDM 2010 (Vol. 6171, pp. 390–404). Springer.
   Google Scholar
• Zhu, B., Wang, G., Liu, X., Hu, D., Lin, S., & Ma, J.2013, May 6–10). Proactive drive failure prediction for large scale storage systems. In IEEE 29th Symposium on Mass Storage Systems and Technologies, MSST 2013 (pp. 1–5). IEEE Computer Society.
   Google Scholar