Multi-filed data fusion through attention-based networks for readiness prediction in aircraft maintenance: natural language processing (NLP) approach

References

• Banghart, M. D. (2017). Bayesian network analysis for diagnostics and prognostics of engineering systems. Mississippi State, MS: Mississippi State University.
   Google Scholar
• Dallosta, P. M., & Simcik, T. A. (2012). Designing for supportability: Driving reliability, availability, and maintainability in…. Tech. Rep. Defense Acquisition University Fort Belvoir United States.
   Google Scholar
• Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding, arXiv preprint arXiv: 1810.04805.
   Google Scholar
• Duarte, S., & Machado, V. C. (2011). Manufacturing paradigms in supply chain management. International Journal of Management Science and Engineering Management, 6(5), 328–342. doi:10.1080/17509653.2011.10671181
   Google Scholar
• Fedus, W., Zoph, B., & Shazeer, N. (2022). Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity. Journal of Machine Learning Research, 23, 1–39.
   Web of Science ®Google Scholar
• Gholami, P., & Hafezalkotob, A. (2018). Maintenance scheduling using data mining techniques and time series models. International Journal of Management Science and Engineering Management, 13(2), 100–107. doi:10.1080/17509653.2017.1314201
   Web of Science ®Google Scholar
• Ghosh, N., Ravi, Y., Patra, A., Mukhopadhyay, S., Paul, S., Mohanty, A., & Chattopadhyay, A. (2007). Estimation of tool wear during CNC milling using neural network-based sensor fusion. Mechanical Systems and Signal Processing, 21(1), 466–479. doi:10.1016/j.ymssp.2005.10.010
   Web of Science ®Google Scholar
• Girdhar, R., Carreira, J., Doersch, C., & Zisserman, A. (2019). Video action transformer network. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA (pp. 244–253).
   Google Scholar
• Guo, Y., Zhou, D., Li, P., Li, C., & Cao, J. (2022). Context-aware poly (a) signal prediction model via deep spatial-temporal neural networks. IEEE Transactions on Neural Networks and Learning Systems, (1–13).
   Google Scholar
• Guo, Y., Zhou D, & Ruan X. (2023). Variational gated autoencoder-based feature extraction model for inferring disease-miRNA associations based on multiview features. Neural Networks, 165, 491–505.
   PubMed Web of Science ®Google Scholar
• Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735–1780. doi:10.1162/neco.1997.9.8.1735
   PubMed Web of Science ®Google Scholar
• Junor, L. J. (2017). Managing military readiness.Washington, D.C.: National Defense University Press.
   Google Scholar
• Karita, S., Chen, N., Hayashi, T., Hori, T., Inaguma, H., Jiang, Z., Someki, M., Soplin, N. E. Y., Yamamoto, R.-Y., & Wang, X. (2019). A comparative study on transformer vs. run in speech applications. 2019 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Sentosa, Singapore (pp. 449–456). IEEE.
   Google Scholar
• Li, Y., Cao J, & Xu Y. (2024). Deep learning based on transformer architecture for power system short-term voltage stability assessment with class imbalance. Renewable and Sustainable Energy Reviews, 189, 113913.
   Web of Science ®Google Scholar
• Li, W., Guo Y, & Wang B. (2023). Learning spatiotemporal embedding with gated convolutional recurrent networks for translation initiation site prediction. Pattern Recognition, 136, 109234.
   Web of Science ®Google Scholar
• Meng, T., Jing, X., Yan, Z., & Pedrycz, W. (2020). A survey on machine learning for data fusion. Information Fusion, 57, 115–129. doi:10.1016/j.inffus.2019.12.001
   Web of Science ®Google Scholar
• Mikolov, T., Karafi‘at, M., Burget, L., Cernocky’, J., & Khudanpur, S. (2010). Recurrent neural network based language model. Interspeech (Vol. II, no. 3. pp. 1045–1048).
   Google Scholar
• Moore, S. C., Stockfisch, J., Goldberg, M. S., Holroyd, S. M., & Hildebrandt, G. G. (1991). Measuring military readiness and sustainability, Rand Corp Santa Monica CA. Tech. Rep.
   Google Scholar
• Moubray, J. (2001). Reliability-centered maintenance. New York, NY: Industrial Press Inc.
   Google Scholar
• Pophaley, M., & Vyas, R. K. (2010). Choice criteria for maintenance strategy in automotive industries. International Journal of Management Science and Engineering Management, 5(6), 446–452. doi:10.1080/17509653.2010.10671136
   Google Scholar
• Raffensperger, J. F., & Schrage, L. E. (1997). A new paradigm for measuring military readiness. Military Operations Research, 3(5), 21–34. doi:10.5711/morj.3.5.21
   Google Scholar
• Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning internal representations by error propagation. Biometrika, 1, 599–607.
   Google Scholar
• Sanni-Anibire, M. O., Mohamad Zin, R., & Olatunji, S. O. (2021). Developing a preliminary cost estimation model for tall buildings based on machine learning. International Journal of Management Science and Engineering Management, 16(2), 134–142. doi:10.1080/17509653.2021.1905568
   Web of Science ®Google Scholar
• Sharma, P., & Li, Y. (2019). Self-supervised contextual keyword and keyphrase retrieval with self-labeling. Preprints.org. doi:10.20944/preprints201908.0073.v1
   Google Scholar
• Shebl, N. A., Franklin, B. D., & Barber, N. (2012). Failure mode and effects analysis outputs: Are they valid? BMC Health Services Research, 12(1), 1–10. doi:10.1186/1472-6963-12-150
   PubMed Web of Science ®Google Scholar
• Sukhbaatar, S., Ju, D., Poff, S., Roller, S., Szlam, A., Weston, J., & Fan, A. (2021). Not all memories are created equal: Learning to forget by expiring. International Conference on Machine Learning, Virtual (pp. 9902–9912). PMLR.
   Google Scholar
• Sundararajan, M., Taly, A., & Yan, Q. (2017). Axiomatic attribution for deep networks. International Conference on Machine Learning, Sydney, Australia (pp. 3319–3328). PMLR.
   Google Scholar
• Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L. , and Polo-Sukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30, 5998–6008.
   Google Scholar
• Wang, J., & Tan, X. (2023). Mutually beneficial transformer for multimodal data fusion. IEEE Transactions on Circuits and Systems for Video Technology, 33, 7466–7479.
   Web of Science ®Google Scholar
• Yang, S., Zhou D, & Cao J. (2022). Rethinking low-light enhancement via transformer-GAN. IEEE Signal Processing Letters, 29, 1082–1086.
   Web of Science ®Google Scholar
• Yuan, Q., Pi Y, & Kou L. (2022). Multi-source data processing and fusion method for power distribution internet of things based on edge intelligence. Frontiers in Energy Research, 10, 891867.
   Web of Science ®Google Scholar
• Zheng, Y. (2015). Methodologies for cross-domain data fusion: An overview. IEEE Transactions on Big Data, 1(1), 16–34. doi:10.1109/TBDATA.2015.2465959
   Google Scholar