A deep learning approach for the dynamic dispatching of unreliable machines in re-entrant production systems

References

• Ahn, H. S., I. Duenyas, and R. Q. Zhang. 1999. “Optimal Stochastic Scheduling of a Two-stage Tandem Queue with Parallel Servers.” Advances in Applied Probability 31 (4): 1095–1117. doi:10.1017/S0001867800009642.
   Web of Science ®Google Scholar
• Archibald, T. W. 2007. “Modelling Replenishment and Transshipment Decisions in Periodic Review Multilocation Inventory Systems.” Journal of the Operational Research Society 58 (7): 948–956.
   Web of Science ®Google Scholar
• Arora, R., A. Basu, P. Mianjy, and A. Mukherjee. 2016. Understanding Deep Neural Networks with Rectified Linear Units. ArXiv: 1611.01491.
   Google Scholar
• Aydin, M. E., and E. Oztemel. 2000. “Dynamic Job-shop Scheduling Using Reinforcement Learning Agents.” Robotics and Autonomous Systems 33 (2–3): 169–178. doi:10.1016/S0921-8890(00)00087-7.
   Web of Science ®Google Scholar
• Chang, S. H., and S. B. Gershwin. 2010. “Modeling and Analysis of Two Unreliable Batch Machines with a Finite Buffer in between.” Iie Transactions 42 (6): 405–421. doi:10.1080/07408170903228934.
   Web of Science ®Google Scholar
• Choi, J. Y., and S. B. Kim. 2012. “Computationally Efficient Neuro-dynamic Programming Approximation Method for the Capacitated Re-entrant Line Scheduling Problem.” International Journal of Production Research 50 (8): 2353–2362. doi:10.1080/00207543.2011.578596.
   Web of Science ®Google Scholar
• Gershwin, S. B. 1987. “An Efficient Decomposition Method for the Approximate Evaluation of Tandem Queues with Finite Storage Space and Blocking.” Operations Research 35 (2): 291–305. doi:10.1287/opre.35.2.291.
   Web of Science ®Google Scholar
• Hornik, K., M. Stinchcombe, and H. White. 1989. “Multilayer Feedforward Networks are Universal Approximators.” Neural Networks 2 (5): 359–366. doi:10.1016/0893-6080(89)90020-8.
   Web of Science ®Google Scholar
• Ioffe, S., and C. Szegedy. 2015. “Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift.” ArXiv: 1611.01491: 11.
   Google Scholar
• Kirkizlar, H. E. 2008. Performance Improvements Through Flexible Workforce. PhD diss., Georgia Institute of Technology.
   Google Scholar
• Krizhevsky, A., I. Sutskever, and G. E. Hinton. 2012. Imagenet Classification with Deep Convolutional Neural Networks. Paper presented at the Advances in neural information processing systems.
   Google Scholar
• Leshno, M., V. Y. Lin, A. Pinkus, and S. Schocken. 1993. “Multilayer Feedforward Networks with a Nonpolynomial Activation Function Can Approximate Any Function.” Neural Networks 6 (6): 861–867. doi:10.1016/S0893-6080(05)80131-5.
   Web of Science ®Google Scholar
• Lippman, S. A. 1975. “Apply a New Device in the Optimization of Exponential Queueing Systems.” Operations Research 23 (4): 24.
   Web of Science ®Google Scholar
• Marbach, P., O. Mihatsch, and J. N. Tsitsiklis. 2000. “Call Admission Control and Routing in Integrated Services Networks Using Neuro-dynamic Programming.” IEEE Journal on Selected Areas in Communications 18 (2): 197–208. doi:10.1109/49.824797.
   Web of Science ®Google Scholar
• Marbach, P., and J. N. Tsitsiklis. 2001. “Simulation-based Optimization of Markov Reward Processes.” IEEE Transactions on Automatic Control 46 (2): 191–209. doi:10.1109/9.905687.
   Web of Science ®Google Scholar
• Martens, J., and I. Sutskever. 2011. “Learning Recurrent Neural Networks with Hessian-free Optimization.” Paper presented at the Proceedings of the 28th International Conference on machine learning (ICML-11).
   Google Scholar
• Meyn, S. P. 2005. “Workload Models for Stochastic Networks: Value Functions and Performance Evaluation.” IEEE Transactions on Automatic Control 50 (8): 1106–1122. doi:10.1109/Tac.2005.852564.
   Web of Science ®Google Scholar
• Mishra, N., A. Singh, S. Kumari, K. Govindan, and S. I. Ali. 2016. “Cloud-based Multi-agent Architecture for Effective Planning and Scheduling of Distributed Manufacturing.” International Journal of Production Research 54 (23): 7115–7128. doi:10.1080/00207543.2016.1165359.
   Web of Science ®Google Scholar
• Mouelhi-Chibani, W., and H. Pierreval. 2010. “Training a Neural Network to Select Dispatching Rules in Real Time.” Computers & Industrial Engineering 58 (2): 249–256. doi:10.1016/j.cie.2009.03.008.
   Web of Science ®Google Scholar
• Nair, V., and G. E. Hinton. 2010. “Rectified Linear Units Improve Restricted Boltzmann Machines.” Paper presented at the Proceedings of the 27th international conference on machine learning (ICML-10).
   Google Scholar
• Nattaf, M., S. Dauzere-Peres, C. Yugma, and C. H. Wu. 2019. “Parallel Machine Scheduling with Time Constraints on Machine Qualifications.” Computers & Operations Research 107: 61–76. doi:10.1016/j.cor.2019.03.004.
   Web of Science ®Google Scholar
• Olafsson, S., and X. A. Li. 2010. “Learning Effective New Single Machine Dispatching Rules from Optimal Scheduling Data.” International Journal of Production Economics 128 (1): 118–126. doi:10.1016/j.ijpe.2010.06.004.
   Web of Science ®Google Scholar
• Priore, P., J. Parreno, R. Pino, A. Gomez, and J. Puente. 2010. “Learning-based Scheduling of Flexible Manufacturing Systems Using Support Vector Machines.” Applied Artificial Intelligence 24 (3): 194–209. doi:10.1080/08839510903549606.
   Web of Science ®Google Scholar
• Puterman, M. L. 1994. Markov Decision Processes. Hoboken, NJ: John Wiley and Sons.
   Google Scholar
• Ramachandran, P., B. Zoph, and Q. V. Le. 2017. “Searching for Activation Functions.” ArXiv: 1710.05941.
   Google Scholar
• Sennott, L. I. 1998. Stochastic Dynamic Programming and the Control of Queueing Systems. Hoboken, NJ: John Wiley & Sons.
   Google Scholar
• Serfozo, R. 1978. “An Equivalence between Continuous and Discrete Time Markov Decision Processes.” Operations Research 27 (3): 5.
   Web of Science ®Google Scholar
• Shi, L., G. Guo, and X. Song. 2019. “Multi-agent Based Dynamic Scheduling Optimisation of the Sustainable Hybrid Flow Shop in a Ubiquitous Environment.” International Journal of Production Research, 1–22. doi:10.1080/00207543.2019.1699671.
   Web of Science ®Google Scholar
• Shiue, Y. R. 2009. “Data-mining-based Dynamic Dispatching Rule Selection Mechanism for Shop Floor Control Systems Using a Support Vector Machine Approach.” International Journal of Production Research 47 (13): 3669–3690. doi:10.1080/00207540701846236.
   Web of Science ®Google Scholar
• Simester, D. I., P. Sun, and J. N. Tsitsiklis. 2006. “Dynamic Catalog Mailing Policies.” Management Science 52 (5): 683–696. doi:10.1287/mnsc.1050.0504.
   Web of Science ®Google Scholar
• Srivastava, N., G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. 2014. “Dropout: A Simple Way to Prevent Neural Networks from Overfitting.” Journal of Machine Learning Research 15 (1): 1929–1958.
   Google Scholar
• Szegedy, C., W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, and A. Rabinovich. 2015. “Going Deeper with Convolutions.” Paper presented at the Proceedings of the IEEE Conference on computer Vision and Pattern Recognition.
   Google Scholar
• Taguchi, G. 1986. Introduction to Quality Engineering: Designing Quality into Products and Processes.
   Google Scholar
• Tsitsiklis, J. N., and B. Van Roy. 1999. “Optimal Stopping of Markov Processes: Hilbert Space Theory, Approximation Algorithms, and an Application to Pricing High-dimensional Financial Derivatives.” IEEE Transactions on Automatic Control 44 (10): 1840–1851. doi:10.1109/9.793723.
   Web of Science ®Google Scholar
• Wu, C. H., D. G. Down, and M. E. Lewis. 2008. “Heuristics for Allocation of Reconfigurable Resources in a Serial Line with Reliability Considerations.” Iie Transactions 40 (6): 595–611. doi:10.1080/07408170701744819.
   Web of Science ®Google Scholar
• Wu, C.-H., M. E. Lewis, and M. Veatch. 2006. “Dynamic Allocation of Reconfigurable Resources ina Two-stage Tandem Queueing System with Reliability Considerations.” IEEE Transactions on Automatic Control 51 (2): 309–314.
   Web of Science ®Google Scholar
• Wu, C. H., J. T. Lin, and W. C. Chien. 2010. “Dynamic Production Control in a Serial Line with Process Queue Time Constraint.” International Journal of Production Research 48 (13): 3823–3843. doi:10.1080/00207540902922836.
   Web of Science ®Google Scholar
• Xia, B., C. Wang, Y. Gao, Y. Peng, and L. Liu. 2019. “A new Approach to the Analysis of Homogeneous Transfer Lines with Unreliable Buffers Subject to Time-dependent Failure.” International Journal of Production Research, 1–17. doi:10.1080/00207543.2019.1685700.
   Web of Science ®Google Scholar
• Zhang, J., and X. Wang. 2016. “Multi-agent-based Hierarchical Collaborative Scheduling in Re-entrant Manufacturing Systems.” International Journal of Production Research 54 (23): 7043–7059. doi:10.1080/00207543.2016.1194535.
   Web of Science ®Google Scholar
• Zhou, F.-Y., C.-H. Wu, and C.-J. Yu. 2017. “Dynamic Dispatching for Re-Entrant Production Lines – a Deep Learning Approach.” 2017 13th IEEE Conference on Automation Science and Engineering (CASE), 1026–1031.
   Google Scholar