Development of dynamic scheduling in semiconductor manufacturing using a Q-learning approach

References

• Arzi, Y., and L. Iaroslavitz. 2000. “Operating an FMC by a Decision-tree-based Adaptive Production Control System.” International Journal of Production Research 38 (3): 675–697. doi:10.1080/002075400189365.
   Web of Science ®Google Scholar
• Bangsow, S. 2015. Tecnomatix Plant Simulation. Switzerland: Springer.
   Google Scholar
• Campbell, E., and J. Ammenheuser. 2000. “300 Mm Factory Layout and Material Handling Modeling: Phase II Report.” In Tech transfer document.
   Google Scholar
• Chapelle, O., B. Schölkopf, and A. Zien. 2010. Semi-Supervised Learning. Cambridge, Mass.:MIT Press.
   Google Scholar
• Chen, -C.-C., Y. Yih, and Y.-C. Wu. 1999. “Auto-bias Selection for Developing Learning-based Scheduling Systems.” International Journal of Production Research 37 (9): 1987–2002. doi:10.1080/002075499190879.
   Web of Science ®Google Scholar
• Cho, H. B., and R. A. Wysk. 1995. “Intelligent Workstation Controller for Computer-Integrated Manufacturing - Problems and Models.” Journal of Manufacturing Systems 14 (4): 252–263. doi:10.1016/0278-6125(95)98878-A.
   Web of Science ®Google Scholar
• Davies, D. L., and D. W. Bouldin. 1979. “A Cluster Separation Measure.” IEEE Transactions on Pattern Analysis and Machine Intelligence 1 (2): 224–227. doi:10.1109/TPAMI.1979.4766909.
   PubMed Web of Science ®Google Scholar
• Demuth, H., M. Beale, and M. Hagan. 2006. MATLAB Neural Network Toolbox, Version 5, User’s Guide. Natick, Massachusetts N.: The MathWorks, Inc.
   Google Scholar
• Goodfellow, I., Y. Bengio, A. Courville, and Y. Bengio. 2016. “Deep Learning.”
   Google Scholar
• Guh, R. S., Y. R. Shiue, and T. Y. Tseng. 2011. “The Study of Real Time Scheduling by an Intelligent Multi-controller Approach.” International Journal of Production Research 49 (10): 2977–2997. doi:10.1080/00207541003794884.
   Web of Science ®Google Scholar
• Hochreiter, S., and J. Schmidhuber. 1997. “Long Short-term Memory.” Neural Computation 9 (8): 1735–1780. doi:10.1162/neco.1997.9.8.1735.
   PubMed Web of Science ®Google Scholar
• Hsieh, B.-W., C.-H. Chen, and S.-C. Chang. 2001. “Scheduling Semiconductor Wafer Fabrication by Using Ordinal Optimization-based Simulation.” IEEE Transactions on Robotics and Automation 17 (5): 599–608. doi:10.1109/70.964661.
   Google Scholar
• Ishii, N., and J. J. Talavage. 1994. “A Mixed Dispatching Rule Approach in FMS Scheduling.” International Journal of Flexible Manufacturing Systems 6 (1): 69–87. doi:10.1007/bf01324876.
   Google Scholar
• Kim, C. O., H. S. Min, and Y. Yih. 1998. “Integration of Inductive Learning and Neural Networks for Multi-objective FMS Scheduling.” International Journal of Production Research 36 (9): 2497–2509. doi:10.1080/002075498192652.
   Web of Science ®Google Scholar
• Kim, Y.-D., J.-H. Kang, G.-E. Lee, and S.-K. Lim. 2011. “Scheduling Algorithms for Minimizing Tardiness of Orders at the Burn-in Workstation in a Semiconductor Manufacturing System.” IEEE Transactions on Semiconductor Manufacturing 24 (1): 14–26. doi:10.1109/tsm.2010.2082470.
   Web of Science ®Google Scholar
• Kohonen, T. 2001. Self-Organizing Maps. Third, Extended Edition. Springer Series in Information Sciences vol. 30, Berlin, Germany: Springer-Verlag.
   Google Scholar
• Li, B., J. Wu, W. Carriker, and R. Giddings. 2005. “Factory Throughput Improvements through Intelligent Integrated Delivery in Semiconductor Fabrication Facilities.” IEEE Transactions on Semiconductor Manufacturing 18 (1): 222–231. doi:10.1109/Tsm.2004.840530.
   Web of Science ®Google Scholar
• Li, L., Z. J. Sun, M. C. Zhou, and F. Qiao. 2013. “Adaptive Dispatching Rule for Semiconductor Wafer Fabrication Facility.” IEEE Transactions on Automation Science and Engineering 10 (2): 354–364. doi:10.1109/Tase.2012.2221087.
   Web of Science ®Google Scholar
• Liu, H., and L. Yu. 2005. “Toward Integrating Feature Selection Algorithms for Classification and Clustering.” IEEE Transactions on Knowledge and Data Engineering 17 (4): 491–502. doi:10.1109/Tkde.2005.66.
   Web of Science ®Google Scholar
• Liu, H., and R. Setiono. 1996. “A Probabilistic Approach to Feature Selection-A Filter Solution.” ICML.
   Google Scholar
• Lu, S. C. H., D. Ramaswamy, and P. R. Kumar. 1994. “Efficient Scheduling Policies to Reduce Mean and Variance of Cycle-Time in Semiconductor Manufacturing Plants.” IEEE Transactions on Semiconductor Manufacturing 7 (3): 374–388. doi:10.1109/66.311341.
   Web of Science ®Google Scholar
• Ma, Y. M., F. Qiao, F. Zhao, and J. W. Sutherland. 2017. “Dynamic Scheduling of a Semiconductor Production Line Based on a Composite Rule Set.” Applied Sciences-Basel 7 (10): 1052. doi:10.3390/app7101052.
   Web of Science ®Google Scholar
• Mahajan, P. S., and R. G. Ingalls. 2004. “Evaluation of Methods Used to Detect Warm-up Period in Steady State Simulation”. Proceedings of the 2004 Winter Simulation Conference, 2004. Piscataway, NJ.: IEEE
   Google Scholar
• MathWorks, T. 2016. MATLAB Release 2016b, the MathWorks. Massachusetts, United States: Inc., Natick.
   Google Scholar
• Metan, G., I. Sabuncuoglu, and H. Pierreval. 2010. “Real Time Selection of Scheduling Rules and Knowledge Extraction via Dynamically Controlled Data Mining.” International Journal of Production Research 48 (23): 6909–6938. doi:10.1080/00207540903307581.
   Web of Science ®Google Scholar
• Min, H. S., and Y. Yih. 2003. “Development of a Real-time Multi-objective Scheduler for a Semiconductor Fabrication System.” International Journal of Production Research 41 (10): 2345–2364. doi:10.1080/0020754031000077275.
   Web of Science ®Google Scholar
• Priore, P., A. Gomez, R. Pino, and R. Rosillo. 2014. “Dynamic Scheduling of Manufacturing Systems Using Machine Learning: An Updated Review.” Artificial Intelligence for Engineering Design Analysis and Manufacturing 28 (1): 83–97. doi:10.1017/S0890060413000516.
   Web of Science ®Google Scholar
• Priore, P., D. de la Fuente, J. Puente, and J. Parreno. 2006. “A Comparison of Machine-learning Algorithms for Dynamic Scheduling of Flexible Manufacturing Systems.” Engineering Applications of Artificial Intelligence 19 (3): 247–255. doi:10.1016/j.engappai.2005.09.009.
   Web of Science ®Google Scholar
• Quinlan, J. R. 2014. C4. 5: Programs for Machine Learning. New York: Elsevier.
   Google Scholar
• Rumelhart, D. E., G. E. Hinton, and R. J. Williams. 1985. “Learning Internal Representations by Error Propagation.” Technical Report, California Univ San Diego La Jolla Inst for Cognitive Science.
   Google Scholar
• Sarin, S. C., A. Varadarajan, and L. X. Wang. 2011. “A Survey of Dispatching Rules for Operational Control in Wafer Fabrication.” Production Planning & Control 22 (1): 4–24. doi:10.1080/09537287.2010.490014.
   Web of Science ®Google Scholar
• Shahrabi, J., M. A. Adibi, and M. Mahootchi. 2017. “A Reinforcement Learning Approach to Parameter Estimation in Dynamic Job Shop Scheduling.” Computers & Industrial Engineering 110: 75–82. doi:10.1016/j.cie.2017.05.026.
   Web of Science ®Google Scholar
• Shahzad, A., and N. Mebarki. 2012. “Data Mining Based Job Dispatching Using Hybrid Simulation-optimization Approach for Shop Scheduling Problem.” Engineering Applications of Artificial Intelligence 25 (6): 1173–1181. doi:10.1016/j.engappai.2012.04.001.
   Web of Science ®Google Scholar
• Shiue, Y. R. 2009. “Data-mining-based Dynamic Dispatching Rule Selection Mechanism for Shop Floor Control Systems Using a Support Vector Machine Approach.” International Journal of Production Research 47 (13): 3669–3690. doi:10.1080/00207540701846236.
   Web of Science ®Google Scholar
• Shiue, Y. R., R. S. Guh, and K. C. Lee. 2011. “Study of SOM-based Intelligent Multi-controller for Real-time Scheduling.” Applied Soft Computing 11 (8): 4569–4580. doi:10.1016/j.asoc.2011.07.022.
   Web of Science ®Google Scholar
• Shiue, Y. R., R. S. Guh, and K. C. Lee. 2012. “Development of Machine Learning-based Real Time Scheduling Systems: Using Ensemble Based on Wrapper Feature Selection Approach.” International Journal of Production Research 50 (20): 5887–5905. doi:10.1080/00207543.2011.636389.
   Web of Science ®Google Scholar
• Shiue, Y.-R., K.-C. Lee, and C.-T. Su. 2018. “Real-time Scheduling for a Smart Factory Using a Reinforcement Learning Approach.” Computers & Industrial Engineering 125: 604–614. doi:10.1016/j.cie.2018.03.039.
   Web of Science ®Google Scholar
• Siebert, M., K. Bartlett, H. Kim, S. Ahmed, J. Lee, D. Nazzal, G. Nemhauser, and J. Sokol. 2018. “Lot Targeting and Lot Dispatching Decision Policies for Semiconductor Manufacturing: Optimisation under Uncertainty with Simulation Validation.” International Journal of Production Research 56 (1–2): 629–641. doi:10.1080/00207543.2017.1387679.
   Web of Science ®Google Scholar
• Singh, R., and M. Mathirajan. 2021. “A New Stage-Wise Control Release Policy for Semiconductor Wafer Fabrication Systems.” IEEE Transactions on Semiconductor Manufacturing 34: 115–134. doi:10.1109/TSM.2020.3042856.
   Web of Science ®Google Scholar
• Stricker, N., A. Kuhnle, R. Sturm, and S. Friess. 2018. “Reinforcement Learning for Adaptive Order Dispatching in the Semiconductor Industry.” Cirp Annals-Manufacturing Technology 67 (1): 511–514. doi:10.1016/j.cirp.2018.04.041.
   Web of Science ®Google Scholar
• Sutton, R. S., and A. G. Barto. 1998. “Reinforcement Learning: An Introduction.”
   Google Scholar
• Tung, J., T. Sheen, M. Kao, and C. H. Chen. 2013. “Optimization of AMHS Design for a Semiconductor Foundry Fab by Using Simulation Modeling.” 2013 Winter Simulations Conference (WSC). New York: IEEE.
   Google Scholar
• Vapnik, V. 2013. The Nature of Statistical Learning Theory. Berlin, Germany: Springer science & business media.
   Google Scholar
• Vesanto, J., and E. Alhoniemi. 2000. “Clustering of the Self-organizing Map.” IEEE Transactions on Neural Networks 11 (3): 586–600. doi:10.1109/72.846731.
   PubMed Web of Science ®Google Scholar
• Wang, J. L., and J. Zhang. 2016. “Big Data Analytics for Forecasting Cycle Time in Semiconductor Wafer Fabrication System.” International Journal of Production Research 54 (23): 7231–7244. doi:10.1080/00207543.2016.1174789.
   Web of Science ®Google Scholar
• Wang, Y. C., J. M. Usher. 2005. “Application of reinforcement learning for agent-based production scheduling.” Engineering Applications of Artificial Intelligence 18 (1):73–82. doi:10.1016/j.engappai.2004.08.018
   Web of Science ®Google Scholar
• Watkins, C. J. C. H., and P. Dayan. 1992. “Q-Learning.” Machine Learning 8 (3–4): 279–292. doi:10.1023/A:1022676722315.
   Web of Science ®Google Scholar
• Wein, L. M. 1988. “Scheduling Semiconductor Wafer Fabrication.” IEEE Transactions on Semiconductor Manufacturing 1 (3): 115–130. doi:10.1109/66.4384.
   Web of Science ®Google Scholar
• Wu, C. H., Y. C. Yao, S. Dauzère-Pérès, and C. J. Yu. 2020. “Dynamic Dispatching and Preventive Maintenance for Parallel Machines with Dispatching-dependent Deterioration.” Computers & Operations Research 113: 104779. doi:10.1016/j.cor.2019.104779.
   Web of Science ®Google Scholar
• Wu, S. Y. D., and R. A. Wysk. 2007. “An Application of Discrete-event Simulation to On-line Control and Scheduling in Flexible Manufacturing.” International Journal of Production Research 27 (9): 1603–1623. doi:10.1080/00207548908942642.
   Google Scholar
• Yugma, C., J. Blue, S. Dauzere-Peres, and A. Obeid. 2015. “Integration of Scheduling and Advanced Process Control in Semiconductor Manufacturing: Review and Outlook.” Journal of Scheduling 18 (2): 195–205. doi:10.1007/s10951-014-0381-1.
   Web of Science ®Google Scholar
• Zhong, R. Y., Q. Y. Dai, T. Qu, G. J. Hu, and G. Q. Huang. 2013. “RFID-enabled Real-time Manufacturing Execution System for Mass-customization Production.” Robotics and Computer-Integrated Manufacturing 29 (2): 283–292. doi:10.1016/j.rcim.2012.08.001.
   Web of Science ®Google Scholar
• Zhou, Q., and B. H. Zhou. 2016. “A Deadlock Recovery Strategy for Unified Automated Material Handling Systems in 300 Mm Wafer Fabrications.” Computers in Industry 75: 1–12. doi:10.1016/j.compind.2015.10.014.
   Web of Science ®Google Scholar