An online machine learning framework for early detection of product failures in an Industry 4.0 context

References

• Abadi, M., A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, et al. 2016. “Tensorflow: Large-Scale Machine Learning on Heterogeneous Distributed Systems.” arXivpreprintarXiv:1603.04467
   Google Scholar
• Acciani, G., G. Brunetti, and G. Fornarelli. 2006. “Application of Neural Networks in Optical Inspection and Classification of Solder Joints in Surface Mount Technology.” IEEE Transactions on Industrial Informatics 2 (3): 200–209. doi:10.1109/TII.2006.877265.
   Web of Science ®Google Scholar
• Aggarwal, C. C. 2007. Data Streams: Models and Algorithms. Vol. 31. US: Springer Science & Business Media.
   Google Scholar
• Apache Foundation. 2018. “Apache Kafka.” https://kafka.apache.org/
   Google Scholar
• Backmann, M., A. Baumgrass, N. Herzberg, A. Meyer, and M. Weske. 2013. “Model-Driven Event Query Generation for Business Process Monitoring.” In International Conference on Service-Oriented Computing, 406–418. Berlin, Germany: Springer.
   Google Scholar
• Banks, A., and R. Gupta 2014. “MQTT Version 3.1.1.” Accessed March, 2016. http://docs.oasis-open.org/mqtt/mqtt/v3.1.1/mqtt-v3.1.1.html
   Google Scholar
• Bauer, H., C. Baur, G. Camplone, et al. 2015. “Industry 4.0: How to Navigate Digitization of the Manufacturing Sector.” Technical Report of McKinsey Digital.
   Google Scholar
• Baumgraß, A., N. Herzberg, A. Meyer, and M. Weske. 2014. “BPMN Extension for Business Process Monitoring.” In EMISA, Luxembourg, Luxemburg.
   Google Scholar
• Bodnarova, A., M. Bennamoun, and S. Latham. 2002. “Optimal Gabor Filters for Textile Flaw Detection.” Pattern Recognition 35 (12): 2973–2991. doi:10.1016/S0031-3203(02)00017-1.
   Web of Science ®Google Scholar
• Bonino, D., M. T. D. Alizo, A. Alapetite, T. Gilbert, M. Axling, H. Udsen, J. Á. C. Soto, and M. Spirito. 2015. “ALMANAC: Internet of Things for Smart Cities.” In The 3rd International Conference on Future Internet of Things and Cloud (FiCloud2015), Rome, Italy: IEEE.
   Google Scholar
• Bonino, D., M. T. Delgado, C. Pastrone, M. Spirito, A. Alapetite, T. Gilbert, and M. Axling. 2017. “Enabling Smart Cities through IoT: The ALMANAC Way, Chap. 8.” In The Internet of Things: Foundation for Smart Cities, eHealth, and Ubiquitous Computing, edited by R. Armentano, R. S. Bhadoria, P. Chatterjee, G. C. Deka, et al., 173–201. New York: CRC Press Press.
   Google Scholar
• Bottou, L. 1991. “Stochastic Gradient Learning in Neural Networks.” In Proceedings of Neuro-Nîmes 91. France: Nimes. http://leon.bottou.org/papers/bottou-91c
   Google Scholar
• Breiman, L. 2001. “Random Forests.” Machine Learning 45 (1): 5–32. doi:10.1023/A:1010933404324.
   Web of Science ®Google Scholar
• Brosnan, T., and D. W. Sun. 2002. “Inspection and Grading of Agricultural and Food Products by Computer Vision Systems a Review.” Computers and Electronics in Agriculture 36 (2): 193–213. doi:10.1016/S0168-1699(02)00101-1.
   Web of Science ®Google Scholar
• Buchmann, A., and B. Koldehofe. 2009. “Complex Event Processing.” IT-Information Technology Methoden Und Innovative Anwendungen Der Informatik Und Informationstechnik 51 (5): 241–242.
   Google Scholar
• Calantone, R. J., and C. A. Di Benedetto. 2000. “Performance and Time to Market: Accelerating Cycle Time with Overlapping Stages.” IEEE Transactions on Engineering Management 47 (2): 232–244. doi:10.1109/17.846790.
   Web of Science ®Google Scholar
• Cheeseman, M. J., P. Swann, G. B. Hesketh, and S. Barnes. 2005. “Adaptive Manufacturing Scheduling: A Flexible and Configurable Agent-Based Prototype.” Production Planning & Control 16 (5): 479–487. doi:10.1080/09537280500121810.
   Web of Science ®Google Scholar
• Chen, F. L., and S. F. Liu. 2000. “A Neural-Network Approach to Recognize Defect Spatial Pattern in Semiconductor Fabrication.” IEEE Transactions on Semiconductor Manufacturing 13 (3): 366–373. doi:10.1109/66.857947.
   Web of Science ®Google Scholar
• Chiu, S., S. L. Wang, and Y. S. P. Chiu. 2007. “Determining the Optimal Run Time for EPQ Model with Scrap, Rework, and Stochastic Breakdowns.” European Journal of Operational Research 180 (2): 664–676. doi:10.1016/j.ejor.2006.05.005.
   Web of Science ®Google Scholar
• Chiu, Y.S. P., and H.H. Chang. 2014. “Optimal Run Time for EPQ Model with Scrap, Rework and Stochastic Breakdowns: A Note.” Economic Modelling 37: 143–148. doi:10.1016/j.econmod.2013.11.006.
   Web of Science ®Google Scholar
• Ciresan, D. C., U. Meier, and J. Schmidhuber. 2012. “Transfer Learning for Latin and Chinese Characters with Deep Neural Networks.” In Neural Networks (IJCNN), The 2012 International Joint Conference on, 1–6. Brisbane, Australia: IEEE.
   Google Scholar
• Cugola, G., and A. Margara. 2012. “Processing Flows of Information: From Data Stream to Complex Event Processing.” ACM Computing Surveys (CSUR) 44 (3): 15. doi:10.1145/2187671.2187677.
   Web of Science ®Google Scholar
• De Ron, A. J., and J. E. Rooda. 2006. “OEE and Equipment Effectiveness: An Evaluation.” International Journal of Production Research 44 (23): 4987–5003. doi:10.1080/00207540600573402.
   Web of Science ®Google Scholar
• Dierks, T., and E. Rescorla. 2008. “The Transport Layer Security (TLS) Protocol Version 1.2.” RFC 5246 (Proposed Standard), Aug. Updated by RFCs 5746, 5878, 6176, http://www.ietf.org/rfc/rfc5246.txt
   Google Scholar
• Docker, Inc. 2018. “Docker.” docs.docker.com
   Google Scholar
• Escofet, J., R. Navarro, J. Pladellorens et al. 1998. “Detection of Local Defects in Textile Webs Using Gabor Filters.” Optical Engineering 37 (8): 2297–2307. DOI:10.1117/1.601751.
   Web of Science ®Google Scholar
• Fogliatto, F. S., G. J. C. Da Silveira, and D. Borenstein. 2012. “The Mass Customization Decade: An Updated Review of the Literature.” International Journal of Production Economics 138 (1): 14–25. doi:10.1016/j.ijpe.2012.03.002.
   Web of Science ®Google Scholar
• Gaber, M. M., S. Krishnaswamy, and A. Zaslavsky. 2005. “On-Board Mining of Data Streams in Sensor Networks.” In Advanced Methods for Knowledge Discovery from Complex Data, edited by Ujjwal Maulik, Lawrence B. Holder, Diane J. Cook, 307–335. London: Springer.
   Google Scholar
• Gaber, M. M., A. Zaslavsky, and S. Krishnaswamy. 2005. “Mining Data Streams: A Review.” SIGMOD Record 34 (2): 18–26. doi:10.1145/1083784.1083789.
   Web of Science ®Google Scholar
• Gallarda, H. S., C. W. Lo, A. Rhoads, and C. G. Talbot. 2003. “Feature-Based Defect Detection.”US Patent 6,539,106. March. 25.
   Google Scholar
• Gama, J. 2010. Knowledge Discovery from Data Streams. New York: CRC Press.
   Google Scholar
• Hameed, B., F. Durr, and K. Rothermel. 2011. RFID Based Complex Event Processing in a Smart Real-Time Factory, 3rd CIRP International Conference on Industrial Product Service Systems, Braunschweig, Germany.
   Google Scholar
• Hayek, P. A., and M. K. Salameh. 2001. “Production Lot Sizing with the Reworking of Imperfect Quality Items Produced.” Production Planning & Control 12 (6): 584–590. doi:10.1080/095372801750397707.
   Web of Science ®Google Scholar
• Hermann, M., T. Pentek, and B. Otto. 2016. “Design Principles for Industrie 4.0 Scenarios.” In System Sciences (HICSS), 2016 49th Hawaii International Conference on. 3928–3937. Kauai, Hawaii: IEEE.
   Google Scholar
• Huang, S. H., J. P. Dismukes, J. Shi, Q. I. Su, M. A. Razzak, R. Bodhale, and D. Eugene Robinson. 2003. “Manufacturing Productivity Improvement Using Effectiveness Metrics and Simulation Analysis.” International Journal of Production Research 41 (3): 513–527. doi:10.1080/0020754021000042391.
   Web of Science ®Google Scholar
• Hui, T. W., and G. K. H. Pang. 2009. “Solder Paste Inspection Using Region-Based Defect Detection.” The International Journal of Advanced Manufacturing Technology 42 (7–8): 725–734. doi:10.1007/s00170-008-1639-6.
   Web of Science ®Google Scholar
• Ilie-Zudor, E. 2016. “EXCELL Project.” http://excell-project.eu/
   Google Scholar
• Izaguirre, M., J. A. Garcia, A. Lobov, and J. L. Martinez Lastra. 2011. “OPC-UA and DPWS Interoperability for Factory Floor Monitoring Using Complex Event Processing.” In 2011 9th IEEE International Conference on Industrial Informatics, 205–211. Lisbon, Portugal: IEEE.
   Google Scholar
• Jentsch, M. 2016. “Composition Project.” https://www.composition-project.eu/
   Google Scholar
• Jin, X., X. Lee, N. Kong, and B. Yan. 2008. “Efficient Complex Event Processing over RFID Data Stream.” In Computer and Information Science, 2008. ICIS 08. Seventh IEEE/ACIS International Conference on, 75–81. Portland, Oregon, USA: IEEE.
   Google Scholar
• Jones, E., T. Oliphant, P. Peterson, et al. 2001. “SciPy: Open Source Scientific Tools for Python.” Accessed March 12 2017. http://www.scipy.org/
   Google Scholar
• Jones, M., J. Bradley, and N. Sakimura. 2015. “JSON Web Signature (JWS).” Technical Report.
   Google Scholar
• JSON. 2013. “The JSON Data Interchange Format.” Technical Report Standard ECMA-404 1st Edition/October 2013. ECMA. http://www.ecma-international.org/publications/files/ECMA-ST/ECMA-404.pdf
   Google Scholar
• Kagermann, H., W. Wahlster, and J. Helbig. 2013. “Recommendations for Implementing the Strategic Initiative INDUSTRIE 4.0.” Technical Report. Lyoner Strae 9 60528. Frankfurt/Main Germany: National Academy of Science and Engineering.
   Google Scholar
• Kent, K., J. Kivlin, and E. Gasmann. 2001. “Automatic Defect Detection and Generation of Control Code for Subsequent Defect Repair on an Assembly Line.”US Patent 6,240,633. June. 5.
   Google Scholar
• Kim, T. H., T. H. Cho, Y. S. Moon, and S. H. Park. 1999. “Visual Inspection System for the Classification of Solder Joints.” Pattern Recognition 32 (4): 565–575. doi:10.1016/S0031-3203(98)00103-4.
   Web of Science ®Google Scholar
• Ko, K. W., Y. J. Roh, H. S. Cho, and H. C. Kimn. 2000. “A Neural Network Approach to the Inspection of Ball Grid Array Solder Joints on Printed Circuit Boards.” In Neural Networks, 2000. IJCNN 2000, Proceedings of the IEEE-INNIEEES-ENNS International Joint Conference on Neural Networks, Vol. 5, 233–238, Como, Italy.
   Google Scholar
• Kumar, A. 2003. “Neural Network Based Detection of Local Textile Defects.” Pattern Recognition 36 (7): 1645–1659. doi:10.1016/S0031-3203(03)00005-0.
   Web of Science ®Google Scholar
• Kunz, S., T. Fickinger, J. Prescher, and K. Spengler. 2010. “Managing Complex Event Processes with Business Process Modeling Notation.” In International Workshop on Business Process Modeling Notation, 78–90. Potsdam, Germany: Springer.
   Google Scholar
• Lee, J., B. Bagheri, and H. A. Kao. 2015. “A Cyber-Physical Systems Architecture for Industry 4.0-Based Manufacturing Systems.” Manufacturing Letters 3: 18–23. doi:10.1016/j.mfglet.2014.12.001.
   Google Scholar
• Leitão, P., and F. Restivo. 2006. “ADACOR: A Holonic Architecture for Agile and Adaptive Manufacturing Control.” Computers in Industry 57 (2): 121–130. doi:10.1016/j.compind.2005.05.005.
   Web of Science ®Google Scholar
• Li, M. H. C., A. Al-Refaie, and C. Y. Yang. 2008. “DMAIC Approach to Improve the Capability of SMT Solder Printing Process.” IEEE Transactions on Electronics Packaging Manufacturing 31 (2): 126–133. doi:10.1109/TEPM.2008.919342.
   Web of Science ®Google Scholar
• Li, Q., M. Wang, and G. Weikang. 2002. “Computer Vision Based System for Apple Surface Defect Detection.” Computers and Electronics in Agriculture 36 (2): 215–223. doi:10.1016/S0168-1699(02)00093-5.
   Web of Science ®Google Scholar
• Liang, S. H. L., C. Y. Huang, and T. Khalafbeigi. 2016. “OGC SensorThings API Part I:Sensing OGC Implementation Standard.” http://docs.opengeospatial.org/is/15-078r6/15-078r6.html
   Google Scholar
• Light, R. A. 2017. “Mosquitto: Server and Client Implementation of the MQTT Protocol.” The Journal of Open Source Software 2 (13): 265. doi:10.21105/joss.00265.
   Google Scholar
• LinkSmart. 2016. “LinkSmart Learning Agent.” may. Accessed December 01 2017. https://docs.LinkSmart.eu/display/LA/
   Google Scholar
• LinkSmart. 2017. “LinkSmart Platform.” may. Accessed January 10 2018. https://docs.LinkSmart.eu
   Google Scholar
• Lotter, B., and H. P. Wiendahl. 2009. “Changeable and Reconfigurable Assembly Systems.” In Changeable and Reconfigurable Manufacturing Systems, edted by Hoda A. ElMaraghy, 127–142. London: Springer.
   Google Scholar
• Luckham, D. C. 2011. Event Processing for Business: Organizing the Real-Time Enterprise. Chichester, United Kingdom: John Wiley & Sons.
   Google Scholar
• Mahnke, W., S.-H. Leitner, and M. Damm. 2009. OPC Unified Architecture. Berlin, Heidelberg: Springer Science & Business Media.
   Google Scholar
• Maier, A., A. Vodencarevic, O. Niggemann, R. Just, and M. Jaeger. 2011. “Anomaly Detection in Production Plants Using Timed Automata.” In 8th International Conference on Informatics in Control, Automation and Robotics (ICINCO), 363–369, Noordwijkerhout, The Netherlands.
   Google Scholar
• Michael, M., J. E. Moreira, D. Shiloach, and R. W. Wisniewski. 2007. “Scale-Up X Scale-Out: A Case Study Using Nutch/Lucene.” In Parallel and Distributed Processing Symposium, 2007. IPDPS 2007. IEEE International, 1–8. Long Beach, California, USA: IEEE.
   Google Scholar
• Monostori, L. 2014. “Cyber-Physical Production Systems: Roots, Expectations and R&D Challenges.” Procedia Cirp 17: 9–13. doi:10.1016/j.procir.2014.03.115.
   Google Scholar
• Mont, O. K. 2002. “Clarifying the Concept of Product–Service System.” Journal of Cleaner Production 10 (3): 237–245. doi:10.1016/S0959-6526(01)00039-7.
   Web of Science ®Google Scholar
• Muchiri, P., and L. Pintelon. 2008. “Performance Measurement Using Overall Equipment Effectiveness (OEE): Literature Review and Practical Application Discussion.” International Journal of Production Research 46 (13): 3517–3535. doi:10.1080/00207540601142645.
   Web of Science ®Google Scholar
• Nassehi, A., S. T. Newman, and R. D. Allen. 2006. “STEP-NC Compliant Process Planning as an Enabler for Adaptive Global Manufacturing.” Robotics and Computer-Integrated Manufacturing 22 (5): 456–467. doi:10.1016/j.rcim.2005.11.003.
   Web of Science ®Google Scholar
• Newman, S. 2015. Building Microservices: Designing Fine-Grained Systems. Sebastopol, California, USA: O’Reilly Media.
   Google Scholar
• OPC Foundation. 2017. “OPC Data Access.” Accessed December 13 2017. https://opcfoundation.org/developer-tools/specifications-classic/data-access/
   Google Scholar
• Pedregosa, F., G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel et al. 2011. “Scikit-Learn: Machine Learning in Python.” Journal of Machine Learning Research 12 (Oct): 2825–2830.
   Google Scholar
• Pellicciari, M., A. O. Andrisano, F. Leali, and A. Vergnano. 2009. “Engineering Method for Adaptive Manufacturing Systems Design.” International Journal on Interactive Design and Manufacturing (Ijidem) 3 (2): 81–91. doi:10.1007/s12008-009-0065-9.
   Google Scholar
• Pham, D. T., and A. A. Afify. 2005. “Machine-Learning Techniques and Their Applications in Manufacturing.” Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture 219 (5): 395–412. doi:10.1243/095440505X32274.
   Web of Science ®Google Scholar
• Piller, F., E. Lindgens, and F. Steiner. 2012. Mass Customization at Adidas: Three Strategic Capabilities to Implement Mass Customization, SSRN Electronic Journal.
   Google Scholar
• Richardson, L., and S. Ruby. 2008. RESTful Web Services. Sebastopol, California, USA: O’Reilly Media.
   Google Scholar
• Scipy. 2017. “Scipy: Logistic Probability Density Function.” Accessed August 02 2017. https://docs.scipy.org/doc/scipy/reference/generated/scipy.stats.logistic.html
   Google Scholar
• Siemens. 2016. “Plant Simulation.” https://www.plm.automation.siemens.com
   Google Scholar
• Siemens, A. G. 2018. “Siemens s7 SIMATIC.”
   Google Scholar
• Sola, J., and J. Sevilla. 1997. “Importance of Input Data Normalization for the Application of Neural Networks to Complex Industrial Problems.” IEEE Transactions on Nuclear Science 44 (3): 1464–1468. doi:10.1109/23.589532.
   Web of Science ®Google Scholar
• Soto, C., J. Ángel, M. Jentsch, D. Preuveneers, and E. Ilie-Zudor. 2016a. “CEML: Mixing and Moving Complex Event Processing and Machine Learning to the Edge of the Network for IoT Applications.” In Proceedings of the 6th International Conference on the Internet of Things, IoT’16, New York, NY, USA, 103–110. ACM. doi:10.1145/2991561.2991575.
   Google Scholar
• Soto, C., J. Angel, O. Werner-Kytölä, M. Jahn, J. Pullmann, D. Bonino, C. Pastrone, and M. Spirito. 2016b. “Towards a Federation of Smart City Services.” In International Conference on Recent Advances in Computer Systems (RACS 2015), 163–168, Hail, Saudi Arabia.
   Google Scholar
• Stéfan van der, W., S. C. Colbert, and G. Varoquaux. 2011. “The NumPy Array: A Structure for Efficient Numerical Computation.” Computing in Science & Engineering 13 (2): 22–30. doi:10.1109/MCSE.2011.37.
   Web of Science ®Google Scholar
• Taleizadeh, A. A., H. M. Wee, and S. J. Sadjadi. 2010. “Multi-Product Production Quantity Model with Repair Failure and Partial Backordering.” Computers & Industrial Engineering 59 (1): 45–54. doi:10.1016/j.cie.2010.02.015.
   Web of Science ®Google Scholar
• Tavakolizadeh, F., J. N. C. Soto, D. Gyulai, and C. Beecks. 2017. “Industry 4.0: Mining Physical Defects in Production of Surface-Mount Devices.” In Proceedings of the 17th Industrial Conference, Advances in Data Mining, ICDM 2017, New York, NY, 146–151. http://www.data-mining-forum.de/books/icdmposter2017.pdf
   Google Scholar
• Theano Development Team. 2016. “Theano: A Python Framework for Fast Computation of Mathematical Expressions.” arXiv e-prints abs/1605.02688. http://arxiv.org/abs/1605.02688
   Google Scholar
• Toth, D., and T. Aach. 2001. “Improved Minimum Distance Classification with Gaussian Outlier Detection for Industrial Inspection.” In Image Analysis and Processing, 2001. Proceedings. 11th International Conference on, 584–588. Palermo, Italy: IEEE.
   Google Scholar
• Tsai, D. M., and R. H. Yang. 2005. “An Eigenvalue-Based Similarity Measure and Its Application in Defect Detection.” Image and Vision Computing 23 (12): 1094–1101. doi:10.1016/j.imavis.2005.07.014.
   Web of Science ®Google Scholar
• Vachtsevanos, G. J., I. M. Dar, K. E. Newman, and E. Sahinci. 1999. “Inspection System and Method for Bond Detection and Validation of Surface Mount Devices.”US Patent 5,963,662. October. 5.
   Google Scholar
• Viharos, F., J. Zs, S. D. Chetverikov, T. A. Háry, F. R. Sághegyi, F. A. Barta, S. L. Zalányi, S. I. Pomozi, E. S. Soós, N. Z. Kövér, and T. B. Varjú. 2016. “Vision Based, Statistical Learning System for Fault Recognition in Industrial Assembly Environment.” In Emerging Technologies and Factory Automation (ETFA), 2016 IEEE 21st International Conference on, 1–6. IEEE.
   Google Scholar
• Vilella, J. L. 2009. “Electronic Assembly Video Inspection System.”. US Patent 7,486,813. Feburary 3.
   Google Scholar
• Vyatkin, V., Z. Salcic, P. S. Roop, and J. Fitzgerald. 2007. “Now That’s Smart!” IEEE Industrial Electronics Magazine 1 (4): 17–29.
   Web of Science ®Google Scholar
• Zliobaite, I., A. Bifet, B. Pfahringer, and G. Holmes. 2014. “Active Learning with Drifting Streaming Data.” IEEE Transactions on Neural Networks and Learning Systems 25 (1): 27–39. doi:10.1109/TNNLS.2012.2236570.
   PubMed Web of Science ®Google Scholar