Label-Noise Robust Deep Generative Model for Semi-Supervised Learning

References

• Arazo, E., Ortego, D., Albert, P., O’Connor, N. E., and McGuinness, K. (2019), “Unsupervised Label Noise Modeling and Loss Correction,” arXiv preprint arXiv:1904.11238.
   Google Scholar
• Arpit, D., Jastrzebski, S., Ballas, N., Krueger, D., Bengio, E., Kanwal, M. S., Maharaj, T., Fischer, A., Courville, A., Bengio, Y., Lacoste-Julien, S. (2017), “A Closer Look at Memorization in Deep Networks,” in Proceedings of the 34th International Conference on Machine Learning, JMLR, vol. 70, pp. 233–242.
   Google Scholar
• Atarashi, K., Oyama, S., and Kurihara, M. (2018), “Semi-supervised Learning from Crowds Using Deep Generative Models,” in Thirty-Second AAAI Conference on Artificial Intelligence.
   Google Scholar
• Berthon, A., Han, B., Niu, G., Liu, T., and Sugiyama, M. (2021), “Confidence Scores Make Instance-Dependent Label-Noise Learning Possible,” in International Conference on Machine Learning, PMLR, pp. 825–836.
   Google Scholar
• Cheng, J., Liu, T., Ramamohanarao, K., and Tao, D. (2020a), “Learning with Bounded Instance and Label-dependent Label Noise,” in Proceedings of the 37th International Conference on Machine Learning, eds. H. Daumé III and A. Singh, PMLR, vol. 119, pp. 1789–1799.
   Google Scholar
• Cheng, J., Liu, T., Ramamohanarao, K., and Tao, D. (2020b), “Learning with Bounded Instance and Label-Dependent Label Noise,” in International Conference on Machine Learning, PMLR, pp. 1789–1799.
   Google Scholar
• Goldberger, J., and Ben-Reuven, E. (2017), “Training Deep Neural-Networks Using a Noise Adaptation Layer,” in International Conference on Learning Representations.
   Google Scholar
• Han, B., Yao, Q., Yu, X., Niu, G., Xu, M., Hu, W., Tsang, I., and Sugiyama, M. (2018), “Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels,” in Advances in Neural Information Processing Systems, pp. 8527–8537.
   Google Scholar
• Han, J., Luo, P., and Wang, X. (2019), “Deep Self-Learning from Noisy Labels,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 5138–5147.
   Google Scholar
• Hendrycks, D., Mazeika, M., Wilson, D., and Gimpel, K. (2018), “Using Trusted Data to Train Deep Networks on Labels Corrupted by Severe Noise,” arXiv preprint arXiv:1802.05300.
   Google Scholar
• Hyun, Y., and Kim, H. (2020), “Memory-Augmented Convolutional Neural Networks with Triplet Loss for Imbalanced Wafer Defect Pattern Classification,” IEEE Transactions on Semiconductor Manufacturing, 33, 622–634. DOI: 10.1109/TSM.2020.3010984.
   Web of Science ®Google Scholar
• Jiang, L., Zhou, Z., Leung, T., Li, L.-J., and Fei-Fei, L. (2017), “Mentornet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labels,” arXiv preprint arXiv:1712.05055.
   Google Scholar
• Kim, J., Lee, Y., and Kim, H. (2018), ’‘Detection and Clustering of Mixed-Type Defect Patterns in Wafer Bin Maps,” IISE Transactions, 50, 99–111. DOI: 10.1080/24725854.2017.1386337.
   Web of Science ®Google Scholar
• Kingma, D. P., Mohamed, S., Rezende, D. J., and Welling, M. (2014), “Semi-supervised Learning with Deep Generative Models,” in Advances in Neural Information Processing Systems, pp. 3581–3589.
   Google Scholar
• Kingma, D. P., Salimans, T., Jozefowicz, R., Chen, X., Sutskever, I., and Welling, M. (2016), “Improved Variational Inference with Inverse Autoregressive Flow,” Advances in Neural Information Processing Systems, 29, 4743–4751.
   Google Scholar
• Kingma, D. P., and Welling, M. (2013), “Auto-Encoding Variational Bayes,” arXiv preprint arXiv:1312.6114.
   Google Scholar
• Kremer, J., Sha, F., and Igel, C. (2018), “Robust Active Label Correction,” in International Conference on Artificial Intelligence and Statistics, pp. 308–316.
   Google Scholar
• Kyeong, K., and Kim, H. (2018), “Classification of Mixed-Type Defect Patterns in Wafer Bin Maps Using Convolutional Neural Networks,” IEEE Transactions on Semiconductor Manufacturing, 31, 395–402. DOI: 10.1109/TSM.2018.2841416.
   Web of Science ®Google Scholar
• Lee, H., and Kim, H. (2020), “Semi-Supervised Multi-Label Learning for Classification of Wafer Bin Maps With Mixed-Type Defect Patterns,” IEEE Transactions on Semiconductor Manufacturing, 33, 653–662. DOI: 10.1109/TSM.2020.3027431.
   Web of Science ®Google Scholar
• Liu, T., and Tao, D. (2015), “Classification with Noisy Labels by Importance Reweighting,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 447–461. DOI: 10.1109/TPAMI.2015.2456899.
   Web of Science ®Google Scholar
• Ma, X., Wang, Y., Houle, M. E., Zhou, S., Erfani, S. M., Xia, S.-T., Wijewickrema, S., and Bailey, J. (2018), “Dimensionality-Driven Learning with Noisy Labels,” arXiv preprint arXiv:1806.02612.
   Google Scholar
• Malach, E., and Shalev-Shwartz, S. (2017), “Decoupling ‘When to Update’ from ‘How to Update”’ in Advances in Neural Information Processing Systems, pp. 960–970.
   Google Scholar
• Nakazawa, T., and Kulkarni, D. V. (2018), “Wafer Map Defect Pattern Classification and Image Retrieval Using Convolutional Neural Network,” IEEE Transactions on Semiconductor Manufacturing, 31, 309–314. DOI: 10.1109/TSM.2018.2795466.
   Web of Science ®Google Scholar
• Natarajan, N., Dhillon, I. S., Ravikumar, P. K., and Tewari, A. (2013), “Learning with Noisy Labels,” in Advances in Neural Information Processing Systems, pp. 1196–1204.
   Google Scholar
• Patrini, G., Rozza, A., Krishna Menon, A., Nock, R., and Qu, L. (2017), “Making Deep Neural Networks Robust to Label Noise: A Loss Correction Approach,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1944–1952.
   Google Scholar
• Reed, S., Lee, H., Anguelov, D., Szegedy, C., Erhan, D., and Rabinovich, A. (2014), “Training Deep Neural Networks on Noisy Labels with Bootstrapping,” arXiv preprint arXiv:1412.6596.
   Google Scholar
• Ren, M., Zeng, W., Yang, B., and Urtasun, R. (2018), “Learning to Reweight Examples for Robust Deep Learning,” arXiv preprint arXiv:1803.09050.
   Google Scholar
• Rezende, D., and Mohamed, S. (2015), “Variational Inference with Normalizing Flows,” in International Conference on Machine Learning, PMLR, pp. 1530–1538.
   Google Scholar
• Sukhbaatar, S., Bruna, J., Paluri, M., Bourdev, L., and Fergus, R. (2014), “Training Convolutional Networks with Noisy Labels,” arXiv preprint arXiv:1406.2080.
   Google Scholar
• Tanaka, D., Ikami, D., Yamasaki, T., and Aizawa, K. (2018), “Joint Optimization Framework for Learning with Noisy Labels,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5552–5560.
   Google Scholar
• Xia, X., Liu, T., Han, B., Wang, N., Gong, M., Liu, H., Niu, G., Tao, D., and Sugiyama, M. (2020), “Part-dependent Label Noise: Towards Instance-Dependent Label Noise,” Advances in Neural Information Processing Systems, 33.
   Google Scholar
• Xia, X., Liu, T., Wang, N., Han, B., Gong, C., Niu, G., and Sugiyama, M. (2019), “Are Anchor Points Really Indispensable in Label-Noise Learning?” in Advances in Neural Information Processing Systems, pp. 6835–6846.
   Google Scholar
• Yan, Y., Xu, Z., Tsang, I. W., Long, G., and Yang, Y. (2016), “Robust Semi-supervised Learning through Label Aggregation,” in Thirtieth AAAI Conference on Artificial Intelligence.
   Google Scholar
• Yao, Y., Liu, T., Gong, M., Han, B., Niu, G., and Zhang, K. (2021), “Instance-Dependent Label-Noise Learning Under a Structural Causal Model,” in Thirty-Fifth Conference on Neural Information Processing Systems.
   Google Scholar
• Yao, Y., Liu, T., Han, B., Gong, M., Deng, J., Niu, G., and Sugiyama, M. (2020), “Dual T: Reducing Estimation Error for Transition Matrix in Label-noise Learning,” in Advances in Neural Information Processing Systems, eds. H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, and H. Lin, Curran Associates, Inc., vol. 33, pp. 7260–7271.
   Google Scholar
• Yi, J., Jin, R., Jain, S., Yang, T., and Jain, A. K. (2012), “Semi-crowdsourced Clustering: Generalizing Crowd Labeling by Robust Distance Metric Learning,” in Advances in Neural Information Processing Systems, pp. 1772–1780.
   Google Scholar
• Yu, X., Han, B., Yao, J., Niu, G., Tsang, I. W., and Sugiyama, M. (2019), “How Does Disagreement Help Generalization Against Label Corruption?” arXiv preprint arXiv:1901.04215.
   Google Scholar
• Zhang, C., Bengio, S., Hardt, M., Recht, B., and Vinyals, O. (2016), “Understanding Deep Learning Requires Rethinking Generalization,” arXiv preprint arXiv:1611.03530.
   Google Scholar
• Zhang, Z., and Sabuncu, M. (2018), “Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels,” in Advances in Neural Information Processing Systems, pp. 8778–8788.
   Google Scholar
• Zhang, Z.-Y., Zhao, P., Jiang, Y., and Zhou, Z.-H. (2019), “Learning from Incomplete and Inaccurate Supervision,” in Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1017–1025.
   Google Scholar