Real-time topology optimization based on multi-scale convolutional attention mechanism

References

• Allaire, Grégoire, François Jouve, and Anca-Maria Toader. 2004. “Structural Optimization Using Sensitivity Analysis and a Level-Set Method.” Journal of Computational Physics 194 (1): 363–393. https://doi.org/10.1016/j.jcp.2003.09.032.
   Web of Science ®Google Scholar
• Almasri, Waad, Dimitri Bettebghor, Faouzi Adjed, Florence Danglade, and Fakhreddine Ababsa. 2024. “Geometrically-Driven Generation of Mechanical Designs Through Deep Convolutional GANs.” Engineering Optimization 56 (1): 18–35. https://doi.org/10.1080/0305215X.2022.2144847.
   Web of Science ®Google Scholar
• Andreassen, Erik, Anders Clausen, Matti Schevenels, Boyan S. Lazarov, and Ole Sigmund. 2011. “Efficient Topology Optimization in MATLAB Using 88 Lines of Code.” Structural and Multidisciplinary Optimization 43 (1): 1–16. https://doi.org/10.1007/s00158-010-0594-7.
   Web of Science ®Google Scholar
• Badrinarayanan, Vijay, Alex Kendall, and Roberto Cipolla. 2017. “SegNet: A Deep Convolutional Encoder–Decoder Architecture for Image Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (12): 2481–2495. https://doi.org/10.1109/TPAMI.34.
   PubMed Web of Science ®Google Scholar
• Banga, Saurabh, Harsh Gehani, Sanket Bhilare, Sagar Patel, and Levent Kara. 2018. “3D Topology Optimization Using Convolutional Neural Networks.” ArXiv abs/1808.07440.
   Google Scholar
• Behzadi, Mohammad Mahdi, and Horea T. Ilieş. 2021. “Real-Time Topology Optimization in 3D Via Deep Transfer Learning.” Computer-Aided Design 135:103014. https://doi.org/10.1016/j.cad.2021.103014.
   Web of Science ®Google Scholar
• Bendsøe, Martin P. . 1989. “Optimal Shape Design As a Material Distribution Problem.” Structural Optimization 1 (4): 193–202. https://doi.org/10.1007/BF01650949.
   Google Scholar
• Bendsøe, Martin P., and Noboru Kikuchi. 1988. “Generating Optimal Topologies in Structural Design Using a Homogenization Method.” Computer Methods in Applied Mechanics and Engineering 71 (2): 197–224. https://doi.org/10.1016/0045-7825(88)90086-2.
   Web of Science ®Google Scholar
• Bendsøe, Martin P., Erik Lund, Niels Olhoff, and Ole Sigmund. 2005. “Topology Optimization—Broadening the Areas of Application.” Control and Cybernetics 34 (1): 7–35.
   Google Scholar
• Bock, Frederic E., Roland C. Aydin, Christian J. Cyron, Norbert Huber, Surya R. Kalidindi, and Benjamin Klusemann. 2019. “A Review of the Application of Machine Learning and Data Mining Approaches in Continuum Materials Mechanics.” Frontiers in Materials 6:110. https://doi.org/10.3389/fmats.2019.00110.
   Web of Science ®Google Scholar
• Carion, Nicolas, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, and Sergey Zagoruyko. 2020. “End-to-End Object Detection with Transformers.” In Proceedings of the 16th European Conference on Computer Vision (ECCV 2020), Vol. 12346 of Lecture Notes in Computer Science, 213–229. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-030-58452-8_13.
   Google Scholar
• Cho, Kyunghyun, Bart van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. “Learning Phrase Representations Using RNN Encoder–Decoder for Statistical Machine Translation.” In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 1724–1734. Doha, Qatar: Association for Computational Linguistics.
   Google Scholar
• Dai, Jifeng, Haozhi Qi, Yuwen Xiong, Yi Li, Guodong Zhang, Han Hu, and Yichen Wei. 2017. “Deformable Convolutional Networks.” In Proceedings of the IEEE International Conference on Computer Vision, 764–773. Piscataway, NJ: IEEE.
   Google Scholar
• Das, Raj, Rhys Jones, and Yi-Min Xie. 2011. “Optimal Topology Design of Industrial Structures Using An Evolutionary Algorithm.” Optimization and Engineering 12 (4): 681–717. https://doi.org/10.1007/s11081-010-9132-0.
   Web of Science ®Google Scholar
• Dosovitskiy, Alexey, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, et al. 2020. “An Image Is Worth 16×16 Words: Transformers for Image Recognition at Scale.” Computing Research Repository (CoRR). CoRR, abs/2010.11929.
   Google Scholar
• Fu, Jun, Jing Liu, Haijie Tian, Yong Li, Yongjun Bao, Zhiwei Fang, and Hanqing Lu. 2019. “Dual Attention Network for Scene Segmentation.” In Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 3141–3149. Piscataway, NJ: IEEE. https://doi.org/10.1109/CVPR.2019.00326.
   Google Scholar
• Geng, Zhengyang, Meng-Hao Guo, Hongxu Chen, Xia Li, Ke Wei, and Zhouchen Lin. 2021. “Is Attention Better than Matrix Decomposition?” arXiv preprint arXiv:2109.04553.
   Google Scholar
• Gregor, Karol, Ivo Danihelka, Alex Graves, Danilo Rezende, and Daan Wierstra. 2015. “DRAW: A Recurrent Neural Network for Image Generation.” In Proceedings of the 32nd International Conference on Machine Learning, Vol. 37 of Proceedings of Machine Learning Research, 1462–1471. Lille, France: PMLR.
   Google Scholar
• Guo, Meng-Hao, Cheng-Ze Lu, Qibin Hou, Zhengning Liu, Ming-Ming Cheng, and Shi-Min Hu. 2022. “SegNext: Rethinking Convolutional Attention Design for Semantic Segmentation.” Advances in Neural Information Processing Systems 35:1140–1156.
   Google Scholar
• Guo, Meng-Hao, Cheng-Ze Lu, Zheng-Ning Liu, Ming-Ming Cheng, and Shi-Min Hu. 2023. “Visual Attention Network.” Computational Visual Media 9 (4): 733–752. https://doi.org/10.1007/s41095-023-0364-2.
   Google Scholar
• Guo, Xu, Weisheng Zhang, and Wenliang Zhong. 2014. “Doing Topology Optimization Explicitly and Geometrically—A New Moving Morphable Components Based Framework.” Journal of Applied Mechanics 81 (8): 081009. https://doi.org/10.1115/1.4027609.
   Web of Science ®Google Scholar
• Heaton, James B., Nick G. Polson, and Jan Hendrik Witte. 2017. “Deep Learning for Finance: Deep Portfolios.” Applied Stochastic Models in Business and Industry 33 (1): 3–12. https://doi.org/10.1002/asmb.v33.1.
   Web of Science ®Google Scholar
• Hou, Qibin, Li Zhang, Ming-Ming Cheng, and Jiashi Feng. 2020. “Strip Pooling: Rethinking Spatial Pooling for Scene Parsing.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 4003–4012. Piscataway, NJ: IEEE.
   Google Scholar
• Hu, Jie, Li Shen, and Gang Sun. 2018. “Squeeze-and-Excitation Networks.” In Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 7132–7141. Piscataway, NJ: IEEE. https://doi.org/10.1109/CVPR.2018.00745.
   Google Scholar
• Jamonnak, Suphanut, Ye Zhao, Xinyi Huang, and Md Amiruzzaman. 2021. “Geo-Context Aware Study of Vision-Based Autonomous Driving Models and Spatial Video Data.” IEEE Transactions on Visualization and Computer Graphics 28 (1): 1019–1029. https://doi.org/10.1109/TVCG.2021.3114853.
   PubMed Web of Science ®Google Scholar
• Ji, Wei, Shuang Yu, Junde Wu, Kai Ma, Cheng Bian, Qi Bi, Jingjing Li, et al. 2021. “Learning Calibrated Medical Image Segmentation via Multi-Rater Agreement Modeling.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 12341–12351. Piscataway, NJ: IEEE.
   Google Scholar
• Károly, Artúr István, Péter Galambos, József Kuti, and Imre J. Rudas. 2020. “Deep Learning in Robotics: Survey on Model Structures and Training Strategies.” IEEE Transactions on Systems, Man, and Cybernetics: Systems 51 (1): 266–279. https://doi.org/10.1109/TSMC.6221021.
   Web of Science ®Google Scholar
• Kazemi, Hesaneh, Carolyn C. Seepersad, and H. Alicia Kim. 2022. “Multiphysics Design Optimization Via Generative Adversarial Networks.” Journal of Mechanical Design 144 (12): 121702. https://doi.org/10.1115/1.4055377.
   Web of Science ®Google Scholar
• Keshavarzzadeh, Vahid, Mehran Alirezaei, Tolga Tasdizen, and Robert M. Kirby. 2021. “Image-Based Multiresolution Topology Optimization Using Deep Disjunctive Normal Shape Model.” Computer-Aided Design 130:102947. https://doi.org/10.1016/j.cad.2020.102947.
   Web of Science ®Google Scholar
• Khan, Muhammad Jaleed, Adeel Yousaf, Nizwa Javed, Shifa Nadeem, and Khurram Khurshid. 2017. “Automatic Target Detection in Satellite Images Using Deep Learning.” Journal of Space Technology 7 (1): 44–49.
   Google Scholar
• Li, Shun, PeiJian Zeng, Nankai Lin, Maohua Lu, Jianghao Lin, and Aimin Yang. 2024. “Topology Optimization Based on Improved DoubleU-Net Using Four Boundary Condition Datasets.” Engineering Optimization, 19pp. Advance online publication.https://doi.org/10.1080/0305215X.2024.2338189.
   Google Scholar
• Lin, Tsung-Yi, Priya Goyal, Ross Girshick, Kaiming He, and Piotr Dollár. 2017. “Focal Loss for Dense Object Detection.” In Proceedings of the IEEE International Conference on Computer Vision, 2980–2988. Piscataway, NJ: IEEE.
   Google Scholar
• Liu, Jikai, and Yongsheng Ma. 2016. “A Survey of Manufacturing Oriented Topology Optimization Methods.” Advances in Engineering Software 100:161–175. https://doi.org/10.1016/j.advengsoft.2016.07.017.
   Web of Science ®Google Scholar
• Long, Jonathan, Evan Shelhamer, and Trevor Darrell. 2015. “Fully Convolutional Networks for Semantic Segmentation.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3431–3440. Piscataway, NJ: IEEE.
   Google Scholar
• Loshchilov, Ilya, and Frank Hutter. 2017. “Decoupled Weight Decay Regularization.” arXiv preprint arXiv:1711.05101.
   Google Scholar
• Mei, Yulin, and Xiaoming Wang. 2004. “A Level Set Method for Structural Topology Optimization and Its Applications.” Advances in Engineering Software 35 (7): 415–441. https://doi.org/10.1016/j.advengsoft.2004.06.004.
   Web of Science ®Google Scholar
• Orme, Melissa E., Michael Gschweitl, Michael Ferrari, Ivan Madera, and Franck Mouriaux. 2017. “Designing for Additive Manufacturing: Lightweighting Through Topology Optimization Enables Lunar Spacecraft.” Journal of Mechanical Design 139 (10): 100905. https://www.researchgate.net/publication/318550709_Designing_for_Additive_Manufacturing_Lightweighting_Through_Topology_Optimization_Enables_Lunar_Spacecraft.
   Web of Science ®Google Scholar
• Qi, Shaohua, Xin Ning, Guowei Yang, Liping Zhang, Peng Long, Weiwei Cai, and Weijun Li. 2021. “Review of Multi-View 3D Object Recognition Methods Based on Deep Learning.” Displays69:102053. https://doi.org/10.1016/j.displa.2021.102053.
   Web of Science ®Google Scholar
• Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. 2015. “U-Net: Convolutional Networks for Biomedical Image Segmentation.” In Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2015), Part III, 234–241. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-319-24574-4_28.
   Google Scholar
• Rozvany, George I. N., Ming Zhou, and Torben Birker. 1992. “Generalized Shape Optimization Without Homogenization.” Structural Optimization 4 (3–4): 250–252. https://doi.org/10.1007/BF01742754.
   Web of Science ®Google Scholar
• Rumelhart, David E., Geoffrey E. Hinton, and Ronald J. Williams. 1986. “Learning Representations by Back-Propagating Errors.” Nature 323 (6088): 533–536. https://doi.org/10.1038/323533a0.
   Web of Science ®Google Scholar
• Seo, Junhyeon, and Rakesh K. Kapania. 2023. “Topology Optimization with Advanced CNN Using Mapped Physics-Based Data.” Structural and Multidisciplinary Optimization 66 (1): 21. https://doi.org/10.1007/s00158-022-03461-0.
   Web of Science ®Google Scholar
• Sigmund, Ole. 2007. “Morphology-Based Black and White Filters for Topology Optimization.” Structural and Multidisciplinary Optimization 33 (4–5): 401–424. https://doi.org/10.1007/s00158-006-0087-x.
   Web of Science ®Google Scholar
• Sigmund, Ole. 2022. “On Benchmarking and Good Scientific Practice in Topology Optimization.” Structural and Multidisciplinary Optimization 65 (11): 315. https://doi.org/10.1007/s00158-022-03427-2.
   Web of Science ®Google Scholar
• Sigmund, Ole, and Kurt Maute. 2013. “Topology Optimization Approaches: A Comparative Review.” Structural and Multidisciplinary Optimization 48 (6): 1031–1055. https://doi.org/10.1007/s00158-013-0978-6.
   Web of Science ®Google Scholar
• Singaravel, Sundaravelpandian, Johan Suykens, and Philipp Geyer. 2018. “Deep-Learning Neural-Network Architectures and Methods: Using Component-Based Models in Building-Design Energy Prediction.” Advanced Engineering Informatics 38:81–90. https://doi.org/10.1016/j.aei.2018.06.004.
   Web of Science ®Google Scholar
• Song, Z., X. Liu, Y. Fang, X. Wang, and S. Su. 2024. “Topology Optimization for Cold Plate Using Neural Networks as Proxy Models.” Engineering Optimization, 28pp. Advance online publication. https://doi.org/10.1080/0305215X.2024.2308555.
   Google Scholar
• Sosnovik, Ivan, and Ivan Oseledets. 2019. “Neural Networks for Topology Optimization.” Russian Journal of Numerical Analysis and Mathematical Modelling 34 (4): 215–223. https://doi.org/10.1515/rnam-2019-0018.
   Web of Science ®Google Scholar
• Szegedy, Christian, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2015. “Going Deeper with Convolutions.” In Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1–9. Piscataway, NJ: IEEE. https://doi.org/10.1109/CVPR.2015.7298594.
   Google Scholar
• Tang, Lixin, and Ying Meng. 2021. “Data Analytics and Optimization for Smart Industry.” Frontiers of Engineering Management 8 (2): 157–171. https://doi.org/10.1007/s42524-020-0126-0.
   Web of Science ®Google Scholar
• Wang, Jingdong, Ke Sun, Tianheng Cheng, Borui Jiang, Chaorui Deng, Yang Zhao, Dong Liu, et al. 2020. “Deep High-Resolution Representation Learning for Visual Recognition.” IEEE Transactions on Pattern Analysis and Machine Intelligence 43 (10): 3349–3364. https://doi.org/10.1109/TPAMI.2020.2983686.
   Web of Science ®Google Scholar
• Wang, Michael Y., Xiaoming Wang, and Dongming Guo. 2003. “A Level Set Method for Structural Topology Optimization.” Computer Methods in Applied Mechanics and Engineering 192 (1-2): 227–246. https://doi.org/10.1016/S0045-7825(02)00559-5.
   Web of Science ®Google Scholar
• Wang, Dalei, Cheng Xiang, Yue Pan, Airong Chen, Xiaoyi Zhou, and Yiquan Zhang. 2022. “A Deep Convolutional Neural Network for Topology Optimization with Perceptible Generalization Ability.” Engineering Optimization 54 (6): 973–988. https://doi.org/10.1080/0305215X.2021.1902998.
   Web of Science ®Google Scholar
• Woo, Sanghyun, Jongchan Park, Joon-Young Lee, and In So Kweon. 2018. “CBAM: Convolutional Block Attention Module.” In Proceedings of the European Conference on Computer Vision (ECCV), 3–19. Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-030-01234-2_1.
   Google Scholar
• Xia, Liang, Felix Fritzen, and Piotr Breitkopf. 2017. “Evolutionary Topology Optimization of Elastoplastic Structures.” Structural and Multidisciplinary Optimization 55 (2): 569–581. https://doi.org/10.1007/s00158-016-1523-1.
   Web of Science ®Google Scholar
• Xiang, Cheng, Airong Chen, and Dalei Wang. 2022. “Real-Time Stress-Based Topology Optimization Via Deep Learning.” Thin-Walled Structures 181:110055. https://doi.org/10.1016/j.tws.2022.110055.
   Web of Science ®Google Scholar
• Xie, Yi Min, and Grant P. Steven. 1993. “A Simple Evolutionary Procedure for Structural Optimization.” Computers & Structures 49 (5): 885–896. https://doi.org/10.1016/0045-7949(93)90035-C.
   Web of Science ®Google Scholar
• Xie, Enze, Wenhai Wang, Zhiding Yu, Anima Anandkumar, Jose M. Alvarez, and Ping Luo. 2021. “SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers.” Advances in Neural Information Processing Systems 34:12077–12090.
   Google Scholar
• Yan, Jun, Qi Zhang, Qi Xu, Zhirui Fan, Haijiang Li, Wei Sun, and Guangyuan Wang. 2022. “Deep Learning Driven Real Time Topology Optimisation Based on Initial Stress Learning.” Advanced Engineering Informatics 51:101472. https://doi.org/10.1016/j.aei.2021.101472.
   Web of Science ®Google Scholar
• Yang, X. Y., Y. M. Xie, G. P. Steven, and O. M. Querin. 1999. “Bidirectional Evolutionary Method for Stiffness Optimization.” AIAA Journal 37 (11): 1483–1488. https://doi.org/10.2514/2.626.
   Web of Science ®Google Scholar
• Yuan, Yunshuang, Hao Cheng, and Monika Sester. 2022. “Keypoints-Based Deep Feature Fusion for Cooperative Vehicle Detection of Autonomous Driving.” IEEE Robotics and Automation Letters 7 (2): 3054–3061. https://doi.org/10.1109/LRA.2022.3143299.
   Web of Science ®Google Scholar
• Yuan, Yuhui, Lang Huang, Jianyuan Guo, Chao Zhang, Xilin Chen, and Jingdong Wang. 2021. “OCNet: Object Context Network for Scene Parsing.” International Journal of Computer Vision 129 (8): 2375–2398. https://doi.org/10.1007/s11263-021-01465-9.
   Google Scholar
• Zhang, Han, Ian Goodfellow, Dimitris Metaxas, and Augustus Odena. 2019. “Self-Attention Generative Adversarial Networks.” In Proceedings of the 36th International Conference on Machine Learning, Vol. 97 of Proceedings of Machine Learning Research, 7354–7363. Lille, France: PMLR.
   Google Scholar
• Zhang, Yiquan, Bo Peng, Xiaoyi Zhou, Cheng Xiang, and Dalei Wang. 2020. “A Deep Convolutional Neural Network for Topology Optimization with Strong Generalization Ability.” arXiv preprint arXiv:1901.07761.
   Google Scholar
• Zhao, Hengshuang, Jianping Shi, Xiaojuan Qi, Xiaogang Wang, and Jiaya Jia. 2017. “Pyramid Scene Parsing Network.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2881–2890. Piscataway, NJ: IEEE.
   Google Scholar
• Zheng, Shuai, Haojie Fan, Ziyu Zhang, Zhiqiang Tian, and Kang Jia. 2021. “Accurate and Real-Time Structural Topology Prediction Driven by Deep Learning Under Moving Morphable Component-Based Framework.” Applied Mathematical Modelling 97:522–535. https://doi.org/10.1016/j.apm.2021.04.009.
   Web of Science ®Google Scholar
• Zhou, M., and G. I. N. Rozvany. 1991. “The COC Algorithm, Part II: Topological, Geometrical and Generalized Shape Optimization.” Computer Methods in Applied Mechanics and Engineering 89 (1–3): 309–336. https://doi.org/10.1016/0045-7825(91)90046-9.
   Web of Science ®Google Scholar