Classification of the qilou (arcade building) using a robust image processing framework based on the Faster R-CNN with ResNet50

References

• Abed, M. H., M. Al-Asfoor, and Z. M. Hussain. 2020. “Architectural Heritage Images Classification Using Deep Learning with CNN.”
   Google Scholar
• Ali, R., and Y. Cha. 2022. “Attention-Based Generative Adversarial Network with Internal Damage Segmentation Using Thermography.” Automation in Construction 141:104412. https://doi.org/10.1016/j.autcon.2022.104412.
   Web of Science ®Google Scholar
• Ali, R., D. Kang, G. Suh, and Y. Cha. 2021. “Real-Time Multiple Damage Mapping Using Autonomous UAV and Deep Faster Region-Based Neural Networks for GPS-Denied Structures.” Automation in Construction 130:103831. https://doi.org/10.1016/j.autcon.2021.103831.
   Web of Science ®Google Scholar
• Anderson, C. 2013. Renaissance Architecture. England: OUP Oxford.
   Google Scholar
• Babinovich, N. U., and E. V. Sitnikova. 2021. “Features of Wooden Buildings in Tomsk.“ Journal of Physics: Conference Series 1926 (2021): 12042.
   Google Scholar
• Beckman, G. H., D. Polyzois, and Y. Cha. 2019. “Deep Learning-Based Automatic Volumetric Damage Quantification Using Depth Camera.” Automation in Construction 99:114–124. https://doi.org/10.1016/j.autcon.2018.12.006.
   Web of Science ®Google Scholar
• Castleman, K. R. 1996. Digital Image Processing. New York: Prentice Hall Press.
   Google Scholar
• Cha, Y. J., W. Choi, and O. Büyüköztürk. 2017. “Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks.” Computer‐Aided Civil and Infrastructure Engineering 32 (5): 361–378. https://doi.org/10.1111/mice.12263.
   Web of Science ®Google Scholar
• Cha, Y. J., W. Choi, G. Suh, S. Mahmoudkhani, and O. Büyüköztürk. 2018. “Autonomous Structural Visual Inspection Using Region‐Based Deep Learning for Detecting Multiple Damage Types.” Computer‐Aided Civil and Infrastructure Engineering 33 (9): 731–747. https://doi.org/10.1111/mice.12334.
   Web of Science ®Google Scholar
• Chen, J., J. P. Liu, L. J. Wang, Y. Y. Wang, and F. Wang. 2011. “Qilou Building Climate Adaptation in Tropical Climate Zone of China: A Study on Haikou Qilou Buildings.” Advanced Materials Research 243-249:6503–6513. https://doi.org/10.4028/www.scientific.net/AMR.243-249.6503.
   Google Scholar
• Chen, J., and F. Wang. 2013. “Haikou QiLou Historical and Artistic Value, Applied Mechanics and Materials.” Applied Mechanics & Materials 409-410:404–409. https://doi.org/10.4028/www.scientific.net/AMM.409-410.404.
   Google Scholar
• Chen, M., L. Yu, C. Zhi, R. Sun, S. Zhu, Z. Gao, Z. Ke, M. Zhu, and Y. Zhang. 2022. “Improved Faster R-CNN for Fabric Defect Detection Based on Gabor Filter with Genetic Algorithm Optimization.” Computers in Industry 134:103551. https://doi.org/10.1016/j.compind.2021.103551.
   Web of Science ®Google Scholar
• Choi, W., and Y. Cha. 2019. “SDDNet: Real-Time Crack Segmentation.” IEEE Transactions on Industrial Electronics 67 (9): 8016–8025. https://doi.org/10.1109/TIE.2019.2945265.
   Web of Science ®Google Scholar
• Condit, C. W. 1964. The Chicago School of Architecture: A History of Commercial and Public Building in the Chicago Area, 1875–1925. Chicago, IL, USA: University of Chicago Press.
   Google Scholar
• Ćosović, M., and R. Janković 2020. “CNN Classification of the Cultural Heritage Images.” 2020 19th International Symposium INFOTEH-JAHORINA (INFOTEH), East Sarajevo, Bosnia and Herzegovina, 1–6. IEEE.
   Google Scholar
• Fiorucci, M., M. Khoroshiltseva, M. Pontil, A. Traviglia, A. Del Bue, and S. James. 2020. “Machine Learning for Cultural Heritage: A Survey.” Pattern Recognition Letters 133:102–108. https://doi.org/10.1016/j.patrec.2020.02.017.
   Web of Science ®Google Scholar
• Girshick, R. 2015. “Fast r-cnn.” Proceedings of the IEEE international conference on computer vision, Santiago, Chile, 1440–1448.
   Google Scholar
• Han, D. 2013. “Comparison of Commonly Used Image Interpolation Methods.” Conference of the 2nd International Conference on Computer Science and Electronics Engineering (ICCSEE 2013), Hangzhou, P.R. China, 1556–1559. Atlantis Press.
   Google Scholar
• He, K., X. Zhang, S. Ren, and J. Sun 2016. “Deep Residual Learning for Image Recognition.” Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, USA, 770–778.
   Google Scholar
• Hitam, M. S., E. A. Awalludin, W. N. J. H. Yussof, and Z. Bachok 2013. “Mixture Contrast Limited Adaptive Histogram Equalization for Underwater Image Enhancement.” 2013 International conference on computer applications technology (ICCAT), Sousse, Tunisia, 1–5. IEEE.
   Google Scholar
• Huang, J., V. Rathod, C. Sun, M. Zhu, A. Korattikara, A. Fathi, I. Fischer, Z. Wojna, Y. Song, and S. Guadarrama 2017. “Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors.” Proceedings of the IEEE conference on computer vision and pattern recognition, Hawaii, USA, 7310–7311.
   Google Scholar
• Jiang, A., R. Noguchi, and T. Ahamed. 2022. “Tree Trunk Recognition in Orchard Autonomous Operations Under Different Light Conditions Using a Thermal Camera and Faster R-CNN.” Sensors-Basel 22:2065. https://doi.org/10.3390/s22052065.
   PubMed Web of Science ®Google Scholar
• Kang, D., S. S. Benipal, D. L. Gopal, and Y. Cha. 2020. “Hybrid Pixel-Level Concrete Crack Segmentation and Quantification Across Complex Backgrounds Using Deep Learning.” Automation in Construction 118:103291. https://doi.org/10.1016/j.autcon.2020.103291.
   Web of Science ®Google Scholar
• Kang, D. H., and Y. Cha. 2022. “Efficient Attention-Based Deep Encoder and Decoder for Automatic Crack Segmentation.” Structural Health Monitoring 21 (5): 2190–2205. https://doi.org/10.1177/14759217211053776.
   PubMed Web of Science ®Google Scholar
• Kang, D., and Y. J. Cha. 2018. “Autonomous UAVs for Structural Health Monitoring Using Deep Learning and an Ultrasonic Beacon System with Geo‐Tagging.” Computer‐Aided Civil and Infrastructure Engineering 33 (10): 885–902. https://doi.org/10.1111/mice.12375.
   Web of Science ®Google Scholar
• Keys, R. 1981. “Cubic Convolution Interpolation for Digital Image Processing.” IEEE Transactions on Acoustics, Speech, and Signal Processing 29 (6): 1153–1160. https://doi.org/10.1109/TASSP.1981.1163711.
   Google Scholar
• Lerma, J. L., S. Navarro, M. Cabrelles, and V. Villaverde. 2010. “Terrestrial Laser Scanning and Close Range Photogrammetry for 3D Archaeological Documentation: The Upper Palaeolithic Cave of Parpalló as a Case Study.” Journal of Archaeological Science 37 (3): 499–507. https://doi.org/10.1016/j.jas.2009.10.011.
   Web of Science ®Google Scholar
• Li, Q. 2018. “Preserving Historic Qilou Districts in Southern China: Consideration of Western Models.“ Historic Preservation Theses. https://docs.rwu.edu/hp_theses/15.
   Google Scholar
• Li, Y. 2013. A Typo-Morphological Enquiry into the Evolution of Residential Architecture and Urban Tissues of the Guangfunan Area of Guangzhou, China. Concordia University. https://spectrum.library.concordia.ca/977412/1/Li_MSc_F2013.pdf.
   Google Scholar
• Liang, H., W. Li, S. Lai, L. Zhu, W. Jiang, and Q. Zhang. 2018. “The Integration of Terrestrial Laser Scanning and Terrestrial and Unmanned Aerial Vehicle Digital Photogrammetry for the Documentation of Chinese Classical Gardens–A Case Study of Huanxiu Shanzhuang, Suzhou, China.” Journal of Cultural Heritage 33:222–230. https://doi.org/10.1016/j.culher.2018.03.004.
   Web of Science ®Google Scholar
• Lin, C. 2002. “Research on the Development and Form of Qilou-Style Street Houses.” South China University of Technology.
   Google Scholar
• Lin, L. 2006. Hong Kong, Macau and Pearl River Delta Regional Architecture: Guangdong Qilou. Beijing, China: Science Press.
   Google Scholar
• Liu, W., D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C. Fu, and A. C. Berg 2016. “Ssd: Single Shot Multibox Detector.” Computer Vision–ECCV 2016: 14th European Conference, 21–37. Amsterdam, The Netherlands, Springer. October 11–14, 2016, Proceedings, Part I 14.
   Google Scholar
• Liu, B., W. Zhao, and Q. Sun. 2017. “Study of Object Detection Based on Faster R-CNN.“ 2017 Chinese Automation Congress (CAC), Shandong, China. 6233–6236.
   Google Scholar
• Li, S., and H. Ying. 2021. “Study on the Traditional Architectural Forms of Huangcuo Village in Fujian Province from the Perspective of Regional Culture.“ 3rd International Conference on Architecture: Heritage, Traditions and Innovations (AHTI 2021), Moscow, Russia. Vol. 600. 99–110. Atlantis Press.
   Google Scholar
• Llamas, J. M., P. Lerones, R. Medina, E. Zalama, and J. Gómez-García-Bermejo. 2017. “Classification of Architectural Heritage Images Using Deep Learning Techniques.” Applied Sciences 7:992. https://doi.org/10.3390/app7100992.
   Google Scholar
• Llamas, J., P. M. Lerones, E. Zalama, and J. Gómez-García-Bermejo 2016. “Applying Deep Learning Techniques to Cultural Heritage Images within the INCEPTION Project, Digital Heritage.” Progress in Cultural Heritage: Documentation, Preservation, and Protection: 6th International Conference, EuroMed 2016, 25–32. Nicosia, Cyprus, Springer. October 31–November 5, 2016, Proceedings, Part II 6.
   Google Scholar
• Martin, J. R. 2018. Baroque. Routledge.
   Google Scholar
• Maskeliūnas, R., A. Katkevičius, D. Plonis, T. Sledevič, A. Meškėnas, and R. Damaševičius. 2022. “Building Façade Style Classification from UAV Imagery Using a Pareto-Optimized Deep Learning Network.” Electronics 11 (21): 3450. https://doi.org/10.3390/electronics11213450.
   Web of Science ®Google Scholar
• Obeso, A. M., M. S. G. Vázquez, A. A. R. Acosta, and J. Benois-Pineau 2017. “Connoisseur: Classification of Styles of Mexican Architectural Heritage with Deep Learning and Visual Attention Prediction.” Proceedings of the 15th international workshop on content-based multimedia indexing, Florence, Italy, 1–7.
   Google Scholar
• Paszke, A., S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, and L. Antiga. 2019. “Pytorch: An Imperative Style, High-Performance Deep Learning Library.” Advances in Neural Information Processing Systems, Vancouver. 32.
   Google Scholar
• Pintus, R., K. Pal, Y. Yang, T. Weyrich, E. Gobbetti, and H. Rushmeier. 2016. A Survey of Geometric Analysis in Cultural Heritage, 4–31. England: Computer Graphics Forum, Wiley Online Library.
   Google Scholar
• Redmon, J., S. Divvala, R. Girshick, and A. Farhadi 2016. “You Only Look Once: Unified, Real-Time Object Detection.” Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, USA, 779–788.
   Google Scholar
• Ren, S., K. He, R. Girshick, and J. Sun. 2015. “Faster R-Cnn: Towards Real-Time Object Detection with Region Proposal Networks.” Advances in Neural Information Processing Systems, Montreal, Canada 28.
   Google Scholar
• Simonyan, K., and A. Zisserman. 2014. “Very Deep Convolutional Networks for Large-Scale Image Recognition.” Arxiv Preprint Arxiv:1409.1556.
   Google Scholar
• Skalski, P. 2019. “Make Sense.”
   Google Scholar
• Smith, T. R. 1890. “Architecture, Gothic and Renaissance, Low.”
   Google Scholar
• Theckedath, D., and R. R. Sedamkar. 2020. “Detecting Affect States Using VGG16, ResNet50 and SE-ResNet50 Networks.” SN Computer Science 1 (2). https://doi.org/10.1007/s42979-020-0114-9.
   Google Scholar
• Tian, Z., C. Shen, H. Chen, and T. He 2019. “Fcos: Fully Convolutional One-Stage Object Detection.” Proceedings of the IEEE/CVF international conference on computer vision, California, USA, 9627–9636.
   Google Scholar
• Wang, B., S. Zhang, J. Zhang, and Z. Cai. 2022. “Architectural Style Classification Based on CNN and Channel–Spatial Attention.” Signal, Image and Video Processing 17 (1): 1–9. https://doi.org/10.1007/s11760-022-02208-0.
   Web of Science ®Google Scholar
• Waqas, A., D. Kang, and Y. Cha. 2023. “Deep Learning–Based Obstacle-Avoiding Autonomous UAVs with Fiducial Marker–Based Localization for Structural Health Monitoring.” Structural Health Monitoring. https://doi.org/10.1177/14759217231177314.
   PubMedGoogle Scholar
• Wen, L., X. Li, and L. Gao. 2019. “A Transfer Convolutional Neural Network for Fault Diagnosis Based on ResNet-50.” Neural Computing & Applications 32 (10): 6111–6124. https://doi.org/10.1007/s00521-019-04097-w.
   Web of Science ®Google Scholar
• Xia, B., X. Li, H. Shi, S. Chen, and J. Chen. 2020. “Style Classification and Prediction of Residential Buildings Based on Machine Learning.” Journal of Asian Architecture & Building Engineering 19 (6): 714–730. https://doi.org/10.1080/13467581.2020.1779728.
   Web of Science ®Google Scholar
• Xu, Z., D. Tao, Y. Zhang, J. Wu, and A. C. Tsoi 2014. Architectural Style Classification Using Multinomial Latent Logistic Regression, Computer Vision–ECCV 2014: 13th European Conference, 600–615. Zurich, Switzerland, Springer. September 6-12, 2014, Proceedings, Part I 13.
   Google Scholar
• Yang, H., W. Hu, and G. Pan. 2012. Sai Kuan Mansion and Qilou. Guangzhou, China: Jinan University Press.
   Google Scholar
• Yang, Y., Y. Jiang, Q. Zhang, F. Zou, and L. Du. 2022. “A Mixed Faster R-CNN and Positioning Coordinates Method for Recognition of Suit Button Arrangement with Small Sample Sizes.” International Journal of Clothing Science and Technology 34 (4): 532–548. https://doi.org/10.1108/IJCST-10-2020-0165.
   Web of Science ®Google Scholar
• Ye, Y. 2022. Arcade Detection and Mapping Based on a Deep Learning Model Constructed Using Street View Images and Object Semantic Relations. National Taiwan University. https://doi.org/10.6342/NTU202202527.
   Google Scholar
• Yilmaz, H. M., M. Yakar, S. A. Gulec, and O. N. Dulgerler. 2007. “Importance of Digital Close-Range Photogrammetry in Documentation of Cultural Heritage.” Journal of Cultural Heritage 8 (4): 428–433. https://doi.org/10.1016/j.culher.2007.07.004.
   Web of Science ®Google Scholar
• Yi, Y. K., Y. Zhang, and J. Myung. 2020. “House Style Recognition Using Deep Convolutional Neural Network.” Automation in Construction 118:103307. https://doi.org/10.1016/j.autcon.2020.103307.
   Web of Science ®Google Scholar
• Yoshimura, Y., B. Cai, Z. Wang, and C. Ratti. 2019. “Deep Learning Architect: Classification for Architectural Design Through the Eye of Artificial Intelligence.” International Conference on Computers in Urban Planning and Urban Management, Wuhan, China. Vol. 16. 249–265.
   Google Scholar
• Zhang, J. 2015. “Rise and Fall of the“Qilou”: Metamorphosis of Forms and Meanings in the Built Environment of Guangzhou.” Traditional Dwellings and Settlements Review 26(2): 25–40.
   Google Scholar
• Zhao, J. 2020. “Influencing Factors of Urban Architectural Style in China: A Case Study of Danzhou City.” IOP Conference Series: Earth and Environmental Science China, 62003. IOP Publishing. https://iopscience.iop.org/article/10.1088/1755-1315/510/6/062003/pdf.
   Google Scholar
• Zhao, P., Q. Miao, J. Song, Y. Qi, R. Liu, and D. Ge. 2018. “Architectural Style Classification Based on Feature Extraction Module.” IEEE Access 6:52598–52606. https://doi.org/10.1109/ACCESS.2018.2869976.
   Web of Science ®Google Scholar