Efficient building damage assessment from post-disaster aerial video using lightweight deep learning models

References

• Bahri, A., S. G. Majelan, S. Mohammadi, and M. Noori. 2019. “Remote Sensing Image Classification via Improved Cross-Entropy Loss and Transfer Learning Strategy Based on Deep Convolutional Neural Networks.” IEEE Geoscience & Remote Sensing Letters 17 (6): 1087–1091.
   Web of Science ®Google Scholar
• Chen, F. C., and M. R. Jahanshahi. 2017. “NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion.” IEEE Transactions on Industrial Electronics 65 (5): 4392–4400.
   Web of Science ®Google Scholar
• Chollet, F. 2017. “Xception: Deep Learning with Depthwise Separable Convolutions.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Hawaii, USA, 1251–1258.
   Google Scholar
• Cusicanqui, J., N. Kerle, and F. Nex. 2018. “Usability of aerial video footage for 3-D scene reconstruction and structural damage assessment.” Natural Hazards and Earth System Sciences 18 (6): 1583–1598.
   Web of Science ®Google Scholar
• Ding, Y., H. Li, and Z. Li 2017. “Human Motion Recognition Based on Packet Convolution Neural Network.” In 2017 12th International Conference on Intelligent Systems and Knowledge Engineering (ISKE), Nanjing, China, 1–5.
   Google Scholar
• Dong, X., S. Yan, and C. Duan. 2022. “A Lightweight Vehicles Detection Network Model Based on YOLOv5.” Engineering Applications of Artificial Intelligence 113:104914.
   Web of Science ®Google Scholar
• Duarte, D., F. Nex, N. Kerle, and G. Vosselman. 2017. “Towards a more efficient detection of earthquake induced facade damages using oblique UAV imagery.” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 42:93–100.
   Google Scholar
• Endo, Y., B. Adriano, E. Mas, and S. Koshimura. 2018. “New Insights into Multiclass Damage Classification of Tsunami-Induced Building Damage from SAR Images.” Remote Sensing 10 (12): 2059.
   Web of Science ®Google Scholar
• FEMA (Federal Emergency Management Agency), Multi-hazard loss estimation methodology Hurricane model HAZUS-MH MR3, 2013.
   Google Scholar
• Gonzalez, D., D. Rueda-Plata, A. B. Acevedo, J. C. Duque, R. Ramos-Pollan, A. Betancourt, and S. Garcia. 2020. “Automatic Detection of Building Typology Using Deep Learning Methods on Street Level Images.” Building & Environment 177:106805.
   Web of Science ®Google Scholar
• Grünthal, G. 1998. European Macroseismic Scale 1998 (EMS-98).
   Google Scholar
• Gupta, R., R. Hosfelt, S. Sajeev, N. Patel, B. Goodman, J. Doshi, and M. Gaston. 2019. “xbd: A dataset for assessing building damage from satellite imagery.” arXiv preprint arXiv:1911.09296.
   Google Scholar
• Han, K., Y. Wang, Q. Tian, J. Guo, C. Xu, and C. Xu 2020. “Ghostnet: More Features from Cheap Operations.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Seattle, USA, 1580–1589.
   Google Scholar
• Hao, H., and Y. Wang. 2020. “Leveraging multimodal social media data for rapid disaster damage assessment.” International Journal of Disaster Risk Reduction 51:101760.
   Web of Science ®Google Scholar
• Harris, M., and A. Raviv. 1988. “Corporate Governance: Voting Rights and Majority Rules.” Journal of Financial Economics 20:203–235. https://doi.org/10.1016/0304-405X(88)90045-1.
   Web of Science ®Google Scholar
• He, K., G. Gkioxari, P. Dollár, and R. Girshick. 2017. “Mask r-cnn.” In Proceedings of the IEEE international conference on computer vision, Venice, Italy, 2961–2969.
   Google Scholar
• He, Z., X. Zhang, Y. Cao, Z. Liu, B. Zhang, and X. Wang. 2018. “LiteNet: Lightweight Neural Network for Detecting Arrhythmias at Resource-Constrained Mobile Devices.” Sensors 18 (4): 1229.
   PubMed Web of Science ®Google Scholar
• Ji, M., L. Liu, R. Du, and M. F. Buchroithner. 2019. “A Comparative Study of Texture and Convolutional Neural Network Features for Detecting Collapsed Buildings After Earthquakes Using Pre-And Post-Event Satellite Imagery.” Remote Sensing 11 (10): 1202.
   Web of Science ®Google Scholar
• Kalantar, B., N. Ueda, H. A. Al-Najjar, and A. A. Halin. 2020. “Assessment of Convolutional Neural Network Architectures for Earthquake-Induced Building Damage Detection Based on Pre-And Post-Event Orthophoto Images.” Remote Sensing 12 (21): 3529.
   Web of Science ®Google Scholar
• Kerle, N., F. Nex, M. Gerke, D. Duarte, and A. Vetrivel. 2019. “UAV-Based Structural Damage Mapping: A Review.” ISPRS International Journal of Geo-Information 9 (1): 14.
   Web of Science ®Google Scholar
• Khodaverdizahraee, N., H. Rastiveis, and A. Jouybari. 2020. “Segment-by-segment comparison technique for earthquake-induced building damage map generation using satellite imagery.” International Journal of Disaster Risk Reduction 46:101505.
   Web of Science ®Google Scholar
• Kim, S. H., J. W. Kim, V. S. Doan, and D. S. Kim. 2020. “Lightweight Deep Learning Model for Automatic Modulation Classification in Cognitive Radio Networks.” Institute of Electrical and Electronics Engineers Access 8:197532–197541.
   Google Scholar
• Li, Z., C. Peng, G. Yu, X. Zhang, Y. Deng, and J. Sun. 2017. “Light-head r-cnn: In defense of two-stage object detector.” arXiv preprint arXiv:1711.07264.
   Google Scholar
• Liu, C., H. Sui, and L. Huang. 2020. “Identification of Damaged Building Regions from High-Resolution Images Using Superpixel-Based Gradient and Autocorrelation Analysis.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 14:1010–1024.
   Web of Science ®Google Scholar
• Li, P., H. Xu, and J. Guo. 2010. “Urban Building Damage Detection from Very High Resolution Imagery Using OCSVM and Spatial Features.” International Journal of Remote Sensing 31 (13): 3393–3409. https://doi.org/10.1080/01431161003727705.
   Web of Science ®Google Scholar
• Ma, N., X. Zhang, H. T. Zheng, and J. Sun. 2018. “Shufflenet v2: Practical guidelines for efficient cnn architecture design.” In Proceedings of the European conference on computer vision (ECCV), Munich, Germany, 116–131.
   Google Scholar
• Nex, F., D. Duarte, A. Steenbeek, and N. Kerle. 2019. “Towards Real-Time Building Damage Mapping with Low-Cost UAV Solutions.” Remote Sensing 11 (3): 287.
   Web of Science ®Google Scholar
• Panda, K. G., S. Das, D. Sen, and W. Arif. 2019. “Design and Deployment of UAV-Aided Post-Disaster Emergency Network.” Institute of Electrical and Electronics Engineers Access 7:102985–102999.
   Google Scholar
• Rana, R., C. Lahaye, and R. K. Ray. 2014. “Overview of Lightweight Ferrous Materials: Strategies and Promises.” Jom 66 (9): 1734–1746. https://doi.org/10.1007/s11837-014-1126-5.
   Web of Science ®Google Scholar
• Rezaie, A., R. Achanta, M. Godio, and K. Beyer. 2020. “Comparison of Crack Segmentation Using Digital Image Correlation Measurements and Deep Learning.” Construction and Building Materials 261:120474.
   Web of Science ®Google Scholar
• Rosti, A., M. Rota, and A. Penna. 2018. “Damage Classification and Derivation of Damage Probability Matrices from L’Aquila (2009) Post-Earthquake Survey Data.” Bulletin of Earthquake Engineering 16:3687–3720.
   Web of Science ®Google Scholar
• Shan, S., F. Zhao, Y. Wei, and M. Liu. 2019. “Disaster management 2.0: A real-time disaster damage assessment model based on mobile social media data—A case study of Weibo (Chinese Twitter).” Safety Science 115:393–413.
   Web of Science ®Google Scholar
• Song, D., X. Tan, B. Wang, L. Zhang, X. Shan, and J. Cui. 2020. “Integration of Super-Pixel Segmentation and Deep-Learning Methods for Evaluating Earthquake-Damaged Buildings Using Single-Phase Remote Sensing Imagery.” International Journal of Remote Sensing 41 (3): 1040–1066.
   Web of Science ®Google Scholar
• Vetrivel, A., M. Gerke, N. Kerle, F. Nex, and G. Vosselman. 2018. “Disaster Damage Detection Through Synergistic Use of Deep Learning and 3D Point Cloud Features Derived from Very High Resolution Oblique Aerial Images, and Multiple-Kernel-Learning.” Isprs Journal of Photogrammetry & Remote Sensing 140:45–59.
   Web of Science ®Google Scholar
• Vetrivel, A., M. Gerke, N. Kerle, and G. Vosselman. 2015. “Identification of damage in buildings based on gaps in 3D point clouds from very high resolution oblique airborne images.” Isprs Journal of Photogrammetry & Remote Sensing 105:61–78.
   Web of Science ®Google Scholar
• Wagenaar, D., J. De Jong, and L. M. Bouwer. 2017. “Multi-Variable Flood Damage Modelling with Limited Data Using Supervised Learning Approaches.” Natural Hazards and Earth System Sciences 17 (9): 1683–1696.
   Web of Science ®Google Scholar
• Wang, J., Y. Chen, S. Hao, X. Peng, and L. Hu. 2019. “Deep Learning for Sensor-Based Activity Recognition: A Survey.” Pattern Recognition Letters 119:3–11.
   Web of Science ®Google Scholar
• Wang, X., and P. Li. 2020. “Extraction of Urban Building Damage Using Spectral, Height and Corner Information from VHR Satellite Images and Airborne LiDar Data.” Isprs Journal of Photogrammetry & Remote Sensing 159:322–336.
   Web of Science ®Google Scholar
• Wei, Q., S. Lao, and L. Bai 2017. “Panorama Stitching, Moving Object Detection and Tracking in UAV Videos.” In 2017 International Conference on Vision, Image and Signal Processing (ICVISP), Osaka, Japan, 46–50.
   Google Scholar
• Wei, T., J. Wang, W. Liu, H. Chen, and H. Shi. 2019. “Marginal center loss for deep remote sensing image scene classification.” IEEE Geoscience & Remote Sensing Letters 17 (6): 968–972.
   Web of Science ®Google Scholar
• Xiong, C., Q. Li, and X. Lu. 2020. “Automated Regional Seismic Damage Assessment of Buildings Using an Unmanned Aerial Vehicle and a Convolutional Neural Network.” Automation in Construction 109:102994.
   Web of Science ®Google Scholar
• Yang, X., Y. Luo, M. Li, Z. Yang, C. Sun, and W. Li. 2021. “Recognizing Pests in Field-Based Images by Combining Spatial and Channel Attention Mechanism.” Institute of Electrical and Electronics Engineers Access 9:162448–162458.
   Google Scholar
• Yu, C., B. Hu, X. Cheng, G. Yin, and Z. Wang. 2023. “Remote Sensing Building Damage Assessment with a Multihead Neighbourhood Attention Transformer.” International Journal of Remote Sensing 44 (16): 5069–5100.
   Web of Science ®Google Scholar
• Zhao, K., J. Kang, J. Jung, and G. Sohn 2018. “Building Extraction from Satellite Images Using Mask R-CNN with Building Boundary Regularization.” In Proceedings of the IEEE conference on computer vision and pattern recognition workshops, Salt Lake City, USA, 247–251.
   Google Scholar
• Zhu, Q., Z. He, T. Zhang, and W. Cui. 2020. “Improving Classification Performance of Softmax Loss Function Based on Scalable Batch-Normalization.” Applied Sciences 10 (8): 2950.
   Google Scholar
• Zhu, X., J. Liang, and A. Hauptmann 2021. “Msnet: A Multilevel Instance Segmentation Network for Natural Disaster Damage Assessment in Aerial Videos.” In Proceedings of the IEEE/CVF winter conference on applications of computer vision, (online meeting), 2023–2032.
   Google Scholar