A point cloud segmentation method for power lines and towers based on a combination of multiscale density features and point-based deep learning

References

• Chen, Zhe, Ruichun Chang, and Wenbo Zhao. 2022. “Quantitative Prediction and Evaluation of Geothermal Resource Areas in the Southwest Section of the Mid-Spine Belt of Beautiful China.” International Journal of Digital Earth 15: 748–769. doi:10.1080/17538947.2022.2061055.
   Web of Science ®Google Scholar
• Chen, Chi, Xiaoming Mai, Shuang Song, Xiangyang Peng, Wenxue Xu, and Ke Wang. 2015. “Automatic Power Lines Extraction Method from Airborne LiDAR Point Cloud.” Wuhan Daxue Xuebao (Xinxi Kexue Ban)/Geomatics and Information Science of Wuhan University 40 (12): 1600–1605. doi:10.13203/j.whugis20130573.
   Google Scholar
• Choy, Christopher, Junyoung Gwak, and Silvio Savarese. 2019. “4D Spatio-Temporal Convnets: Minkowski Convolutional Neural Networks.” In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. doi:10.1109/CVPR.2019.00319.
   Google Scholar
• Coomans, D., and D. L. Massart. 1982. “Alternative K-Nearest Neighbour Rules in Supervised Pattern Recognition.” Analytica Chimica Acta 138: 153–165. doi:10.1016/s0003-2670(01)95359-0.
   Web of Science ®Google Scholar
• Deng, S., P. Li, J. Zhang, and J. Yang. 2012. “Power Line Detection from Synthetic Aperture Radar Imagery Using Coherence of Co-Polarisation and Cross-Polarisation Estimated in the Hough Domain.” IET Radar, Sonar and Navigation 6 (9): 873–880. doi:10.1049/iet-rsn.2011.0332.
   Web of Science ®Google Scholar
• Graham, Benjamin, Martin Engelcke, and Laurens Van Der Maaten. 2018. “3D Semantic Segmentation with Submanifold Sparse Convolutional Networks.” In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. doi:10.1109/CVPR.2018.00961.
   Google Scholar
• Guan, Haiyan, Yongtao Yu, Jonathan Li, Zheng Ji, and Qi Zhang. 2016. “Extraction of Power-Transmission Lines from Vehicle-Borne Lidar Data.” International Journal of Remote Sensing 37 (1): 229–247. doi:10.1080/01431161.2015.1125549.
   Web of Science ®Google Scholar
• Heideman, Hans Karl. 2014. “LIDAR Base Specification (Ver. 1.2).” U.S. Geological Survey Techniques and Methods 11-B4.
   Google Scholar
• Jadin, Mohd Shawal, Kamarul Hawari Ghazali, and Soib Taib. 2013. “Thermal Condition Monitoring of Electrical Installations Based on Infrared Image Analysis.” In 2013 Saudi International Electronics, Communications and Photonics Conference, SIECPC. 2013:1–6. doi:10.1109/SIECPC.2013.6550790.
   Google Scholar
• Jóźków, G., B. Vander Jagt, and C. Toth. 2015. “Experiments with UAS Imagery for Automatic Modeling of Power Line 3D Geometry.” In International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives, 403–409. doi:10.5194/isprsarchives-XL-1-W4-403-2015.
   Google Scholar
• Kanungo, Tapas, D. M. Mount, N. S. Netanyahu, C. D. Piatko, Ruth Silverman, and A. Y. Wu. 2002. “An Efficient K-Means Clustering Algorithm: Analysis and Implementation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 24 (7): 881–892. doi:10.1109/TPAMI.2002.1017616.
   Web of Science ®Google Scholar
• Kobayashi, Yoshihiro, George G. Karady, Gerald Thomas Heydt, and Robert G. Olsen. 2009. “The Utilisation of Satellite Images to Identify Trees Endangering Transmission Lines.” IEEE Transactions on Power Delivery 24 (3): 1703–1709. doi:10.1109/TPWRD.2009.2022664.
   Web of Science ®Google Scholar
• Lai, Xudong, Dachang Dai, Min Zheng, and Yong Du. 2014. “Powerline Three-Dimensional Reconstruction for LiDAR Point Cloud Data.” Yaogan Xuebao/Journal of Remote Sensing 18 (6): 1223–1229. doi:10.11834/jrs.20144075.
   Google Scholar
• Lai, Xin, Jianhui Liu, Li Jiang, Liwei Wang, Hengshuang Zhao, Shu Liu, Xiaojuan Qi, and Jiaya Jia. 2022. “Stratified Transformer for 3D Point Cloud Segmentation” 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). doi:10.1109/CVPR52688.2022.00831.
   Google Scholar
• Lai, Guangling, Zhiyuan Qin, and Ding Lu. 2016. “Extraction of Power Lines and Poles Based on Mobile LiDAR Data.” Journal of Geomatics Science and Technology 33 (06): 617–622. doi:10.3969/j.issn.1673-6338.2016.06.013.
   Google Scholar
• Lecun, Yann, Yoshua Bengio, and Geoffrey Hinton. 2015. “Deep Learning.” Nature 521 (7553): 436. doi:10.1038/nature14539.
   PubMed Web of Science ®Google Scholar
• Li, Yangyan, Rui Bu, Mingchao Sun, Wei Wu, Xinhan Di, and Baoquan Chen. 2018. “PointCNN: Convolution on X-Transformed Point clouds.” In Advances in Neural Information Processing Systems.
   Google Scholar
• Li, Guohao, Matthias Muller, Ali Thabet, and Bernard Ghanem. 2019. “DeepGCNs: Can GCNs Go as Deep as CNNs?” In Proceedings of the IEEE International Conference on Computer Vision. doi:10.1109/ICCV.2019.00936.
   Google Scholar
• Liang, Anqi, Hongchao Ma, and Zhan Cai. 2019. “An Airborne LiDAR Data Power Pine Extraction Method Based on SVM.” Laser Journal 40 (02): 29–34. doi:CNKI:SUN:JGZZ.0.2019-02-007.
   Google Scholar
• Lin, Xiangguo, Minyan Duan, Jixian Zhang, and Yi Zang. 2016. “A Method of Reconstructing 3D Powerlines from Airborne LiDAR Point Clouds.” Science of Surveying and Mapping 41 (01): 109–114+64. doi:10.16251/j.cnki.1009-2307.2016.01.021.
   Google Scholar
• Liu, Yuee, Zhengrong Li, Ross Hayward, Rodney Walker, and Hang Jin. 2009. “Classification of Airborne LIDAR Intensity Data Using Statistical Analysis and Hough Transform with Application to Power Line Corridors.” In DICTA 2009 - Digital Image Computing: Techniques and Applications, 462–467. doi:10.1109/DICTA.2009.83.
   Google Scholar
• Liu, Xiaolei, Shunyi Zheng, and Lei Xu. 2017. “Power Line Automatic Extraction Algorithm Based on LiDAR Data.” Journal of Geomatics 42 (4): 13–16. doi:10.14188/j.2095-6045.2015219.
   Google Scholar
• Lou, Wenjuan, Dengguo Wu, Jie Su, Shanqiang Gu, and Wendong Jiang. 2019. “Discussion on Wind-Induced Swing Flashover and Conductor Wind Load of EHV Transmission Lines.” Gaodianya Jishu/High Voltage Engineering 45 (4): 1249–1255. doi:10.13336/j.1003-6520.hve.20190329022.
   Google Scholar
• Matikainen, Leena, Matti Lehtomäki, Eero Ahokas, Juha Hyyppä, Mika Karjalainen, Anttoni Jaakkola, Antero Kukko, and Tero Heinonen. 2016. “Remote Sensing Methods for Power Line Corridor Surveys.” ISPRS Journal of Photogrammetry and Remote Sensing 119: 10–31. doi:10.1016/j.isprsjprs.2016.04.011.
   Web of Science ®Google Scholar
• Maturana, Daniel, and Sebastian Scherer. 2015. “VoxNet: A 3D Convolutional Neural Network for Real-Time Object Recognition.” In IEEE International Conference on Intelligent Robots and Systems. doi:10.1109/IROS.2015.7353481.
   Google Scholar
• Mills, Steven J., Marcos P. Gerardo Castro, Zhengrong Li, Jinhai Cai, Ross Hayward, Luis Mejias, and Rodney A. Walker. 2010. “Evaluation of Aerial Remote Sensing Techniques for Vegetation Management in Power-Line Corridors.” IEEE Transactions on Geoscience and Remote Sensing 48 (9): 3379–3390. doi:10.1109/TGRS.2010.2046905.
   Web of Science ®Google Scholar
• Qi, Charles R., Hao Su, Kaichun Mo, and Leonidas J. Guibas. 2017. “PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation.” In Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017. doi:10.1109/CVPR.2017.16.
   Google Scholar
• Qi, Charles R., Li Yi, Hao Su, and Leonidas J. Guibas. 2017. “PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space.” In Advances in Neural Information Processing Systems.
   Google Scholar
• Song, Shuran, Fisher Yu, Andy Zeng, Angel X. Chang, Manolis Savva, and Thomas Funkhouser. 2017. “Semantic Scene Completion from a Single Depth Image.” In Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017. doi:10.1109/CVPR.2017.28.
   Google Scholar
• Tan, Junxiang, Haojie Zhao, Ronghao Yang, Hua Liu, Shaoda Li, and Jianfei Liu. 2021. “An Entropy-Weighting Method for Efficient Power-Line Feature Evaluation and Extraction from LiDAR Point Clouds.” Remote Sensing 13 (17): 3446. doi:10.3390/rs13173446.
   Web of Science ®Google Scholar
• Tang, Liyao, Yibing Zhan, Zhe Chen, Baosheng Yu, and Dacheng Tao. 2022. “Contrastive Boundary Learning for Point Cloud Segmentation” 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). doi:10.1109/CVPR52688.2022.00830.
   Google Scholar
• Tatebe, Yoshiki, Daisuke Deguchi, Yasutomo Kawanishi, Ichiro Ide, Hiroshi Murase, and Utsushi Sakai. 2017. “Can We Detect Pedestrians Using Low-Resolution LIDAR? Integration of Multi-Frame Point-Clouds.” In VISIGRAPP 2017 - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications. doi:10.5220/0006100901570164.
   Google Scholar
• Tatebe, Yoshiki, Daisuke Deguchi, Yasutomo Kawanishi, Ichiro Ide, Hiroshi Murase, and Utsushi Sakai. 2018. “Pedestrian Detection from Sparse Point-Cloud Using 3DCNN.” In 2018 International Workshop on Advanced Image Technology, IWAIT 2018. 1–4. doi:10.1109/IWAIT.2018.8369680.
   Google Scholar
• Thomas, Hugues, Charles R. Qi, Jean Emmanuel Deschaud, Beatriz Marcotegui, Francois Goulette, and Leonidas Guibas. 2019. “KPConv: Flexible and Deformable Convolution for Point Clouds.” In Proceedings of the IEEE International Conference on Computer Vision. doi:10.1109/ICCV.2019.00651.
   Google Scholar
• Wang, Yue, Yongbin Sun, Ziwei Liu, Sanjay E. Sarma, Michael M. Bronstein, and Justin M. Solomon. 2019. “Dynamic Graph Cnn for Learning on Point Clouds.” ACM Transactions on Graphics 38 (5): 1–12. doi:10.1145/3326362.
   Web of Science ®Google Scholar
• Wang, Shenlong, Simon Suo, Wei-Chiu Ma, Andrei Pokrovsky, and Raquel Urtasun. 2018. “Deep Parametric Continuous Convolutional Neural Networks.” In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2589–2597. IEEE. doi:10.1109/CVPR.2018.00274.
   Google Scholar
• Wang, Jingru, Cheng Wang, Xiaohuan Xi, Meng Du, Pu Wang, and Sheng Nie. 2022. “Segmentation of the Communication Tower and Its Accessory Equipment Based on Geometrical Shape Context from 3D Point Cloud.” International Journal of Digital Earth 15 (1): 1547–1566. doi:10.1080/17538947.2022.2117428.
   Web of Science ®Google Scholar
• Wang, Pinghua, Xiaohuan Xi, Cheng Wang, and Shaobo Xia. 2017. “Study on Power Line Fast Extraction Based on Airborne LiDAR Data.” Science of Surveying and Mapping 42 (02): 154–158+171. doi:10.16251/j.cnki.1009-2307.2017.02.029.
   Google Scholar
• Xu, Kan, Xiaozhi Zhang, Zhiguo Chen, Wenhao Wu, and Tao Li. 2016. “Risk Assessment for Wildfire Occurrence in High-Voltage Power Line Corridors by Using Remote-Sensing Techniques: A Case Study in Hubei Province, China.” International Journal of Remote Sensing 37 (20): 4818–4837. doi:10.1080/01431161.2016.1220032.
   Web of Science ®Google Scholar
• Yan, Yueguan, Haixu Yan, Junting Guo, and Huayang Dai. 2020. “Classification and Segmentation of Mining Area Objects in Large-Scale Spares Lidar Point Cloud Using a Novel Rotated Density Network.” ISPRS International Journal of Geo-Information, doi:10.3390/ijgi9030182.
   Web of Science ®Google Scholar
• Yang, Bisheng, and Zhen Dong. 2013. “A Shape-Based Segmentation Method for Mobile Laser Scanning Point Clouds.” ISPRS Journal of Photogrammetry and Remote Sensing 81: 19–30. doi:10.1016/j.isprsjprs.2013.04.002.
   Web of Science ®Google Scholar
• Yang, Bisheng, Fuxun Liang, and Ronggang Huang. 2017. “Progress, Challenges and Perspectives of 3D LiDAR Point Cloud Processing.” Cehui Xuebao/Acta Geodaetica et Cartographica Sinica 46 (10): 1509–1516. doi:10.11947/j.AGCS.2017.20170351.
   Google Scholar
• Yang, Wen, Ge Xu, Jiayu Chen, and Hong Sun. 2006. “Power Transmission Towers Extraction in Polarimetric SAR Imagery Based on Genetic Algorithm.” In Lecture Notes in Control and Information Sciences 345: 410–420. doi:10.1007/11816515_42.
   Google Scholar
• Ye, Lan, Qian Liu, and Qingwu Hu. 2010. “Research of Power Line Fitting and Extraction Techniques Based on LIDAR Point Cloud Data.” Mapping and Spatial Geographic Information 33 (05): 30–34. doi:10.3969/j.issn.1672-5867.2010.05.011.
   Google Scholar
• Yu, Jie, Chao Mu, Yanming Feng, and Yanjuan Dou. 2011. “Powerlines Extraction Techniques from Airborne LiDAR Data.” Wuhan Daxue Xuebao (Xinxi Kexue Ban)/Geomatics and Information Science of Wuhan University 36 (11): 1275–1279. doi:CNKI:SUN:WHCH.0.2011-11-006.
   Google Scholar
• Zhang, Ruizhuo, Yang Bisheng, Xiao Wen, Liang Fuxun, Liu Yang, and Wang Ziming. 2019. “Automatic Extraction of High-Voltage Power Transmission Objects from UAV Lidar Point Clouds.” Remote Sensing 11 (22): 2600. doi:10.3390/rs11222600.
   Web of Science ®Google Scholar
• Zhang, Wenfeng, Xiangyang Peng, Ruimin Chen, Chi Chen, Chaoyi Deng, Jinju Qian, and Wenxue Xu. 2014. “Intelligent Diagnostic Techniques of Abnormal Heat Defect in Transmission Lines Based on Unmanned Helicopter Infrared Video.” Dianwang Jishu/Power System Technology 5: 1334–1338. doi:10.13335/j.1000-3673.pst.2014.05.032.
   Google Scholar
• Zhao, Hengshuang, Li Jiang, Jiaya Jia, Philip Torr, and Vladlen Koltun. 2021. “Point Transformer.” IEEE/CVF International Conference on Computer Vision (ICCV). doi:10.1109/ICCV48922.2021.01595.
   Google Scholar
• Zhao, Haocheng, Junfeng Lei, and Xianpei Wang. 2019. “Powerline Identification Algorithm for Aerial Image in Complex Background.” Bulletin of Surveying and Mapping 7: 28–32. doi:10.13474/j.cnki.11-2246.2019.0213.
   Google Scholar
• Zhou, Ruqin, Ruicong Zhai, and Wanshou Jiang. 2018. “Automatic Extraction and Reconstruction of Bundle Conductors from Airborne LiDAR Point Clouds.” Science of Surveying and Mapping 43 (6): 124–130. doi:10.16251/j.cnki.1009-2307.2018.06.021.
   Google Scholar