1,486
Views
27
CrossRef citations to date
0
Altmetric
Articles

A general-purpose framework for parallel processing of large-scale LiDAR data

ORCID Icon, &
Pages 26-47 | Received 08 Sep 2016, Accepted 04 Dec 2016, Published online: 06 Jan 2017

References

  • Aljumaily, H., D. F. Laefer, and D. Cuadra. 2015. “Big-data Approach for Three-dimensional Building Extraction from Aerial Laser Scanning.” Journal of Computing in Civil Engineering, 30 (3). doi:10.1061/(ASCE)CP.1943-5487.0000524
  • Armstrong, M. P. 2010. “Exascale Computing, Cyberinfrastructure, and Geographical Analysis.” In 2010 NSF Cyber-GIS workshop Washington, DC, February 2–3.
  • ASPRS. 2013. “LAS Specification Version 1.4 – R13 15 July 2013.” Accessed September 5, 2016. http://www.asprs.org/wp-content/uploads/2010/12/LAS_1_4_r13.pdf.
  • Borthakur, D. 2008. “HDFS Architecture Guide.” Accessed September 5, 2016. http://hadoop.apache.org/common/docs/current/hdfsdesign.pdf.
  • Borthakur, D. 2013. “HDFS Architecture Guide.” Accessed September 5, 2016. https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html.
  • Bui, G., P. Calyam, B. Morago, R. B. Antequera, T. Nguyen, and Y. Duan. 2015. “LIDAR-based Virtual Environment Study for Disaster Response Scenarios.” In 2015 IFIP/IEEE international symposium on Integrated Network Management (IM), Ottawa, Canada, May 11–15, 790–793. IEEE.
  • Crosby, C., J. Arrowsmith, V. Nandigam, and C. Baru. 2011. “Online Access and Processing of LiDAR Topography Data.” In Geoinformatics: Cyberinfrastructure for the Solid Earth Sciences, edited by G. Keller and C. Baru, 251–265. Cambridge: Cambridge University Press. doi:10.1017/CBO9780511976308.017.
  • Dean, J., and S. Ghemawat. 2008. “MapReduce: Simplified Data Processing on Large Clusters.” Communications of the ACM 51 (1): 107–113. doi: 10.1145/1327452.1327492
  • Esri. 2016. “What is a LAS Dataset?” Accessed July 13, 2016. http://desktop.arcgis.com/en/arcmap/10.3/manage-data/las-dataset/what-is-a-las-dataset-.htm.
  • Goetz, S. J., D. Steinberg, M. G. Betts, R. T. Holmes, P. J. Doran, R. Dubayah, and M. Hofton. 2010. “LiDAR Remote Sensing Variables Predict Breeding Habitat of a Neotropical Migrant Bird.” Ecology 91 (6): 1569–1576. doi: 10.1890/09-1670.1
  • Guan, H., J. Li, L. Zhong, Y. Yongtao, and M. Chapman. 2013. “Process Virtualization of Large-scale LiDAR Data in a Cloud Computing Environment.” Computers & Geosciences 60: 109–116. doi: 10.1016/j.cageo.2013.07.013
  • Guan, X., and H. Wu. 2010. “Leveraging the Power of Multi-core Platforms for Large-scale Geospatial Data Processing: Exemplified by Generating DEM from Massive LiDAR Point Clouds.” Computers & Geosciences 36 (10): 1276–1282. doi: 10.1016/j.cageo.2009.12.008
  • Han, S. H., J. Heo, H. G. Sohn, and K. Yu. 2009. “Parallel processing method for airborne laser scanning data using a PC cluster and a virtual grid.” Sensors 9 (4): 2555–2573. doi: 10.3390/s90402555
  • Hanusniak, V., M. Svalec, J. Branicky, L. Takac, and M. Zabovsky. 2015. “Exploitation of Hadoop Framework for Point Cloud Geographic Data Storage System.” 2015 fifth International Conference on Digital Information Processing and Communications (ICDIPC), Sierre, Switzerland, October 7–9, 197–200. IEEE.
  • Hodgson, M. E., and P. Bresnahan. 2004. “Accuracy of Airborne LiDAR-derived Elevation: Empirical Assessment and Error Budget.” Photogrammetric Engineering & Remote Sensing 70 (3): 331–339. doi: 10.14358/PERS.70.3.331
  • Hodgson, M. E., Y. Cheng, P. Coleman, and R. C. Durfee. 1995. “GIS Computational Burdens: Solutions with Heuristic Algorithms and Parallel Processing.” GeoInfo Systems 4: 28–37.
  • Homm, F., N. Kaempchen, J. Ota, and D. Burschka. 2010. “Efficient Occupancy Grid Computation on the GPU with LiDAR and Radar for Road Boundary Detection.” In Intelligent Vehicles symposium (IV), Sofitel Gold Coast Broadbeach, Gold Coast City, Australia, June 23–26, 1006–1013. IEEE.
  • Hu, X., X. Li, and Y. Zhang. 2013. “Fast Filtering of LiDAR Point Cloud in Urban Areas Based on Scan Line Segmentation and GPU Acceleration.” IEEE Geoscience and Remote Sensing Letters 10 (2): 308–312. doi: 10.1109/LGRS.2012.2205130
  • Huang, F., D. Liu, X. Tan, J. Wang, Y. Chen, and B. He. 2011. “Explorations of the Implementation of a Parallel IDW Interpolation Algorithm in a Linux Cluster-based Parallel GIS.” Computers & Geosciences 37 (4): 426–434. doi: 10.1016/j.cageo.2010.05.024
  • Hug, C., P. Krzystek, and W. Fuchs. 2004. “Advanced LiDAR Data Processing with LasTools.” In XXth ISPRS Congress, Istanbul, Turkey, July 12–23, 12–23.
  • Isenburg, M. 2012. “LAStools-efficient Tools for LiDAR Processing.” Accessed June 16, 2016. http: http://www.cs.unc.edu/~isenburg/lastools.
  • Kersting, J., and A. P. B. Kersting. 2005. “LIDAR Data Points Filtering using ArcGIS’3D and Spatial Analyst.” In proceedings of the 25th ESRI user conference, San Diego, CA, July 25–29.
  • Kwan, M. P., and D. M. Ransberger. 2010. “LiDAR Assisted Emergency Response: Detection of Transport Network Obstructions Caused by Major Disasters.” Computers, Environment and Urban Systems 34 (3): 179–188. doi: 10.1016/j.compenvurbsys.2010.02.001
  • Lausten, K. 2007. “ENVI LiDAR Toolkit. Technical Report.” Accessed June 15, 2016. http://exelis.http.internapcdn.net/exelis/pdfs/2-13_ENVILiDAR_Brochure_LoRes.pdf.
  • Li, Z., F. Hu, J. L. Schnase, D. Q. Duffy, T. Lee, M. K. Bowen, and C. Yang. 2017. “A Spatiotemporal Indexing Approach for Efficient Processing of Big Array-based Climate Data with MapReduce.” International Journal of Geographical Information Science 31 (1): 17–35. doi: 10.1080/13658816.2015.1131830
  • Li, J., Y. Jiang, C. Yang, Q. Huang, and M. Rice. 2013. “Visualizing 3D/4D Environmental Data Using Many-core Graphics Processing Units (GPUs) and Multi-core Central Processing Units (CPUs).” Computers & Geosciences 59: 78–89. doi: 10.1016/j.cageo.2013.04.029
  • Li, Z., C. Yang, B. Jin, M. Yu, K. Liu, M. Sun, and M. Zhan. 2015. “Enabling Big Geoscience Data Analytics with a Cloud-based, MapReduce-enabled and Service-oriented Workflow Framework.” PloS One 10 (3): e0116781. doi: 10.1371/journal.pone.0116781
  • Li, Z., C. Yang, K. Liu, F. Hu, and B. Jin. 2016. “Automatic Scaling Hadoop in the Cloud for Efficient Process of Big Geospatial Data.” ISPRS International Journal of Geo-Information 5 (10): 173–191. doi: 10.3390/ijgi5100173
  • Li, Z., C. P. Yang, H. Wu, W. Li, and L. Miao. 2011. “An Optimized Framework for Seamlessly Integrating OGC Web Services to Support Geospatial Sciences.” International Journal of Geographical Information Science 25 (4): 595–613. doi: 10.1080/13658816.2010.484811
  • Liu, Y. Y., D. R. Maidment, D. G. Tarboton, X. Zheng, A. Yildirim1, N. S. Sazib, and S. Wang. 2016. “CyberGIS Approach to Generating High-resolution Height Above Nearest Drainage (HAND) Raster for National Flood Mapping.” CyberGIS Center technical report, CYBERGIS-TR-2016-005.
  • Lopatin, J., K. Dolos, H. J. Hernández, M. Galleguillos, and F. E. Fassnacht. 2016. “Comparing Generalized Linear Models and Random Forest to Model Vascular Plant Species Richness Using LiDAR Data in a Natural Forest in Central Chile.” Remote Sensing of Environment 173: 200–210. doi: 10.1016/j.rse.2015.11.029
  • Lukač, N., and B. Žalik. 2013. “GPU-based Roofs’ Solar Potential Estimation Using LiDAR Data.” Computers & Geosciences 52: 34–41. doi: 10.1016/j.cageo.2012.10.010
  • Luo, W., and H. Zhang. 2015. “Visual Analysis of Large-scale LiDAR Point Clouds.” 2015 IEEE international conference on Big Data (Big Data), Santa Clara, CA, October 29-November 1, 2487–2492. IEEE.
  • Ma, H., and Z. Wang. 2011. “Distributed Data Organization and Parallel Data Retrieval Methods for Huge Laser Scanner Point Clouds.” Computers & Geosciences 37 (2): 193–201. doi: 10.1016/j.cageo.2010.05.017
  • McGaughey, R. J. 2009. “FUSION/LDV: Software for LIDAR Data Analysis and Visualization.” US Department of Agriculture, Forest Service. Seattle, WA: Pacific Northwest Research Station, 123(2).
  • Neteler, M., M. H. Bowman, M. Landa, and M. Metz. 2012. “GRASS GIS: A Multi-purpose Open Source GIS.” Environmental Modelling & Software 31: 124–130. doi: 10.1016/j.envsoft.2011.11.014
  • Oryspayev, D., R. Sugumaran, J. DeGroote, and P. Gray. 2012. “LiDAR Data Reduction Using Vertex Decimation and Processing with GPGPU and Multicore CPU Technology.” Computers & Geosciences 43: 118–125. doi: 10.1016/j.cageo.2011.09.013
  • Svanberg, S. 2015. “LiDAR Techniques for Environmental and Ecological Monitoring.” In EGU general assembly conference abstracts, 17, 13357 Vienna, Austria, April 12–17.
  • Tarolli, P., J. R. Arrowsmith, and E. R. Vivoni. 2009. “Understanding Earth Surface Processes from Remotely Sensed Digital Terrain Models.” Geomorphology 113 (1): 1–3. doi: 10.1016/j.geomorph.2009.07.005
  • Tesfa, T. K., D. G. Tarboton, D. W. Watson, K. A. Schreuders, M. E. Baker, and R. M. Wallace. 2011. “Extraction of Hydrological Proximity Measures from DEMs Using Parallel Processing.” Environmental Modelling & Software 26 (12): 1696–1709. doi: 10.1016/j.envsoft.2011.07.018
  • Venugopal, V., and S. Kannan. 2013. “Accelerating Real-time LiDAR Data Processing Using GPUs.” 2013 IEEE 56th international Midwest Symposium on Circuits and Systems (MWSCAS), Columbus, OH, August 4–7, 1168–1171. IEEE.
  • Vierling, K. T., L. A. Vierling, W. A. Gould, S. Martinuzzi, and R. M. Clawges. 2008. “LiDAR: Shedding New Light on Habitat Characterization and Modeling.” Frontiers in Ecology and the Environment 6 (2): 90–98. doi: 10.1890/070001
  • Wang, S. 2010. “A CyberGIS Framework for the Synthesis of Cyberinfrastructure, GIS, and Spatial Analysis.” Annals of the Association of American Geographers 100 (3): 535–557. doi: 10.1080/00045601003791243
  • Wang, S., and M. P. Armstrong. 2003. “A Quadtree Approach to Domain Decomposition for Spatial Interpolation in Grid Computing Environments.” Parallel Computing 29 (10): 1481–1504. doi: 10.1016/j.parco.2003.04.003
  • Wang, S., M. K. Cowles, and M. P. Armstrong. 2008. “Grid Computing of Spatial Statistics: Using the TeraGrid for Gi*(d) Analysis.” Concurrency and Computation: Practice and Experience 20 (14): 1697–1720. doi: 10.1002/cpe.1294
  • Wright, D. J., and S. Wang. 2011. “The Emergence of Spatial Cyberinfrastructure.” Proceedings of the National Academy of Sciences 108 (14): 5488–5491. doi: 10.1073/pnas.1103051108
  • Yang, C., Q. Huang, Z. Li, K. Liu, and F. Hu. 2016. “Big Data and Cloud Computing: Innovation Opportunities and Challenges.” International Journal of Digital Earth, 1–41. doi:10.1080/17538947.2016.1239771.
  • Yang, C., R. Raskin, M. Goodchild, and M. Gahegan. 2010. “Geospatial Cyberinfrastructure: Past, Present and Future.” Computers, Environment and Urban Systems 34 (4): 264–277. doi: 10.1016/j.compenvurbsys.2010.04.001
  • Yang, C., H. Wu, Q. Huang, Z. Li, and J. Li. 2011. “Using Spatial Principles to Optimize Distributed Computing for Enabling the Physical Science Discoveries.” Proceedings of the National Academy of Sciences 108 (14): 5498–5503. doi: 10.1073/pnas.0909315108
  • Yonglin, S., W. Lixin, and W. Zhi. 2010. “Identification of Inclined Buildings from Aerial LiDAR Data for Disaster Management.” In 2010 18th international conference on Geoinformatics, Beijing, China, June 18–20, 1–5. IEEE.
  • You, Y., L. Fan, K. Roimela, and V. V. Mattila. 2014. “Simple Octree Solution for Multi-resolution LiDAR Processing and Visualisation.” 2014 IEEE international conference on Computer and Information Technology (CIT), Dhaka, Bangladesh, December 22–23, 220–225. IEEE.
  • Youn, C., V. Nandigam, M. Phan, D. Tarboton, N. Wilkins-Diehr, C. Baru, and S. Wang. 2014. “Leveraging XSEDE HPC Resources to Address Computational Challenges with High-resolution Topography Data.” In proceedings of the 2014 annual conference on Extreme Science and Engineering Discovery Environment, Atlanta, GA, July 13–18, 59, CM.
  • Zhao, Y., A. Padmanabhan, and S. Wang. 2013. “A Parallel Computing Approach to Viewshed Analysis of Large Terrain Data Using Graphics Processing Units.” International Journal of Geographical Information Science 27 (2): 363–384. doi: 10.1080/13658816.2012.692372

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.