A photogrammetric approach to fusing natural colour and thermal infrared UAS imagery in 3D point cloud generation

References

• Aasen, H., A. Burkart, A. Bolten, and G. Bareth. 2015. “Generating 3D Hyperspectral Information with Lightweight UAV Snapshot Cameras for Vegetation Monitoring: From Camera Calibration to Quality Assurance.” ISPRS Journal of Photogrammetry and Remote Sensing 108 International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS): 245–259. https://doi.org/10.1016/j.isprsjprs.2015.08.002.
   Web of Science ®Google Scholar
• Agisoft. 2018. photoscan Professional V1.4. St. Petersburg: Russia: Agisoft LLC.
   Google Scholar
• Allahyari, M., M. J. Olsen, D. T. Gillins, and M. L. Dennis. 2018. “Tale of Two RTNs: Rigorous Evaluation of Real-Time Network GNSS Observations.” Journal of Surveying Engineering 144 (2): 05018001. doi:10.1061/(ASCE)SU.1943-5428.0000249.
   Web of Science ®Google Scholar
• Berni, J., P. J. Zarco-Tejada, L. Suarez, and E. Fereres. 2009. “Thermal and Narrowband Multispectral Remote Sensing for Vegetation Monitoring from an Unmanned Aerial Vehicle.” Geoscience and Remote Sensing, IEEE Transactions On 47 (3): 722–738. doi:10.1109/TGRS.2008.2010457.
   Web of Science ®Google Scholar
• Bo, L., L. Heng, K. Koser, and M. Pollefeys. 2013. “A Multiple-Camera System Calibration Toolbox Using A Feature Descriptor-Based Calibration Pattern.” In 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE.,1301–1307. doi:10.1109/IROS.2013.6696517.
   Google Scholar
• Borrmann, D., A. Nüchter, M. Ðakulović, I. Maurović, I. Petrović, D. Osmanković, and V. Jasmin. 2014. “A Mobile Robot Based System for Fully Automated Thermal 3D Mapping.” Advanced Engineering Informatics 28 (4): 425–440. doi:10.1016/j.aei.2014.06.002.
   Web of Science ®Google Scholar
• Bouguet, J.-Y. 2004. Camera Calibration Toolbox for MATLAB.
   Google Scholar
• Brook, A., M. Vandewal, and E. Ben-Dor. 2012. “Fusion of Optical and Thermal Imagery and LiDAR Data for Application to 3-D Urban Environment and Structure Monitoring.” In Remote Sensing - Advanced Techniques and Platforms. InTech. doi:10.5772/36066.
   Google Scholar
• Choi, K., C. Kim, and J. B. Ra. 2010. “Infrared Image Enhancement Based on an Aligned High Resolution Visible Image.” In 2010 IEEE International Conference on Image Processing, IEEE, 3341–3344. doi:10.1109/ICIP.2010.5651482.
   Google Scholar
• Colomina, I., and P. Molina. 2014. “Unmanned Aerial Systems for Photogrammetry and Remote Sensing: A Review.” ISPRS Journal of Photogrammetry and Remote Sensing 92 (June): 79–97. doi:10.1016/j.isprsjprs.2014.02.013.
   Web of Science ®Google Scholar
• Ellmauthaler, A., E. A. B. Da Silva, C. L. Pagliari, J. N. Gois, and S. R. Neves. 2013. “A Novel Iterative Calibration Approach for Thermal Infrared Cameras.” In 2013 IEEE International Conference on Image Processing, IEEE, 2182–2186. doi:10.1109/ICIP.2013.6738450.
   Google Scholar
• Eltner, A., A. Kaiser, C. Castillo, G. Rock, F. Neugirg, and A. Antonio. 2016. “Image-Based Surface Reconstruction in Geomorphometry – Merits, Limits and Developments.” Earth Surface Dynamics 4 (2): 359–389. doi:10.5194/esurf-4-359-2016.
   Web of Science ®Google Scholar
• Esri. 2016. “arcgis Desktop V10.2.2.”. Redlands, CA: Esri. http://desktop.arcgis.com/en/
   Google Scholar
• Furukawa, Y., and J. Ponce. 2010. “Accurate, Dense, and Robust Multiview Stereopsis.” IEEE Transactions on Pattern Analysis and Machine Intelligence 32 (8) IEEE: 1362–1376. doi:10.1109/TPAMI.2009.161.
   PubMed Web of Science ®Google Scholar
• Gade, R., and T. B. Moeslund. 2014. “Thermal Cameras and Applications: A Survey.” Machine Vision and Applications 25 (1): 245–262. doi:10.1007/s00138-013-0570-5.
   Web of Science ®Google Scholar
• Geospatial, H. 2014. envi V5.2. Melbourne, FL: Harris Corporation. http://www.harrisgeospatial.com/ProductsandTechnology/Software/ENVI.aspx
   Google Scholar
• Ghilani, C. D. 2011. Adjustment Computations: Spatial Data Analysis. Hoboken, NJ: John Wiley & Sons.
   Google Scholar
• Girardeau-Montaut, D. 2017. “Cloud Compare: 3D Point Cloud and Mesh Processing Software, Open-Source Project.” Open Source Project. http://www.danielgm.net/cc/
   Google Scholar
• González-Aguilera, D., P. Rodriguez-Gonzalvez, J. Armesto, and S. Lagüela. 2012. “Novel Approach to 3D Thermography and Energy Efficiency Evaluation.” Energy and Buildings 54 (November): 436–443. doi:10.1016/j.enbuild.2012.07.023.
   Web of Science ®Google Scholar
• Guo, Q., L. Wenkai, Y. Hong, and O. Alvarez. 2010. “Effects of Topographic Variability and Lidar Sampling Density on Several DEM Interpolation Methods.” Photogrammetric Engineering & Remote Sensing 76 (6): 701–712. doi:10.14358/PERS.76.6.701.
   Web of Science ®Google Scholar
• Ham, Y., and M. Golparvar-Fard. 2013. “An Automated Vision-Based Method for Rapid 3D Energy Performance Modeling of Existing Buildings Using Thermal and Digital Imagery.” Advanced Engineering Informatics 27 (3) Elsevier Ltd: 395–409. doi:10.1016/j.aei.2013.03.005.
   Web of Science ®Google Scholar
• Harris, C., and M. Stephens. 1988. “A Combined Corner and Edge Detector.” Alvey Vision Conference 15: 50.
   Google Scholar
• Heikkila, J., and O. Silven. 1997. “A Four-Step Camera Calibration Procedure with Implicit Image Correction.” In Computer Vision and Pattern Recognition, 1997. Proceedings., 1997, IEEE Computer Society Conference On, San Juan, Puerto Rico, USA, 1106–1112.
   Google Scholar
• Hoegner, L., T. Abmayr, D. Tosic, S. Turzer, and U. Stilla. 2018. “Fusion of 3d Point Clouds with Tir Images for Indoor Scene Reconstruction.” ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLII–1 (October): 189–194. doi:10.5194/isprs-archives-XLII-1-189-2018.
   Google Scholar
• Hoegner, L., S. Tuttas, Y. Xu, K. Eder, and U. Stilla. 2016. “Evaluation of Methods for Coregistration and Fusion of Rpas-based 3d Point Clouds and Thermal Infrared Images.” ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLI-B3 (June) IEEE: 241–246. doi:10.5194/isprs-archives-XLI-B3-241-2016.
   Google Scholar
• Honkavaara, E., T. Rosnell, R. Oliveira, and A. Tommaselli. 2017. “Band Registration of Tuneable Frame Format Hyperspectral UAV Imagers in Complex Scenes.” ISPRS Journal of Photogrammetry and Remote Sensing 134 The Authors: 96–109.doi:10.1016/j.isprsjprs.2017.10.014.
   Web of Science ®Google Scholar
• Iyengar, S. S., S. Sastry, and N. Balakrishnan. 2003. “Foundations of Data Fusion for Automation.” IEEE Instrumentation & Measurement Magazine 6 (4): 35–41. doi:10.1109/MIM.2003.1251481.
   Web of Science ®Google Scholar
• Javadnejad, F. 2013. “Flood Inundation Mapping Using HEC-RAS and GIS for Shelby County, Tennessee.” University of Memphis.
   Google Scholar
• Javadnejad, F. 2018. “Small Unmanned Aircraft Systems (UAS) for Engineering Inspections and Geospatial Mapping.” Oregon State University. http://ir.library.oregonstate.edu/concern/graduate_thesis_or_dissertations/6969z572s
   Google Scholar
• Javadnejad, F., F. Alinia, and P. Behnia. 2011. “Targeting Structural Features and Alterations for Reconnaissance of Hydrothermal Gold Mineralization in Delijan Area Using DEM and ETM+ Data.” Amirkabir Journal of Science and Technology 72 (21): 9–16.
   Google Scholar
• Javadnejad, F., and D. T. Gillins. 2016. “Unmanned Aircraft Systems-Based Photogrammetry for Ground Movement Monitoring.” In Pipelines 2016, 1000–1011. Reston, VA: American Society of Civil Engineers. doi:10.1061/9780784479957.094.
   Google Scholar
• Javadnejad, F., D. T. Gillins, C. C. Higgins, and M. N. Gillins. 2017a. “BridgeDex : Proposed Web GIS Platform for Managing and Interrogating Multiyear and Multiscale Bridge-Inspection Images.” Journal of Computing in Civil Engineering 31 (6): 04017061. doi:10.1061/(ASCE)CP.1943-5487.0000710.
   Web of Science ®Google Scholar
• Javadnejad, F., M. N. Gillins, and D. T. Gillins. 2016. “Vertical Accuracy Assessment of Image-Based Reconstructed 3D Point Clouds with respect to Horizontal Ground Sampling Distance.” In ASPRS Annual Conference, Imaging & Geospatial Technology Forum (IGTF) 2016. Fort Worth, TX: ASPRS.
   Google Scholar
• Javadnejad, F., C. H. Simpson, D. T. Gillins, T. Claxton, and M. J. Olsen. 2017b. “An Assessment of UAS-Based Photogrammetry for Civil Integrated Management (CIM) Modeling of Pipes.” In Pipelines 2017, 112–123. Reston, VA: American Society of Civil Engineers. doi:10.1061/9780784480885.012.
   Google Scholar
• Javadnejad, F., B. Waldron, and A. Hill. 2017. “LITE Flood: Simple GIS-Based Mapping Approach for Real-Time Redelineation of Multifrequency Floods.” Natural Hazards Review 18 (3): 04017004. doi:10.1061/(ASCE)NH.1527-6996.0000238.
   Web of Science ®Google Scholar
• Jensen, J. R. 2009. Remote Sensing of the Environment: An Earth Resource Perspective. 2nd ed. New Delhi, India: Pearson Education India.
   Google Scholar
• Kylili, A., P. A. Fokaides, P. Christou, and S. A. Kalogirou. 2014. “Infrared Thermography (IRT) Applications for Building Diagnostics: A Review.” Applied Energy 134: 531–549. doi:10.1016/j.apenergy.2014.08.005.
   Web of Science ®Google Scholar
• Lague, D., N. Brodu, and J. Leroux. 2013. “Accurate 3D Comparison of Complex Topography with Terrestrial Laser Scanner: Application to the Rangitikei Canyon (N-Z).” ISPRS Journal of Photogrammetry and Remote Sensing 82 (August) International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS): 10–26. doi:10.1016/j.isprsjprs.2013.04.009.
   Web of Science ®Google Scholar
• Lagüela, S., L. Díaz-Vilariño, and D. Roca. 2016. “Infrared Thermography: Fundamentals and Applications.” In, edited by B. Riveiro and M. Solla, 113–138.CRC Press. doi:10.1201/b19024-8.
   Google Scholar
• Le Moigne, J., W. J. Campbell, and R. F. Cromp. 2002. “An Automated Parallel Image Registration Technique Based on the Correlation of Wavelet Features.” IEEE Transactions on Geoscience and Remote Sensing 40 (8) IEEE: 1849–1864. doi:10.1109/TGRS.2002.802501.
   Web of Science ®Google Scholar
• Lewis, A., G. E. Hilley, and J. L. Lewicki. 2015. “Integrated Thermal Infrared Imaging and Structure-from-Motion Photogrammetry to Map Apparent Temperature and Radiant Hydrothermal Heat Flux at Mammoth Mountain, CA, USA.” Journal of Volcanology and Geothermal Research 303 (September) Elsevier B.V.: 16–24. doi:10.1016/j.jvolgeores.2015.07.025.
   Web of Science ®Google Scholar
• Lowe, D. G. 2004. “Distinctive Image Features from Scale-Invariant Keypoints.” International Journal of Computer Vision 60 (2): 91–110. doi:10.1023/B:VISI.0000029664.99615.94.
   Web of Science ®Google Scholar
• Lucieer, A., Z. Malenovský, T. Veness, and L. Wallace. 2014. “HyperUAS-Imaging Spectroscopy from a Multirotor Unmanned Aircraft System.” Journal of Field Robotics 31 (4): 571–590. doi:10.1002/rob.21508.
   Web of Science ®Google Scholar
• Mahmoudabadi, H., M. J. Olsen, and S. Todorovic. 2016. “Efficient Terrestrial Laser Scan Segmentation Exploiting Data Structure.” ISPRS Journal of Photogrammetry and Remote Sensing 119 (September) International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS): 135–150. doi:10.1016/j.isprsjprs.2016.05.015.
   Web of Science ®Google Scholar
• Martinez-De, Dios, J. R., and A. Ollero. 2006. “Automatic Detection of Windows Thermal Heat Losses in Buildings Using UAVs.” In 2006 World Automation Congress, 1–6. IEEE. doi:10.1109/WAC.2006.375998.
   Google Scholar
• Maset, E., A. Fusiello, F. Crosilla, R. Toldo, and D. Zorzetto. 2017. “Photogrammetric 3d Building Reconstruction from Thermal Images.” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences 4 (2W3): 25–32. doi:10.5194/isprs-annals-IV-2-W3-25-2017.
   Google Scholar
• Mikhail, E. M., J. S. Bethel, and J. Chris McGlone. 2001. introduction to Modern Photogrammetry. New York, NY: John Wiley & Sons.
   Google Scholar
• Nagi, R. 2012. “Maintaining Detail and Color Definition When Integrating Color and Grayscale Rasters Using No Alteration of Grayscale or Intensity (NAGI) Fusion Method.” In Proceedings, 16–18.
   Google Scholar
• Nishar, A., S. Richards, D. Breen, J. Robertson, and B. Breen. 2016. “Thermal Infrared Imaging of Geothermal Environments and by an Unmanned Aerial Vehicle (UAV): A Case Study of the Wairakei – Tauhara Geothermal Field, Taupo, New Zealand.” Renewable Energy 86 (February): 1256–1264. doi:10.1016/j.renene.2015.09.042.
   Web of Science ®Google Scholar
• O’Banion, M. S., M. J. Olsen, C. Rault, J. Wartman, and K. Cunningham. 2018. “Suitability of Structure from Motion for Rock-Slope Assessment.” The Photogrammetric Record 33 (162): 217–242. doi:10.1111/phor.12241.
   Web of Science ®Google Scholar
• Pajares, G. 2015. “Overview and Current Status of Remote Sensing Applications Based on Unmanned Aerial Vehicles (uavs).” Photogrammetric Engineering & Remote Sensing 81 (4): 281–330. doi:10.14358/PERS.81.4.281.
   Web of Science ®Google Scholar
• Pix4D. 2018. “pix4dmapper Pro V4.0.”. Lausanne, Switzerland: Pix4D. https://pix4d.com/product/pix4dmapper-photogrammetry-software/
   Google Scholar
• Roth, M., T. R. Oke, and W. J. Emery. 1989. “Satellite-Derived Urban Heat Islands from Three Coastal Cities and the Utilization of Such Data in Urban Climatology.” International Journal of Remote Sensing 10 (11): 1699–1720. doi:10.1080/01431168908904002.
   Web of Science ®Google Scholar
• Roy, D. P., M. A. Wulder, T. R. Loveland, C. E. Woodcock, R. G. Allen, M. C. Anderson, D. Helder, et al. 2014. “Landsat-8: Science and Product Vision for Terrestrial Global Change Research.” Remote Sensing of Environment 145 (April): 154–172. doi:10.1016/j.rse.2014.02.001.
   Web of Science ®Google Scholar
• Salvi, J., X. Armangué, and J. Batlle. 2002. “A Comparative Review of Camera Calibrating Methods with Accuracy Evaluation.” Pattern Recognition 35 (7): 1617–1635. doi:10.1016/S0031-3203(01)00126-1.
   Web of Science ®Google Scholar
• Shao, Z., N. Yang, X. Xiao, L. Zhang, and Z. Peng. 2016. “A Multi-View Dense Point Cloud Generation Algorithm Based on Low-Altitude Remote Sensing Images.” Remote Sensing 8 (5): 381. doi:10.3390/rs8050381.
   Web of Science ®Google Scholar
• Shi, Y. J., S. C. Alex Thomasson, M. N. Ace Pugh, W. L. Rooney, S. Shafian, N. Rajan, G. Rouze, et al. 2016. “Unmanned Aerial Vehicles for High-Throughput Phenotyping and Agronomic Research.” Edited by Z. Jinfa. Plos One 11 (7): e0159781.doi:10.1371/journal.pone.0159781.
   PubMed Web of Science ®Google Scholar
• Singh, K. K., and A. E. Frazier. 2018. “A Meta-Analysis and Review of Unmanned Aircraft System (UAS) Imagery for Terrestrial Applications.” International Journal of Remote Sensing, no. January: 1–21. doi:10.1080/01431161.2017.1420941.
   Web of Science ®Google Scholar
• Sledz, A., J. Unger, and C. Heipke. 2018. “Thermal Ir Imaging: Image Quality and Orthophoto Generation.” ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLII–1: 413–420. doi:10.5194/isprs-archives-XLII-1-413-2018.
   Google Scholar
• Slocum, R. K., and C. E. Parrish. 2017. “Simulated Imagery Rendering Workflow for UAS-Based Photogrammetric 3D Reconstruction Accuracy Assessments.” Remote Sensing 9 (4): 396. doi:10.3390/rs9040396.
   Web of Science ®Google Scholar
• Snavely, N., S. M. Seitz, and R. Szeliski. 2006. “Photo Tourism.” In ACM SIGGRAPH 2006 Papers on - SIGGRAPH ’06, 25:835. New York, New York, USA: ACM Press. doi:10.1145/1179352.1141964.
   Google Scholar
• Snavely, N., S. M. Seitz, and R. Szeliski. 2008. “Modeling the World from Internet Photo Collections.” International Journal of Computer Vision 80 (2): 189–210. doi:10.1007/s11263-007-0107-3.
   Web of Science ®Google Scholar
• Szeliski, R. 2010. Computer Vision: Algorithms and Applications. 1st ed. New York, NY, USA: Springer-Verlag New York.
   Google Scholar
• Tahami, H., A. Basiri, T. Moore, J. Park, and L. Bonenberg. 2018. Virtual Spatial Diversity Antenna for GNSS Based Mobile Positioning in the Harsh Environments. 3186–3198. doi:10.33012/2018.15987.
   Google Scholar
• Teillet, P. M., J. L. Barker, B. L. Markham, R. R. Irish, G. Fedosejevs, and J. C. Storey. 2001. “Radiometric Cross-Calibration of the Landsat-7 ETM+ and Landsat-5 TM Sensors Based on Tandem Data Sets.” Remote Sensing of Environment 78 (1–2): 39–54. doi:10.1016/S0034-4257(01)00248-6.
   Web of Science ®Google Scholar
• Tommaselli, A. M., G. J. Marcato Junior, R. S. Ruy, and R. F. Lopes. 2010. “Registration and Fusion of Multiple Images Acquired with Medium Format Cameras.” In The 2010 Canadian Geomatics Conference and Symposium of Commission I - ISPRS Convergence in Geomatics. Calgary, Alberta, Canada. doi:10.13140/2.1.3064.0329.
   Google Scholar
• Triggs, B., P. F. McLauchlan, R. I. Hartley, and A. W. Fitzgibbon. 1999. “Bundle Adjustment—A Modern Synthesis.” In International Workshop on Vision Algorithms, 298–372. Berlin: Springer.
   Google Scholar
• Vidas, S., P. Moghadam, and M. Bosse. 2013. “3D Thermal Mapping of Building Interiors Using an RGB-D and Thermal Camera.” Proceedings - IEEE International Conference on Robotics and Automation, 2311–2318. doi:10.1109/ICRA.2013.6630890.
   Google Scholar
• Vidas, S., P. Moghadam, and S. Sridharan. 2015. “Real-Time Mobile 3D Temperature Mapping.” IEEE Sensors Journal 15 (2): 1145–1152. doi:10.1109/JSEN.2014.2360709.
   Web of Science ®Google Scholar
• Wood, R. L., D. T. Gillins, M. E. Mohammadi, F. Javadnejad, H. Tahami, M. N. Gillins, and Y. Liao. 2017. “2015 Gorkha Post-Earthquake Reconnaissance of a Historic Village with Micro Unmanned Aerial Systems.” In 16th World Conference on Earthquake (16WCEE),Santiago, Chile. International Association for Earthquake Engineering (IAEE).
   Google Scholar
• Wu, C. 2011. “VisualSFM: A Visual Structure from Motion System.”
   Google Scholar
• Yilmaz, A., K. Shafique, and M. Shah. 2003. “Target Tracking in Airborne Forward Looking Infrared Imagery.” Image and Vision Computing 21 (7): 623–635. doi:10.1016/S0262-8856(03)00059-3.
   Web of Science ®Google Scholar
• Zhang, J. 2010. “Multi-Source Remote Sensing Data Fusion: Status and Trends.” International Journal of Image and Data Fusion 1 (1): 5–24. doi:10.1080/19479830903561035.
   Google Scholar