Publication Cover
Canadian Journal of Remote Sensing
Journal canadien de télédétection
Volume 46, 2020 - Issue 3
217
Views
4
CrossRef citations to date
0
Altmetric
Research Article

A New Tie Plane-Based Method for Fine Registration of Imagery and Point Cloud Dataset

Une méthode basée sur les plans de liaison pour l'alignement précis d’images avec des nuages de points

ORCID Icon & ORCID Icon
Pages 295-312 | Received 22 Aug 2019, Accepted 16 Jun 2020, Published online: 22 Jul 2020

References

  • Abayowa, B.O., Yilmaz, A., and Hardie, R.C. 2015. “Automatic registration of optical aerial imagery to a LiDAR point cloud for generation of city models.” ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 106: pp. 68–81. doi:10.1016/j.isprsjprs.2015.05.006.
  • Aldelgawy, M., Detchev, I. D., and Habib, A. F. 2008. “Alternative procedures for the incorporation of LiDAR-derived linear and areal features for photogrammetric geo-referencing.” Proceedings of the American Society for Photogrammetry and Remote Sensing (ASPRS) Annual Conference, Portland, Oregon.
  • Amami, M.M., Smith, M.J., and Kokkas, N. 2014. “Low cost vision based personal mobile mapping system.” ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XL-3/W1(No. 3W1): pp. 1–6. doi:10.5194/isprsarchives-XL-3-W1-1-2014.
  • Barazzetti, L., Scaioni, M., and Remondino, F. 2010. “Orientation and 3D modelling from markerless terrestrial images: Combining accuracy with automation.” The Photogrammetric Record, Vol. 25(No. 132): pp. 356–381. doi:10.1111/j.1477-9730.2010.00599.x.
  • Barsai, G., Yilmaz, A., Nagarajan, S., and Srestasathiern, P. 2017. “Registration of images to Lidar and GIS data without establishing explicit correspondences.” Photogrammetric Engineering & Remote Sensing, Vol. 83(No. 10): pp. 705–716. doi:10.14358/PERS.83.10.705.
  • Campos-Taberner, M., Romero-Soriano, A., Gatta, C., Camps-Valls, G., Lagrange, A., Le Saux, B., Beaupere, A., et al. 2016. “Processing of extremely high-resolution LiDAR and RGB data: Outcome of the 2015 IEEE GRSS data fusion contest–part A: 2-D contest.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 9(No. 12): pp. 5547–5559. doi:10.1109/JSTARS.2016.2569162.
  • Chen, Y., and Medioni G. 1991. “Object medeling by registration of multiple range images.” IEEE International Conference on Robotics and Automation, Sacramento, California, pp. 2724–2729.
  • Chen, H., and Yu, P. 2019. “Application of laser SLAM technology in backpack indoor mobile measurement system.” IOP Conference Series: Earth and Environmental Science, Vol. 237 pp. 032026. doi:10.1088/1755-1315/237/3/032026.
  • Chiang, K-w., Tsai, G-j., Li, Y-h., and El-Sheimy, N. 2017. “Development of LiDAR-based UAV system for environment reconstruction.” IEEE Geoscience and Remote Sensing Letters, Vol. 14(No. 10): pp. 1790–1794. doi:10.1109/LGRS.2017.2736013.
  • Eslami, M., and Mohammadzadeh, A. 2016. “Developing a spectral-based strategy for urban object detection from airborne hyperspectral TIR and visible data.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 9(No. 5): pp. 1808–1816. doi:10.1109/JSTARS.2015.2489838.
  • Eslami, M., and Mohammadzadeh, A. 2017. “A novel method for urban land cover mapping based on new vegetation indices and texture-spectral information from fused visible and hyperspectral thermal infrared airborne data.” European Journal of Remote Sensing, Vol. 50(No. 1): pp. 320–331. doi:10.1080/22797254.2017.1328645.
  • Fanta-Jende, P., Nex, F., Vosselman, G., and Gerke, M. 2019. “Co-registration of panoramic mobile mapping images and oblique aerial images.” Photogrammetric Record, Vol. 34(No. 166): pp. 148–173.
  • Fieber, K.D., Mills, J.P., Miller, P.E., Clarke, L., Ireland, L., and Fox, A.J. 2018. “Rigorous 3D change determination in Antarctic Peninsula Glaciers from Stereo WorldView-2 and archival aerial imagery.” Remote Sensing of Environment, Vol. 205: pp. 18–31. doi:10.1016/j.rse.2017.10.042.
  • Furukawa, Y., and Ponce, J. 2010. “Accurate, dense, and robust multiview stereopsis.” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 32(No. 8): pp. 1362–1376. doi:10.1109/TPAMI.2009.161.
  • Goodwin, N.R., Armston, J.D., Muir, J., and Stiller, I. 2017. “Monitoring gully change: A Comparison of airborne and terrestrial laser scanning using a case study from Aratula.” Geomorphology, Vol. 282: pp. 195–208. doi:10.1016/j.geomorph.2017.01.001.
  • Habib, A., Morgan, M., Kim, E. M., and Cheng, R. 2004. “Linear features in photogrammetric activities.” ISPRS Congress, Istanbul, Turkey, pp. 610.
  • Hirschmuller, H., and Scharstein, D. 2009. “Evaluation of stereo matching costs on images with radiometric differences.” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 31(No. 9): pp. 1582–1599. doi:10.1109/TPAMI.2008.221.
  • Hopkinson, C., Chasmer, L., Gynan, C., Mahoney, C., and Sitar, M. 2016. “Multisensor and multispectral LiDAR characterization and classification of a forest environment.” Canadian Journal of Remote Sensing, Vol. 42(No. 5): pp. 501–520. doi:10.1080/07038992.2016.1196584.
  • Huang, X., Zhang, L., and Gong, W. 2011. “Information fusion of aerial images and LIDAR data in urban areas: Vector-stacking, re-classification and post-processing approaches.” International Journal of Remote Sensing, Vol. 32(No. 1): pp. 69–84. doi:10.1080/01431160903439882.
  • Huang, R., Zheng, S., and Hu, K. 2018. “Registration of aerial optical images with LiDAR data using the closest point principle and collinearity equations.” Sensors, Vol. 18(No. 6): pp. 1770. doi:10.3390/s18061770.
  • Kume, H., Sato, T., and Yokoya, N. 2015. “Bundle adjustment using aerial images with two-stage geometric.” Computer Vision and Image Understanding, Vol. 138: pp. 74–84. doi:10.1016/j.cviu.2015.05.003.
  • Kwak, T.-S., Kim, Y.-I., Yu, K.-Y., and Lee, B.-K. 2006. “Registration of aerial imagery and aerial LiDAR data using centroids of plane roof surfaces as control information.” KSCE Journal of Civil Engineering, Vol. 10(No. 5): pp. 365–370. doi:10.1007/BF02830090.
  • Leckie, D., Gougeon, F., Hill, D., Quinn, R., Armstrong, L., and Shreenan, R. 2003. “Combined high-density Lidar and multispectral imagery for individual tree crown analysis.” Canadian Journal of Remote Sensing, Vol. 29(No. 5): pp. 633–649. doi:10.5589/m03-024.
  • Lehtola, V., Kaartinen, H., Nüchter, A., Kaijaluoto, R., Kukko, A., Litkey, P., Honkavaara, E., et al. 2017. “Comparison of the selected state-of-the-art 3D indoor scanning and point cloud generation methods.” Remote Sensing, Vol. 9(No. 8): pp. 726–796. doi:10.3390/rs9080796.
  • Li, J., Yang, B., Chen, C., Huang, R., Dong, Z., and Xiao, W. 2018. “Automatic registration of panoramic image sequence and mobile laser scanning data using semantic features.” ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 136: pp. 41–57. doi:10.1016/j.isprsjprs.2017.12.005.
  • Lowe, D.G. 2004. “Distinctive image features from scale-invariant keypoints.” International Journal of Computer Vision, Vol. 60(No. 2): pp. 91–110. doi:10.1023/B:VISI.0000029664.99615.94.
  • Luhtmann, T., Robson, S., Kyle, S., and Harley, I. 2011. Close Range Photogrammetry: Principles, Techniques and Applications. Caithness: Whittles.
  • Mastin, A., Kepner, J., and Fisher, J.J. 2009. “Automatic registration of LIDAR and optical images of urban scenes.” In Computer Vision and Pattern Recognition, 2009, CVPR 2009, IEEE Conference On, IEEE, pp. 2639–2646.
  • Miled, M., Soheilian, B., Habets, E., and Vallet, B. 2016. “Hybrid online mobile laser scanner calibration through image alignment by mutual information.” ISPRS Annals of Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. III-1L pp. 25–31. doi:10.5194/isprs-annals-III-1-25-2016.
  • Mishra, R., and Zhang, Y. 2012. “A review of optical imagery and airborne Lidar data registration methods.” The Open Remote Sensing Journal, Vol. 5(No. 1): pp. 54–63.
  • Mitishita, E., Habib, A., Centeno, J., Machado, A., Lay, J., and Wong, C. 2008. “Photogrammetric and Lidar data integration using the centroid of a rectangular roof as a control point.” The Photogrammetric Record, Vol. 23(No. 121): pp. 19–35. doi:10.1111/j.1477-9730.2008.00464.x.
  • Mostegel, C., Fraundorfer, F., and Bischof, H. 2018. “Prioritized multi-view stereo depth map generation using confidence prediction.” ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 143: pp. 167–180. doi:10.1016/j.isprsjprs.2018.03.022.
  • Mousa, Y.A., Helmholz, P., Belton, D., and Bulatov, D. 2019. “Building detection and regularisation using DSM and imagery information.” The Photogrammetric Record, Vol. 34(No. 165): pp. 85–107. doi:10.1111/phor.12275.
  • Moussa, W., Abdel-Wahab, M., and Fritsch, D. 2012. “An automatic procedure for combining digital images and laser scanner data.” ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XXXIX: pp. 229–234. http://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XXXIX-B5/229/2012/isprsarchives-XXXIX-B5-229-2012.pdf%0Ahttp://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XXXIX-B5/229/2012/.
  • O’Banion, M.S., Olsen, M.J., Ault, C., Wartman, J., and Cunningham, K. 2018. “Suitability of structure from motion for rock-slope assessment.” The Photogrammetric Record, Vol. 33(No. 162): pp. 217–242.
  • Omidalizarandi, M., and Neumann, I. 2015. “Comparison of target-and mutual information based calibration of terrestrial laser scanner and digital camera for deformation monitoring.” ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XL-1-W5(No. 1): pp. 559–564. doi:10.5194/isprsarchives-XL-1-W5-559-2015.
  • Pandey, G., McBride, J. R., Savarese, S., and Eustice, R. M. 2012. “Automatic targetless extrinsic calibration of a 3D Lidar and camera by maximizing mutual information.” Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, pp. 2053–2059.
  • Parmehr, E.G., Fraser, C.S., Zhang, C., and Leach, J. 2014. “Automatic registration of optical imagery with 3D LiDAR data using statistical similarity.” ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 88: pp. 28–40. doi:10.1016/j.isprsjprs.2013.11.015.
  • Remondino, F., Spera, M.G., Nocerino, E., Menna, F., and Nex, F. 2014. “State of the art in high density image matching.” The Photogrammetric Record, Vol. 29(No. 146): pp. 144–166. doi:10.1111/phor.12063.
  • Rottensteiner, F., Sohn, G., Gerke, M., Wegner, J.D., Breitkopf, U., and Jung, J. 2014. “Results of the ISPRS benchmark on urban object detection and 3D building reconstruction.” ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 93: pp. 256–271. doi:10.1016/j.isprsjprs.2013.10.004.
  • Safdarinezhad, A., Mokhtarzade, M., and Valadan Zoej, M. 2016. “Shadow-based hierarchical matching for the automatic registration of airborne LiDAR data and space imagery.” Remote Sensing, Vol. 8(No. 6): pp. 466. doi:10.3390/rs8060466.
  • Sedaghat, A., and Mohammadi, N. 2018. “Uniform competency-based local feature extraction for remote sensing images.” ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 135: pp. 142–157. doi:10.1016/j.isprsjprs.2017.11.019.
  • Seitz, S.M., and Dyer, C.R. 1999. “Photorealistic scene reconstruction by voxel coloring.” International Journal of Computer Vision, Vol. 35(No. 2): pp. 151–173.
  • Sima, A.A., and Buckley, S.J. 2013. “Optimizing SIFT for matching of short wave infrared and visible wavelength images.” Remote Sensing, Vol. 5(No. 5): pp. 2037–2056. doi:10.3390/rs5052037.
  • Sima, A.A., Buckley, S.J., Kurz, T.H., and Schneider, D. 2014. “Semi-automated registration of close-range hyperspectral scans using oriented digital camera imagery and a 3D model.” The Photogrammetric Record, Vol. 29(No. 145): pp. 10–29. doi:10.1111/phor.12049.
  • Srestasathiern, P. 2012. Line Based Estimation of Object Space Geometry and Camera Motion. Columbus: The Ohio State University.
  • Sun, S., and Savalggio, C. 2012. “Complex building roof detection and strict description from LIDAR data and orthorectified aerial imagery.” Geoscience and Remote Sensing Symposium (IGARSS), 2012 IEEE International, IEEE, pp. 5466–5469.
  • Teo, T.A., and Huang, S.H. 2013. “Automatic co-registration of optical satellite images and airborne Lidar data using relative and absolute orientations.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 6(No. 5): pp. 2229–2237. doi:10.1109/JSTARS.2012.2237543.
  • Toth, C., Ju, H., and Grejner-Brzezinska, D. 2011. Matching between Different Image Domains. Berlin/Heidelberg, Germany: Springer.
  • Viola, P., and Wells, W.M. III. 1997. “Alignment by maximization of mutual information.” International Journal of Computer Vision, Vol. 24(No. 2): pp. 137–154. (doi:10.1023/A:1007958904918.
  • Wang, L., and Neumann, U. 2009. “A robust approach for automatic registration of aerial images with untextured aerial LiDAR data.” 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, pp. 2623–2630.
  • Wang, X., Rottensteiner, F., and Heipke, C. 2019. “Structure from motion for ordered and unordered image sets based on random K-d forests and global pose estimation.” ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 147: pp. 19–41. doi:10.1016/j.isprsjprs.2018.11.009.
  • Yang, B., and Chen, C. 2015. “Automatic registration of UAV-borne sequent images and LiDAR DATA.” ISPRS Journal of Photogrammetry and Remote Sensing, Vol. 101: pp. 262–274. doi:10.1016/j.isprsjprs.2014.12.025.
  • Yong, J. 2011. “GPU-friendly multi-view stereo reconstruction using surfel representation and graph cuts.” Computer Vision and Image Understanding, Vol. 115(No. 5): pp. 620–634. 10.1016/j.cviu.2010.11.017.
  • Zheng, S., Huang, R., and Zhou, Y. 2013. “Registration of optical images with Lidar data and its accuracy assessment.” Photogrammetric Engineering & Remote Sensing, Vol. 79(No. 8): pp. 731–741. doi:10.14358/PERS.79.8.731.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.