Advanced search
Publication Cover
Geo-spatial Information Science Volume 23, 2020 - Issue 1: Challenges and Trends of Geo-spatial Information Science. Guest Editors: Prof. Jianya Gong and Prof. Zhenfeng Shao
Submit an article Journal homepage
7,696
Views
28
CrossRef citations to date
0
Altmetric
Invited Articles

Deep learning for geometric and semantic tasks in photogrammetry and remote sensing

Christian HeipkeInstitute of Photogrammetry and GeoInformation (PI), Leibniz University Hannover, Hannover, GermanyCorrespondence[email protected]
ORCID Iconhttps://orcid.org/0000-0002-7007-9549View further author information
ORCID Icon &
Franz RottensteinerInstitute of Photogrammetry and GeoInformation (PI), Leibniz University Hannover, Hannover, GermanyORCID Iconhttps://orcid.org/0000-0003-1942-8210View further author information
ORCID Icon
Pages 10-19 | Received 18 Dec 2019, Accepted 14 Jan 2020, Published online: 03 Feb 2020

References

  • Baral, C., O. Fuentes, and V. Kreinovich. 2018.“Why Deep Neural Networks: A Possible Theoretical Explanation”. In Constraint Programming and Decision Making: Theory and Applications, edited by M. Ceberio and V. Kreinovich, 1–6. Cham, Switzerland: Springer. http://www.cs.utep.edu/vladik/2015/tr15-55.pdf
  • Bromley, J., J. W. Bentz, L. Bottou, I. Guyon, Y. LeCun, C. Moore, and R. Shah. 1993. “Signature Verification Using a “Siamese” Time Delay Neural Network.” International Journal of Pattern Recognition and Artificial Intelligence 7 (04): 669–688. doi:10.1142/S0218001493000339.
  • Goodfellow, I., J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, 2014. “Generative Adversarial Nets.” Advances in Neural Information Processing Systems 27 (NIPS’14), Montreal, Quebec, Canada, December 8–13, 2672–2680.
  • Goodfellow, I., Y. Bengio, and A. Courville. 2016. Deep Learning. Cambridge, MA: MIT Press.
  • Grave, A., M. Liwicki, S. Fernandez, R. Bertolami, H. Bunke, and J. Schmidhuber. 2009. “A Novel Connectionist System for Improved Unconstrained Handwriting Recognition.” IEEE Transactions on Pattern Analysis and Machine Intelligence 31 (5): 855–868. doi:10.1109/TPAMI.2008.137.
  • He, K., G. Gkioxari, P. Dollar, and R. Girshick. 2017. “Mask R-CNN.” Proc. International Conference on Computer Vision (ICCV), Venice, Italy, 2980–2988.
  • He, K., X. Zhang, S. Ren, and J. Sun. 2015. “Delving Deep into Rectifiers: Surpassing Human-level Performance on ImageNet Classification.” IEEE International Conference on Computer Vision (ICCV), Las Condes, Santiago, Chile, 1026–1034.
  • Hermans, A., L. Beyer, and B. Leibe. 2017. “In Defence of the Triplet Loss for Person Re-identification.” In CoRR. arXiv:abs/1703.07737. Ithaca, NY: Cornell University. https://arxiv.org/abs/1703.07737
  • Hinton, G., and R. Salakhutdinov. 2006. “Reducing the Dimensionality of Data with Neural Networks.” Science 313 (5786): 504–507. doi:10.1126/science.1127647.
  • Hinton, G., S. Osindero, and Y. Teh. 2006. “A Fast Learning Algorithm for Deep Belief Nets.” Neural Computation 18: 1527–1554. doi:10.1162/neco.2006.18.7.1527.
  • Holschneider, M., R. Kronland-Martinet, J. Morlet, and P. Tchamitchian. 1990. “A Real-time Algorithm for Signal Analysis with the Help of the Wavelet Transform.” In Wavelets, edited by J. M. Combres, A. Grossmann, and P. Tchamitchian, 286–297. Berlin, Heidelberg: Springer.
  • Kreinovich, V., and C. Quintana. 1991. “Neural Networks: What Non-linearity to Choose?” Proceedings of the 4th University of New Brunswick Artificial Intelligence Workshop, Fredericton, New Brunswick, 627–637.
  • Krizhevsky, A., I. Sutskever, and G. E. Hinton. 2012. “ImageNet Classification with Deep Convolutional Neural Networks.” Advances in Neural Information Processing Systems 25 (NIPS’12), Lake Tahoe, NV, 1097–1105.
  • Landrieu, L., and M. Simonovsky. 2018. “Large-scale Point Cloud Semantic Segmentation with Superpoint Graphs.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT.
  • LeCun, Y. 1987. “Modèles connexionnistes de l’apprentissage.” Thèse de Doctorat, Université Paris 6.
  • LeCun, Y., B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, and L. D. Jackel. 1989. “Handwritten Digit Recognition with a Back-propagation Network.” 2nd International Conference on Neural Information Processing Systems (NIPS’89), Denver, CO, 396–404.
  • LeCun, Y., and Y. Bengio. 1998. Convolutional Networks for Images, Speech, and Time Series, the Handbook of Brain Theory and Neural Networks. Cambridge, MA: MIT Press.
  • Long, J., E. Shelhamer, and T. Darrell. 2015. “Fully Convolutional Networks for Semantic Segmentation.” IEEE Computer Vision and Pattern Recognition (CVPR ‘15), Boston, MA.
  • Lowe, D. G. 2004. “Distinctive Image Features from Scale-invariant Keypoints.” International Journal of Computer Vision 60 (2): 91–110. doi:10.1023/B:VISI.0000029664.99615.94.
  • McCulloch, W., and W. Pitts. 1943. “A Logical Calculus of the Ideas Immanent in Nervous Activity.” Bulletin of Mathematical Biophysics 5: 115–133. doi:10.1007/BF02478259.
  • Minsky, M., and S. Papert. 1969. Perceptrons. Cambridge, MA: MIT Press.
  • Nguyen, A., J. Yosinski, and J. Clune. 2015. “Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Images.” IEEE Computer Vision and Pattern Recognition (CVPR ‘15), Boston, MA.
  • Qi, C. R., H. Su, K. Mo, and L. Guibas. 2016. “PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation.” IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV.
  • Ren, S., K. He, R. Girshick, and J. Sun. 2017. “Faster R-CNN: Towards Real-time Object Detection with Region Proposal Networks.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (6): 1137–1149. doi:10.1109/TPAMI.2016.2577031.
  • Ronneberger, O., P. Fischer, and T. Brox. 2015. “U-Net: Convolutional Networks for Biomedical Image Segmentation.” 18th Int. Conference on medical image computing and computer assisted intervention, Munich, Germany.
  • Roscher, R., B. Bohn, M. F. Duarte, and J. Garcke. 2019. “Explainable Machine Learning for Scientific Insights and Discoveries.” In arXiv:1905.08883. Ithaca, NY: Cornell University.
  • Rosenblatt, F. 1958. “The Perceptron. A Probabilistic Model for Information Storage and Organization in the Brain.” Psychological Reviews 65: 386–408. doi:10.1037/h0042519.
  • Rummelhart, D., G. Hinton, and R. Williams. 1986. “Learning Representations by Back-propagating Errors.” Nature 323: 533–536. doi:10.1038/323533a0.
  • Russakovsky, O., J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, et al. 2015. “ImageNet Large Scale Visual Recognition Challenge.” International Journal of Computer Vision 115 (3): 211–252. doi:10.1007/s11263-015-0816-y.
  • Tzeng, E., J. Hoffman, K. Saenko, and T. Darrell. 2017. “Adversarial Discriminative Domain Adaptation.” Proc.IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, July 21–26.
  • Weinberger, K. Q., and L. K. Saul. 2009. “Distance Metric Learning for Large Margin Nearest Neighbor Classification.” Journal of Machine Learning Research 10: 207–244.
  • Yosinski, J., J. Clune, Y. Bengio, and H. Lipson. 2014. “How Transferable are Features in Deep Neural Networks?” Advances in Neural Information Processing Systems 27 (NIPS’14), Montreal, Quebec, Canada, December 8–13.
  • Yu, F., and V. Koltun. 2016. “Multi-Scale Context Aggregation by Dilated Convolutions.” 4th International Conference on Learning Representations, Caribe Hilton, San Juan, Puerto Rico, May 2–4.
  • Zbontar, J., and Y. LeCun. 2015. “Computing the Stereo Matching Cost with a Convolutional Neural Network.” CVPR 1592–1599. doi:10.1109/CVPR.2015.7298767.
  • Zhu, X., D. Tuia, L. Mou, G. Xia, L. Zhang, F. Xu, and F. Fraundorfer. 2017. “Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources.” IEEE GRSS Magazine 5 (4): 8–36.

IPI contributions

  • Albert L., Rottensteiner F., and Heipke C. 2017. “A Higher Order Conditional Random Field Model for Simultaneous Classification of Land Cover and Land Use.” ISPRS Journal for Photogrammetry and Remote Sensing 130 (2017): 63–80.
  • Blott G., Yu J., and Heipke C. 2019. “Multi-View Person Re-Identification in a Fisheye Camera Network with Different Viewing Directions.” PFG. doi:10.1007/s41064-019-00083-y.
  • Blott G., Takami M., and Heipke C. 2018. “Semantic Segmentation of Fisheye Images.” Computer Vision – ECCV 2018 Workshops Part I – 6th Workshop on Computer Vision for Road Scene Understanding and Autonomous Driving, Springer LNCS 11,129, Cham, 181–196.
  • Chen L., Rottensteiner F., and Heipke C. 2016. “Invariant Descriptor Learning Using a Siamese Convolutional Neural Network.” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences III-3, Prague, Czech Republic, July 12–19.
  • Clermont D., Kruse C., Rottensteiner F., and Heipke C. 2019. “Supervised Detection of Bomb Craters in Historical Aerial Images Using Convolutional Neural Networks.” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLII-2/W16: 67–74. doi:10.5194/isprs-archives-XLII-2-W16-67-2019.
  • Coenen M., Rottensteiner F., and Heipke C. 2019. “Precise Vehicle Reconstruction for Autonomous Driving Applications.” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences IV-2/W5: 21–28. doi:10.5194/isprs-annals-IV-2-W5-21-2019.
  • Dorozynski M., Clermont D., and Rottensteiner F., 2019. “Multi-task Deep Learning with Incomplete Training Samples for the Image-based Prediction of Variables Describing Silk Fabrics.” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences IV-2/W6: 47–54.
  • i.c.sens. 2019. Accessed 20 November 2019. https://www.icsens.uni-hannover.de/start.html?&L=1
  • Kang J., Chen L., Deng F., and Heipke C. 2019. “Context Pyramidal Network for Stereo Matching Regularized by Disparity Gradients.” ISPRS Journal of Photogrammetry and Remote Sensing 157 (2019): 201–215.
  • Mehltretter M., and Heipke C. 2019. “CNN-based Cost Volume Analysis as Confidence Measure for Dense Matching.” ICCV Workshop on 3D Reconstruction in the Wild (3DRW2019). http://openaccess.thecvf.com/content_ICCVW_2019/papers/3DRW/Mehltretter_CNN-Based_Cost_Volume_Analysis_as_Confidence_Measure_for_Dense_Matching_ICCVW_2019_paper.pdf
  • Nguyen U., Rottensteiner F., and Heipke C. 2019. “Confidence-aware Pedestrian Tracking Using a Stereo Camera.” ISPRS Annals IV-2/W5, Enschede, The Netherlands, June 10–14, 53–60.
  • SILKNOW. 2019. Accessed 20 November 2019. http://silknow.eu/
  • Wittich D., and Rottensteiner F. 2019. “Adversarial Domain Adaptation for the Classification of Aerial Images and Height Data Using Convolutional Neural Networks.” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences IV-2/W7: 197–204.
  • Yang C., Rottensteiner F., and Heipke C. 2018. “Classification of Land Cover and Land Use Based on Convolutional Neural Networks.” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences IV-3: 251–258. doi:10.5194/isprs-annals-IV-3-251-2018.
  • Yang C., Rottensteiner F., and Heipke C. 2019. “Classification of Land Cover and Land Use Based on Convolutional Neural Networks.” ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences III-3: 251–258.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.