Automatic Detection and 3D Reconstruction of Buildings from Historical Maps

References

• Affara, L., L. Nan, B. Ghanem, and P. Wonka. 2016. Large scale asset extraction for urban images. Proceedings of the European Conference on Computer Vision, Amsterdam, Netherlands, 437–34.
   Google Scholar
• ArcGIS CityEngine. 2023. Computer Software. ESRI, 1. https://www.esri.com/es-es/arcgis/products/arcgis-cityengine/overview.
   Google Scholar
• Arikan, M. 2013. O-Snap: Automatic polygonal reconstruction with interactive refinement. [Publisher Name].
   Google Scholar
• Balletti, C., and F. Guerra. 2016. Historical maps for 3D digital city’s history. Cartographica: The International Journal for Geographic Information & Geovisualization 51 (3):115–26. doi:10.3138/cart.51.3.3140.
   Google Scholar
• Billen, R., A.-F. Cutting-Decelle, O. Marina, J.-P. De Almeida, M. C. G. Falquet, T. Leduc, C. Métral, G. Moreau, J. Perret, et al. 2014. 3D city models and urban information: Current issues and perspectives: European COST action TU0801. In 3D city models and urban information: Current issues and perspectives – European COST action TU0801, ed. R. Billen and S. Zlatanova, I–118. Les Ulis, France: EDP Sciences. doi:10.1051/TU0801/201400001.
   Google Scholar
• Braun, G. 1965. Civitates orbis terrarum (vols. 1 and 2). apud auctores.
   Google Scholar
• Chiang, Y., W. Duan, S. Leyk, J. Uhl, and C. Knoblock. 2020. Using historical maps in scientific studies: Challenges and best practices. Cham, Switzerland: Springer. doi:10.1007/978-3-319-66908-3.
   Google Scholar
• Chiang, Y. Y., and C. A. Knoblock. 2013. A general approach for extracting road vector data from raster maps. IJDAR 16 (1):55–81. doi:10.1007/s10032-011-0177-1.
   Web of Science ®Google Scholar
• Chiang, Y.-Y., S. Leyk, and C. A. Knoblock. 2014. A survey of digital map processing techniques. ACM Computing Surveys 47 (1):1–44. doi:10.1145/2557423.
   Web of Science ®Google Scholar
• Cioranescu, A. 1965. La Laguna: Guía histórica y monumental. San Cristobal de La Laguna: Ayuntamiento de San Cristobal de la Laguna.
   Google Scholar
• Cohen, A., M. R. Oswald, Y. Liu, and M. Pollefeys. 2017. Symmetry-aware façade parsing with Occlusions. 2017 International Conference on 3D Vision (3DV), 393–401. doi:10.1109/3DV.2017.00052.
   Google Scholar
• Drolias, G. C., and N. Tziokas. 2020. Building footprint extraction from historic maps utilizing automatic vectorisation methods in open source GIS software. Automatic Vectorisation of Historical Maps: International Workshop Organized by the ICA Commission on Cartographic Heritage into the Digital. Budapest – 13 March, 2020, 9–17. doi:10.21862/avhm2020.01.
   Google Scholar
• Duan, W., Y.-Y. Chiang, C. A. Knoblock, S. Leyk, and J. H. Uhl. 2018. Automatic generation of precisely delineated geographic features from georeferenced historical maps using deep learning. The 22nd International Research Symposium on Computer-Based Cartography and GIScience (Autocarto/UCGIS). https://www.ucgis.org/assets/docs/AutoCarto-UCGIS%202018%20Proceedings.pdf.
   Google Scholar
• Feng, C., Y. Zhong, Y. Gao, M. R. Scott, and W. Huang. 2021. TOOD: Task-aligned one-stage object detection. CoRR, abs/2108.07755.
   Google Scholar
• Gede, M., V. Árvai, G. Vassányi, Z. Supka, E. Szabó, A. Bordács, C. G. Varga, and K. Irás. 2020. Automatic vectorisation of old maps using QGIS – tools, possibilities and challenges. In Automatic vectorisation of historical maps, ed. I. Krisztina, 39–45. Budapest: ELTE Eötvös Loránd University.
   Google Scholar
• Gobbi, S., M. Ciolli, N. La Porta, D. Rocchini, C. Tattoni, and P. Zatelli. 2019. New tools for the classification and filtering of historical maps. ISPRS International Journal of Geo-Information 8 (10):455. doi:10.3390/ijgi8100455.
   Web of Science ®Google Scholar
• Gordo, A. G., and T. D. Zamudio. 2019. Sevilla extramuros en el siglo XVI: tres vistas del Civitates Orbis Terrarum. Boletín de la Asociación de Geógrafos Españoles 80:1–28.
   Google Scholar
• Gruen, A., S. Schubiger, R. Qin, G. Schrotter, B. Xiong, J. Li, X. Ling, C. Xiao, S. Yao, and F. Nuesch. 2019. Semantically enriched high resolution LOD 3 building model generation. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLII-4/W15:11–18. doi:10.5194/isprs-archives-XLII-4-W15-11-2019.
   Google Scholar
• Haegler, S., P. Müller, and L. Van Gool. 2009. Procedural modeling for digital cultural heritage. EURASIP Journal on Image and Video Processing 2009:1–1. doi:10.1155/2009/852392.
   Google Scholar
• Han, F., and S.-C. Zhu. 2009. Bottom-up/top-down image parsing with attribute grammar. IEEE Transactions on Pattern Analysis & Machine Intelligence 31 (1):59–73. doi:10.1109/TPAMI.2008.65.
   PubMed Web of Science ®Google Scholar
• Harris, C. R., K. J. Millman, S. J. Van Der Walt, R. Gommers, P. Virtanen, D. Cournapeau, E. Wieser, J. Taylor, S. Berg, N. J. Smith, et al. 2020. Array programming with NumPy. Nature 585 (7825):357–62. doi:10.1038/s41586-020-2649-2.
   PubMed Web of Science ®Google Scholar
• Heitzler, M., and L. Hurni. 2020. Cartographic reconstruction of building footprints from historical maps: A study on the Swiss Siegfried map. Transactions in GIS 24 (2):442–61. doi:10.1111/tgis.12610.
   Web of Science ®Google Scholar
• Hensel, S., S. Goebbels, and M. Kada. 2019. Facade reconstruction for textured lod2 citygml models based on deep learning and mixed integer linear programming. ISPRS Annals of the Photogrammetry, Remote Sensing & Spatial Information Sciences 4:37–44. doi:10.5194/isprs-annals-IV-2-W5-37-2019.
   Google Scholar
• Herold, H. 2018. Geoinformation from the past. Springer Fachmedien Wiesbaden. doi:10.1007/978-3-658-20570-6.
   Google Scholar
• Herold, H., and R. Hecht. 2017. 3D reconstruction of urban history based on old maps. In Digital research and education in architectural heritage, ed. S. Munster, 63–79. Cham, Switzerland: Springer.
   Google Scholar
• Herrault, P. A., D. Sheeren, M. Fauvel, and M. Paegelow. 2013. Automatic extraction of forests from historical maps based on unsupervised classification in the CIELab color space. In Geographic information science at the heart of Europe: Lecture notes in Geoinformation and cartography, ed. D. Vandenbroucke, B. Bucher, and J. Crompvoets. Springer. doi:10.1007/978-3-319-00615-4_6.
   Google Scholar
• Holzmann, T. 2017. Hybrid method for 3D and plane-based Urban Reconstruction. [Publisher Name].
   Google Scholar
• Hu, H., L. Wang, M. Zhang, Y. Ding, and Q. Zhu. 2020. Fast and regularized reconstruction of building faÇades from street-view images using binary integer programming. ISPRS Annals of the Photogrammetry, Remote Sensing & Spatial Information Sciences V-2-2020:365–71. doi:10.5194/isprs-annals-V-2-2020-365-2020.
   Google Scholar
• Ignjatić, J., B. Nikolić, and A. Rikalović. 2018. Deep learning for historical cadastral maps digitization: Overview, challenges and potential. https://otik.uk.zcu.cz/handle/11025/34636.
   Google Scholar
• Instituto Geográfico Nacional. 2022. Madrid. Planos de población. (1656). 1881. Instituto Geográfico Nacional - Servicio de Documentación, January 13. https://www.ign.es/web/catalogo-cartoteca/resources/html/001488.html.
   Google Scholar
• Iosifescu, I., A. Tsorlini, and L. Hurni. 2016. Towards a comprehensive methodology for automatic vectorization of raster historical maps. E-Perimetron 11:57–76.
   Google Scholar
• Jiang, H., L. Nan, D.-M. Yan, W. Dong, X. Zhang, and P. Wonka. 2016. Automatic constraint detection for 2D layout regularization. IEEE Transactions on Visualization and Computer Graphics 22 (8):1933–44. doi:10.1109/TVCG.2015.2480059.
   PubMed Web of Science ®Google Scholar
• Jiao, C., M. Heitzler, and L. Hurni. 2020. Extracting wetlands from Swiss historical maps with convolutional neural networks. In Automatic vectorisation of historical maps, ed. I. Krisztina, 33–38. Budapest: ELTE Eötvös Loránd University.
   Google Scholar
• Jocher, G., A. Chaurasia, and J. Qiu. 2023. Ultralytics YOLOv8 (8.0.0) [computer software]. https://github.com/ultralytics/ultralytics.
   Google Scholar
• Karabork, H., and E. Aktas. 2018. The international archives of the photogrammetry, remote sensing and spatial information sciences. 1716–23.
   Google Scholar
• Kargas, A., G. Loumos, and D. Varoutas. 2019. Using different ways of 3D reconstruction of historical cities for gaming purposes: The case study of Nafplio. Heritage 2 (3):1799–811. Article 3. doi:10.3390/heritage2030110.
   Google Scholar
• Kersten, T. P., F. Keller, J. Saenger, and J. Schiewe. 2012. Automated generation of an historic 4D city model of Hamburg and its visualisation with the GE engine. Euro-Mediterranean Conference, Lemessos, Cyprus, 55–65.
   Google Scholar
• Khan, K., S. U. Rehman, K. Aziz, S. Fong, and S. Sarasvady. 2014. DBSCAN: Past, present and future. The Fifth International Conference on the Applications of Digital Information and Web Technologies (ICADIWT 2014), 232–38. https://ieeexplore.ieee.org/abstract/document/6814687/.
   Google Scholar
• Kluger, F., H. Ackermann, M. Y. Yang, and B. Rosenhahn. 2017. Deep learning for vanishing point detection using an inverse gnomonic projection. Proceedings of the German Conference on Pattern Recognition, Basel, Switzerland, 17–28.
   Google Scholar
• Larraz Mora, A. 2008. A vista de oficiales ya su contento. Tipología y sistemas constructivos de la vivienda en La Laguna y Tenerife a raíz de la Conquista (1497–1526). La Laguna. Tenerife: Instituto de Estudios Canarios.
   Google Scholar
• Lee, G. A., A. Dünser, S. Kim, and M. Billinghurst. 2012. CityViewAR: A mobile outdoor AR application for city visualization. 2012 IEEE International Symposium on Mixed and Augmented Reality-Arts, Media, and Humanities (ISMAR-AMH), Atlanta, USA, 57–64.
   Google Scholar
• Lee, S. C., and R. Nevatia. 2004. Extraction and integration of window in a 3D building model from ground view images. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004., vol. 2, II–II. https://ieeexplore.ieee.org/abstract/document/1315152/.
   Google Scholar
• Li, C.-K., H.-X. Zhang, J.-X. Liu, Y.-Q. Zhang, S.-C. Zou, and Y.-T. Fang. 2020. Window detection in facades using heatmap fusion. Journal of Computer Science and Technology 35 (4):900–12. doi:10.1007/s11390-020-0253-4.
   Web of Science ®Google Scholar
• Li, H., J. Liu, and X. Zhou. 2018. Control of higher order harmonics and spurious modes for microstrip patch antennas. Institute of Electrical and Electronics Engineers Access 6:34158–65. doi:10.1109/ACCESS.2018.2823501.
   Google Scholar
• Li, X., W. Wang, L. Wu, S. Chen, X. Hu, J. Li, J. Tang, and J. Yang. 2020. Generalized focal loss: Learning qualified and distributed bounding boxes for dense object detection. CoRR. abs/2006.04388.
   Google Scholar
• Lienhard, S. 2024. Shapeml [C++]. https://github.com/stefalie/shapeml.
   Google Scholar
• Liu, C. 2011. Automatic facade image rectification and extraction using line segment features. VISAPP 104–11. https://www.scitepress.org/Papers/2011/33164/33164.pdf.
   Google Scholar
• Liu, C., J. Wu, P. Kohli, and Y. Furukawa. 2017. Raster-to-vector: Revisiting floorplan transformation. Proceedings of the IEEE International Conference on Computer Vision, 2195–203. http://openaccess.thecvf.com/content_iccv_2017/html/Liu_Raster-To-Vector_Revisiting_Floorplan_ICCV_2017_paper.html.
   Google Scholar
• Liu, S., L. Qi, H. Qin, J. Shi, and J. Jia. 2018. Path aggregation network for instance segmentation. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 8759–68. doi:10.1109/CVPR.2018.00913.
   Google Scholar
• Liu, T., P. Xu, and S. Zhang. 2019. A review of recent advances in scanned topographic map processing. Neurocomputing 328:75–87. doi:10.1016/j.neucom.2018.02.102.
   Web of Science ®Google Scholar
• Loran, C., S. Haegi, and C. Ginzler. 2018. Comparing historical and contemporary maps—A methodological framework for a cartographic map comparison applied to Swiss maps. IJGIS 32 (11):2123–2139. doi:10.1080/13658816.2018.1482553.
   Web of Science ®Google Scholar
• Mathias, M., A. Martinović, and L. Van Gool. 2016. ATLAS: A three-layered approach to facade parsing. International Journal of Computer Vision 118 (1):22–48. doi:10.1007/s11263-015-0868-z.
   Web of Science ®Google Scholar
• Miao, Q., P. Xu, X. Li, J. Song, W. Li, and Y. Yang. 2017. The recognition of the point symbols in the scanned topographic maps. IEEE Transactions on Image Processing 26 (6):2751–66. doi:10.1109/TIP.2016.2613409.
   PubMed Web of Science ®Google Scholar
• Micusik, B., H. Wildenauer, and J. Kosecka. 2008. Detection and matching of rectilinear structures. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, USA, 1–7.
   Google Scholar
• Morlighem, C., A. Labetski, and H. Ledoux. 2022. Reconstructing historical 3D city models. Urban Informatics 1 (1), Article 1. 10.1007/s44212-022-00011-3.
   PubMedGoogle Scholar
• Müller, P., P. Wonka, S. Haegler, A. Ulmer, and L. Van Gool. 2006. Procedural modeling of buildings. ACM SIGGRAPH 2006 Papers, 614–23.
   Google Scholar
• Nan, L., C. Jiang, B. Ghanem, and P. Wonka. 2015. Template assembly for detailed urban reconstruction. Computer Graphics Forum 34 (2):217–28. doi:10.1111/cgf.12554.
   Web of Science ®Google Scholar
• Nava, F. P., I. S. Berriel, A. P. Nava, V. G. Rodríguez, and J. P. Morera. 2022. Promoting the heritage of the city of San Cristobal de La Laguna through a temporal link with a 16th century map. Virtual Archaeology Review 13 (26):62–75. Article 26. doi:10.4995/var.2022.15322.
   Web of Science ®Google Scholar
• Navarro Segura, M. I. 1999. La Laguna 1500: La ciudad-república. Una utopía insular según“Las leyes” de Platón. San Cristóbal de La Laguna: Ayuntamiento de San Cristóbal de La Laguna.
   Google Scholar
• Neuhausen, M., and M. König. 2018. Automatic window detection in facade images. Automation in Construction 96:527–39. doi:10.1016/j.autcon.2018.10.007.
   Web of Science ®Google Scholar
• Neuhausen, M., M. Obel, A. Martin, P. Mark, and M. König. 2018. Window detection in facade images for risk assessment in tunneling. Visualization in Engineering 6 (1):1. doi:10.1186/s40327-018-0062-9.
   Google Scholar
• Oliveira, S. A., F. Kaplan, and I. D. Lenardo. 2017. Machine vision algorithms on cadaster plans. Digital humanities conference. https://api.semanticscholar.org/CorpusID:33631441.
   Google Scholar
• Pérez Nava, F., I. Sánchez Berriel, J. Pérez Morera, N. Martín Dorta, C. Meier, and J. Hernández Rodríguez. 2023. From maps to 3D models: Reconstructing the urban landscape of San Cristóbal de La Laguna in the 16th Century. Applied Sciences 13 (7):4293. doi:10.3390/app13074293.
   Google Scholar
• Pezeshk, A., and R. L. Tutwiler. 2011. Automatic feature extraction and text recognition from scanned topographic maps. IEEE Transactions on Geoscience & Remote Sensing 49 (12):5047–63. doi:10.1109/TGRS.2011.2157697.
   Web of Science ®Google Scholar
• Prusinkiewicz, P., and A. Lindenmayer. 1990. The algorithmic beauty of plants. Springer New York. doi:10.1007/978-1-4613-8476-2.
   Google Scholar
• Rahmani, K., and H. Mayer. 2022. A hybrid method for window detection on high resolution facade images. In Intelligent systems and pattern recognition, ed. A. Bennour, T. Ensari, Y. Kessentini, and S. Eom, vol. 1589, 43–50. Springer International Publishing. doi:10.1007/978-3-031-08277-1_4.
   Google Scholar
• Range, K. 2024. Brief summary of YOLOv8 model structure. https://github.com/ultralytics/ultralytics/issues/189.
   Google Scholar
• Redmon, J., and A. Farhadi. 2018. YOLOv3: An incremental improvement. CoRR, Abs/1804.02767. http://arxiv.org/abs/1804.02767.
   Google Scholar
• Riche, M. 2020. Identifying building footprints in historic map data using OpenCV and PostGIS. In Automatic vectorisation of historical maps, ed. I. Krisztina, 19–31. Budapest: ELTE Eötvös Loránd University.
   Google Scholar
• Sánchez Berriel, I., F. Pérez Nava, and P. T. Albertos. 2023. LagunAR: A city-scale Mobile outdoor augmented reality application for heritage dissemination. Sensors 23 (21):8905. Article 21. doi:10.3390/s23218905.
   PubMed Web of Science ®Google Scholar
• Schlegel, I. 2023. A holistic workflow for semi-automated object extraction from large-scale historical maps. KN - Journal of Cartography and Geographic Information 73 (1):3–18. doi:10.1007/s42489-023-00131-z.
   Google Scholar
• Sedlacek, D., and J. Zara. 2009. Graph cut based point-cloud segmentation for polygonal reconstruction. International Symposium on Visual Computing, Las Vegas, USA, 218–27.
   Google Scholar
• Stiny, G. 1975. Pictorial and formal aspects of shape and shape grammars. Birkhäuser Basel. doi:10.1007/978-3-0348-6879-2.
   Google Scholar
• Tardif, J. 2009. Non-iterative approach for fast and accurate vanishing point detection. Proceedings of the IEEE 12th International Conference on Computer Vision, Kyoto, Japan, 1250–57.
   Google Scholar
• Teboul, O., I. Kokkinos, L. Simon, P. Koutsourakis, and N. Paragios. 2013. Parsing facades with shape grammars and reinforcement learning. IEEE Transactions on Pattern Analysis & Machine Intelligence 35 (7):1744–56. doi:10.1109/TPAMI.2012.252.
   PubMed Web of Science ®Google Scholar
• Terven, J., D.-M. Córdova-Esparza, and J.-A. Romero-González. 2023. A comprehensive review of YOLO architectures in computer vision: From YOLOv1 to YOLOv8 and YOLO-NAS. Machine Learning and Knowledge Extraction 5 (4):1680–716. doi:10.3390/make5040083.
   Google Scholar
• Tomljenovic, I., B. Höfle, D. Tiede, and T. Blaschke. 2015. Building extraction from airborne laser scanning data: An analysis of the state of the art. Remote Sensing 7 (4):3826–62. doi:10.3390/rs70403826.
   Web of Science ®Google Scholar
• Torriani, L. 1590a. Alla Maesta del Re Catolico, descrittione et historia del regno de l’isole Canarie gia dette le Fortvnate con il parere delle loro fortificationi. https://am.uc.pt/item/46770.
   Google Scholar
• Torriani, L. 1590b. Alla Maesta del Re Catolico, descrittione et historia del regno de l’isole Canarie gia dette le Fortvnate con il parere delle loro fortificationi—Digital Version. am.uc.pt. https://am.uc.pt/item/46770.
   Google Scholar
• Tyleček, R., and R. Šára. 2013. Spatial pattern templates for recognition of objects with regular structure. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 8142 LNCS, 364–74.
   Google Scholar
• Uhl, J. H. 2019. ProQuest dissertations and theses. PhD diss., University of Colorado at Boulder. Spatio-temporal information extraction under uncertainty using multi-source data integration and machine learning: Applications to human settlement modelling (2303837500). ProQuest Dissertations & Theses Global.
   Google Scholar
• Uhl, J. H., and W. Duan. 2021. Automating information extraction from large historical topographic map archives: New opportunities and challenges. In Handbook of big geospatial data, ed. M. Werner and Y.-Y. Chiang, 509–22. Springer International Publishing. https://www.proquest.com/dissertations-theses/spatio-temporal-information-extraction-under/docview/2303837500/se-2?accountid=27689 doi:10.1007/978-3-030-55462-0_20.
   Google Scholar
• Wildenauer, H., and A. Hanbury. 2012. Robust camera self-calibration from monocular images of Manhattan worlds. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, USA, 2831–38.
   Google Scholar
• Wu, C., J.-M. Frahm, and M. Pollefeys. 2010. Detecting large repetitive structures with salient boundaries. Proceedings of the ECCV, Heraklion, Crete, 142–55.
   Google Scholar
• Xiao, J., T. Fang, P. Zhao, L. Quan, and M. Lhuillier. 2009. Image-based street-side city modeling. ACM Transactions on Graphics 28 (5):1–12. doi:10.1145/1618452.1618460.
   Web of Science ®Google Scholar
• Xydas, C., A. Kesidis, K. Kalogeropoulos, and A. Tsatsaris. 2022. Buildings extraction from historical topographic maps via a deep convolution neural network. Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 485–92. doi:10.5220/0010839700003124.
   Google Scholar
• Zatelli, P., S. Gobbi, C. Tattoni, N. Porta, and M. Ciolli. 2019. Object-based image analysis for historic maps classification. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XLII-4/W14:247–54. doi:10.5194/isprs-archives-XLII-4-W14-247-2019.
   Google Scholar
• Zhai, M., S. Workman, and N. Jacobs. 2016. Detecting vanishing points using global image context in a non-Manhattan world. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, USA, 5657–65.
   Google Scholar
• Zhang, X., and D. Aliaga. 2022. RFCNet: Enhancing urban segmentation using regularization, fusion, and completion. Computer Vision and Image Understanding 220:103435. doi:10.1016/j.cviu.2022.103435.
   Web of Science ®Google Scholar
• Zheng, Z., P. Wang, W. Liu, J. Li, R. Ye, and D. Ren. 2019. Distance-IoU loss: Faster and better learning for bounding box regression. CoRR. abs/1911.08287.
   Google Scholar
• Zhu, Q., M. Zhang, H. Hu, and F. Wang. 2020. Interactive correction of a distorted street-view panorama for efficient 3-D façade modeling. IEEE Geoscience & Remote Sensing Letters 17 (12):2125–29. doi:10.1109/LGRS.2019.2962696.
   Web of Science ®Google Scholar