1,977
Views
6
CrossRef citations to date
0
Altmetric
Review Article

Extraction and analysis of natural disaster-related VGI from social media: review, opportunities and challenges

ORCID Icon, ORCID Icon & ORCID Icon
Pages 1275-1316 | Received 17 Feb 2021, Accepted 27 Feb 2022, Published online: 21 Mar 2022

References

  • Abed Al Ahad, M., et al., 2020. The effect of air-pollution and weather exposure on mortality and hospital admission and implications for further research: a systematic scoping review. PLoS One, 15 (10), e0241415.
  • Ahmad, K., et al., 2017a. CNN and GAN based satellite and social media data fusion for disaster detection. In: Working notes proceedings of the MediaEval 2017 workshop, Dublin, Ireland, 13–15 September 2017.
  • Ahmad, K., et al., 2018. A comparative study of global and deep features for the analysis of user-generated natural disaster related images. In: 2018 IEEE 13th image, video, and multidimensional signal processing workshop (IVMSP). New York: IEEE, 1–5.
  • Ahmad, S., et al., 2017b. Convolutional neural networks for disaster images retrieval. In: Working notes proceedings of the MediaEval 2017 workshop, Dublin, Ireland, 13–15 September 2017.
  • Alam, F., et al., 2018a. A Twitter tale of three hurricanes: Harvey, Irma, and Maria. In: Proceedings of the international ISCRAM conference, Rochester, UK, 20–23 May 2018, 553–572.
  • Alam, F., et al., 2020b. Deep learning benchmarks and datasets for social media image classification for disaster response. arXiv preprint arXiv:2011.08916.
  • Alam, F., et al., 2020c. Standardizing and benchmarking crisis-related social media datasets for humanitarian information processing. arXiv preprint arXiv:2004.06774.
  • Alam, F., et al., 2021. Humaid: human-annotated disaster incidents data from twitter. In: 15th International conference on web and social media (ICWSM).
  • Alam, F., Imran, M., and Ofli, F., 2017. Image4act: Online social media image processing for disaster response. In: Proceedings of the 2017 IEEE/ACM international conference on advances in social networks analysis and mining 2017, Sydney, Australia, 31 July – 3 August 2017, 601–604.
  • Alam, F., Joty, S., and Imran, M., 2018b. Graph based semi-supervised learning with convolution neural networks to classify crisis related tweets. In: Proceedings of the international AAAI conference on web and social media, Palo Alto, CA, 25–28 June 2018, vol. 12, 556–559.
  • Alam, F., Ofli, F., and Imran, M., 2018c. Crisismmd: multimodal Twitter datasets from natural disasters. In: Proceedings of the international AAAI conference on web and social media, Palo Alto, CA, 25–28 June 2018, vol. 12, 465–473.
  • Alam, F., Ofli, F., and Imran, M., 2018d. Processing social media images by combining human and machine computing during crises. International Journal of Human–Computer Interaction, 34 (4), 311–327.
  • Alam, F., Ofli, F., and Imran, M., 2020a. Descriptive and visual summaries of disaster events using artificial intelligence techniques: case studies of hurricanes Harvey, Irma, and Maria. Behaviour & Information Technology, 39 (3), 288–318.
  • Ankerst, M., et al., 1999. Optics: ordering points to identify the clustering structure. ACM SIGMOD Record, 28 (2), 49–60.
  • Assumpção, T.H., et al., 2018. Citizen observations contributing to flood modelling: opportunities and challenges. Hydrology and Earth System Sciences, 22 (2), 1473–1489.
  • Aulov, O., Price, A., and Halem, M., 2014. Asonmaps: a platform for aggregation visualization and analysis of disaster related human sensor network observations. In: ISCRAM 2014 Conference Proceedings, University Park, PA, 1 May 2014, 802–806.
  • Avgerinakis, K., et al., 2017. Visual and textual analysis of social media and satellite images for flood detection@ multimedia satellite task mediaeval 2017. In: Working notes proceedings of the MediaEval 2017 workshop, Dublin, Ireland, 13–15 September 2017.
  • Beigi, G., et al., 2016. An overview of sentiment analysis in social media and its applications in disaster relief. In: W. Pedrycz and S.-M. Chen, eds. Sentiment analysis and ontology engineering. Cham: Springer, 313–340.
  • Berlyand, Y., et al., 2018. How artificial intelligence could transform emergency department operations. The American Journal of Emergency Medicine, 36 (8), 1515–1517.
  • Bischke, B., et al., 2016. Contextual enrichment of remote-sensed events with social media streams. In: Proceedings of the 24th ACM international conference on Multimedia, Amsterdam, Netherlands, 15–19 October 2016, 1077–1081.
  • Bischke, B., et al., 2017a. Detection of flooding events in social multimedia and satellite imagery using deep neural networks. In: Working notes proceedings of the MediaEval 2017 workshop, Dublin, Ireland, 13–15 September 2017.
  • Bischke, B., et al., 2017b. The multimedia satellite task at mediaeval 2017: emergency response for flooding events. In: Working notes proceedings of the MediaEval 2017 workshop, Dublin, Ireland, 13–15 September 2017.
  • Bischke, B., et al., 2018. The multimedia satellite task at mediaeval 2018 emergency response for flooding events. In: Working notes proceedings of the MediaEval 2018 workshop, Sophia Antipolis, France, 29–31 October 2018.
  • Bischke, B., et al., 2019. The multimedia satellite task at mediaeval 2019. In: Proceedings of the MediaEval 2019 workshop, Sophia Antipolis, France, 27–30 October 2019.
  • Blei, D.M., Ng, A.Y., and Jordan, M.I., 2003. Latent dirichlet allocation. Journal of Machine Learning Research, 3 (Jan), 993–1022.
  • Bojanowski, P., et al., 2017. Enriching word vectors with subword information. Transactions of the Association for Computational Linguistics, 5, 135–146.
  • Boulton, C., Shotton, H., and Williams, H., 2016. Using social media to detect and locate wildfires. In: Proceedings of the international AAAI conference on web and social media, Cologne, Germany, 17–20 May 2016, 178–186.
  • Brandt, K., et al., 2020. Integrating sketch mapping and hot spot analysis to enhance capacity for community-level flood and disaster risk management. The Geographical Journal, 186 (2), 198–212.
  • Caragea, C., et al., 2014. Mapping moods: geo-mapped sentiment analysis during hurricane sandy. In: ISCRAM 2014 Conference Proceedings, University Park, PA, 1 May 2014, 642–651.
  • Cattaneo, D., et al., 2019. Cmrnet: camera to LiDAR-map registration. In: 2019 IEEE intelligent transportation systems conference (ITSC). New York: IEEE, 1283–1289.
  • Cattaneo, D., Sorrenti, D.G., and Valada, A., 2020. Cmrnet++: map and camera agnostic monocular visual localization in LiDAR maps. arXiv preprint arXiv:2004.13795.
  • CBS News. 2017. Interactive map shows where Harvey flooding is worst. https://www.cbsnews.com/news/houston-harvey-u-flood-maps/?ftag=CNM-00-10aab6a&linkId=41670697 [Accessed 07 May 2021].
  • Cerutti, V., et al., 2016. Identification of disaster-affected areas using exploratory visual analysis of georeferenced tweets: application to a flood event. Helsinki, Finland: Association of Geographic Information Laboratories in Europe, 5.
  • Cervone, G., et al., 2016. Using twitter for tasking remote-sensing data collection and damage assessment: 2013 boulder flood case study. International Journal of Remote Sensing, 37 (1), 100–124.
  • Chae, J., et al., 2012. Spatiotemporal social media analytics for abnormal event detection and examination using seasonal-trend decomposition. In: 2012 IEEE conference on visual analytics science and technology (VAST). New York: IEEE, 143–152.
  • Chae, J., et al., 2014. Public behavior response analysis in disaster events utilizing visual analytics of microblog data. Computers & Graphics, 38, 51–60.
  • Chatzichristofis, S.A., and Boutalis, Y.S., 2008. Cedd: color and edge directivity descriptor: a compact descriptor for image indexing and retrieval. In: International conference on computer vision systems. Santorini, Greece, 12–15 May 2008, Cham: Springer, 312–322.
  • Chaudhary, P., et al., 2019. Flood-water level estimation from social media images. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, IV-2/W5 (2/W5), 5–12.
  • Chaudhary, P., et al., 2020. Water level prediction from social media images with a multi-task ranking approach. ISPRS Journal of Photogrammetry and Remote Sensing, 167, 252–262.
  • Chaudhry, S., and Yuksel, M., 2019. Engaging communities in public safety via social media. In: IEEE INFOCOM 2019-IEEE conference on computer communications workshops (INFOCOM WKSHPS). New York: IEEE, 560–565.
  • Chen, D.M., et al., 2011. City-scale landmark identification on mobile devices. In: CVPR 2011. New York: IEEE, 737–744.
  • Chen, S., et al., 1999. Indexing and searching structure for multimedia database systems. In: M.M. Yeung, B.-L. Yeo, and C.A. Bouman, eds. Storage and retrieval for media databases 2000. Bellingham, WA: International Society for Optics and Photonics, vol. 3972, 262–270.
  • Chowdhury, S.R., et al., 2013. Tweet4act: using incident-specific profiles for classifying crisis-related messages. In: ISCRAM 2013 Conference Proceedings. Baden-Baden, Germany, 12–15 May 2013, 834–839.
  • Craglia, M., Ostermann, F., and Spinsanti, L., 2012. Digital earth from vision to practice: making sense of citizen-generated content. International Journal of Digital Earth, 5 (5), 398–416.
  • Cresci, S., et al., 2015. Crisis mapping during natural disasters via text analysis of social media messages. In: International conference on web information systems engineering. Miami, FL, 1–3 November 2015, Cham: Springer, 250–258.
  • Crooks, A., et al., 2013. # earthquake: Twitter as a distributed sensor system. Transactions in GIS, 17 (1), 124–147.
  • Crowell, B.W., Bock, Y., and Squibb, M.B., 2009. Demonstration of earthquake early warning using total displacement waveforms from real-time GPS networks. Seismological Research Letters, 80 (5), 772–782.
  • Daly, S., and Thom, J.A., 2016. Mining and classifying image posts on social media to analyse fires. In: Proceedings of the ISCRAM 2016 Conference, Rio de Janeiro, Brazil, 1–14 May 2016.
  • Dao, M. S., and Pham, Q., 2017. A domain-based late-fusion for disaster image retrieval from social media. In: CEUR workshop proceedings. New York, NY: ACM Press, 1–3.
  • Dao, M.S., et al., 2018. A context-aware late-fusion approach for disaster image retrieval from social media. In: Proceedings of the 2018 ACM on international conference on multimedia retrieval. New York, NY: ACM, 266–273.
  • De Longueville, B., et al., 2010. Digital earth’s nervous system for crisis events: real-time sensor web enablement of volunteered geographic information. International Journal of Digital Earth, 3 (3), 242–259.
  • De Longueville, B., Smith, R.S., and Luraschi, G., 2009. “OMG, from here, I can see the flames!” a use case of mining location based social networks to acquire spatio-temporal data on forest fires. In: Proceedings of the 2009 international workshop on location based social networks. New York, NY: ACM, 73–80.
  • Deng, J., et al., 2009. Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. New York: IEEE, 248–255.
  • Devlin, J., et al., 2019. Bert: pre-training of deep bidirectional transformers for language understanding. In: NAACL HLT 2019 - 2019 conference of the North American chapter of the Association for Computational Linguistics: Human Language Technologies – Proceedings of the Conference, Minneapolis, MN, 2–7 June 2019, vol. 1, 4171–4186.
  • Dittrich, A., and Lucas, C., 2014. Is this Twitter event a disaster? In: 17th AGILE conference on geographic information science. Connecting a digital Europe through location and place, proceedings of the AGILE’2014 international conference on geographic information science, Castellón, E., 3–6 June, 2014. Ed.: J. Huerta.
  • Doggett, E., and Cantarero, A., 2016. Identifying eyewitness news-worthy events on twitter. In: Proceedings of the fourth international workshop on natural language processing for social media, Austin, TX, 1 November 2016, 7–13.
  • Dong, L., and Shan, J., 2013. A comprehensive review of earthquake-induced building damage detection with remote sensing techniques. ISPRS Journal of Photogrammetry and Remote Sensing, 84, 85–99.
  • Earle, P.S., Bowden, D.C., and Guy, M., 2011. Twitter earthquake detection: Earthquake monitoring in a social world. Annals of Geophysics, 54 (6), 708–715.
  • Eilander, D., et al., 2016. Harvesting social media for generation of near real-time flood maps. Procedia Engineering, 154, 176–183.
  • Ester, M., et al., 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the second international conference on knowledge discovery and data mining, KDD’96. Palo Alto, CA: AAAI Press, 226–231.
  • Fang, R., et al., 2016. Witness identification in twitter. In: Proceedings of the fourth international workshop on natural language processing for social media, Austin, TX, 1 November 2016, 65–73.
  • Feng, Q., Liu, J., and Gong, J., 2015. Urban flood mapping based on unmanned aerial vehicle remote sensing and random forest classifier–a case of Yuyao, China. Water, 7 (12), 1437–1455.
  • Feng, Y., Brenner, C., and Sester, M., 2020. Flood severity mapping from volunteered geographic information by interpreting water level from images containing people: a case study of Hurricane Harvey. ISPRS Journal of Photogrammetry and Remote Sensing, 169, 301–319.
  • Feng, Y., et al., 2018. Ensembled convolutional neural network models for retrieving flood relevant tweets. In: Working notes proceedings of the MediaEval 2018 workshop, Sophia Antipolis, France, 29–31 October 2018.
  • Feng, Y., and Sester, M., 2018. Extraction of pluvial flood relevant volunteered geographic information (VGI) by deep learning from user generated texts and photos. ISPRS International Journal of Geo-Information, 7 (2), 39.
  • Fohringer, J., et al., 2015. Social media as an information source for rapid flood inundation mapping. Natural Hazards and Earth System Sciences, 15 (12), 2725–2738.
  • Fuchs, G., et al., 2013. Tracing the German centennial flood in the stream of tweets: first lessons learned. In: Proceedings of the second ACM SIGSPATIAL international workshop on crowdsourced and volunteered geographic information. New York, NY: ACM, 31–38.
  • Goodchild, M.F., 2007. Citizens as sensors: the world of volunteered geography. GeoJournal, 69 (4), 211–221.
  • Goodchild, M.F., and Glennon, J.A., 2010. Crowdsourcing geographic information for disaster response: a research frontier. International Journal of Digital Earth, 3 (3), 231–241.
  • Gupta, R., et al., 2019. Creating xBD: a dataset for assessing building damage from satellite imagery. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, Long Beach, CA, 16–20 June 2019, 10–17.
  • Hanif, M., et al., 2017. Flood detection using social media data and spectral regression based kernel discriminant analysis. In: Working notes proceedings of the MediaEval 2017 workshop, Dublin, Ireland, 13–15 September 2017.
  • Hassan, S.Z., et al., 2019. Sentiment analysis from images of natural disasters. In: International conference on image analysis and processing. Trento, Italy, 9–13 September 2019, Cham: Springer, 104–113.
  • He, K., et al., 2016. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, 26 June 2016 – 1 July 2016, 770–778.
  • He, K., et al., 2017. Mask R-CNN. In: Proceedings of the IEEE international conference on computer vision, Venice, Italy, 22–29 October 2017, 2961–2969.
  • Heipke, C., 2010. Crowdsourcing geospatial data. ISPRS Journal of Photogrammetry and Remote Sensing, 65 (6), 550–557.
  • Hu, Y., and Wang, J., 2020. How do people describe locations during a natural disaster: an analysis of tweets from Hurricane Harvey. In: 11th international conference on geographic information science (GIScience 2021)-Part I. Schloss Dagstuhl-Leibniz-Zentrum für Informatik.
  • Huang, G., et al., 2017. Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, 21–26 July 2017, 4700–4708.
  • Huang, J., et al., 1997. Image indexing using color correlograms. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition. New York: IEEE, 762–768.
  • Huang, J., et al., 2020. A novel approach to measuring urban waterlogging depth from images based on mask region-based convolutional neural network. Sustainability, 12 (5), 2149.
  • Huang, Q., and Xiao, Y., 2015. Geographic situational awareness: mining tweets for disaster preparedness, emergency response, impact, and recovery. ISPRS International Journal of Geo-Information, 4 (3), 1549–1568.
  • Huang, X., et al., 2020. Identifying disaster related social media for rapid response: a visual-textual fused cnn architecture. International Journal of Digital Earth, 13 (9), 1017–1023.
  • Huang, X., Wang, C., and Li, Z., 2018a. A near real-time flood-mapping approach by integrating social media and post-event satellite imagery. Annals of GIS, 24 (2), 113–123.
  • Huang, X., Wang, C., and Li, Z., 2018b. Reconstructing flood inundation probability by enhancing near real-time imagery with real-time gauges and tweets. IEEE Transactions on Geoscience and Remote Sensing, 56 (8), 4691–4701.
  • Huang, Y., Li, Y., and Shan, J., 2018c. Spatial-temporal event detection from geo-tagged tweets. ISPRS International Journal of Geo-Information, 7 (4), 150.
  • Imran, M., et al., 2013a. Practical extraction of disaster-relevant information from social media. In: Proceedings of the 22nd international conference on World Wide Web, Rio de Janeiro, Brazil, 13–17 May 2013, 1021–1024.
  • Imran, M., et al., 2013b. Extracting information nuggets from disaster-related messages in social media. In: ISCRAM 2013 Conference Proceedings, Baden-Baden, Germany, 12–15 May 2013, 791–801.
  • Imran, M., Mitra, P., and Castillo, C., 2016. Twitter as a lifeline: Human-annotated twitter corpora for nlp of crisis-related messages. In: 10th international conference on language resources and evaluation, LREC 2016. Paris: European Language Resources Association (ELRA), 1638–1643.
  • Iyengar, A., Finin, T., and Joshi, A., 2011. Content-based prediction of temporal boundaries for events in twitter. In: 2011 IEEE third international conference on privacy, security, risk and trust and 2011 IEEE third international conference on social computing. New York: IEEE, 186–191.
  • Jain, P., Ross, R., and Schoen-Phelan, B., 2019. Estimating distributed representation performance in disaster-related social media classification. In: 2019 IEEE/ACM international conference on advances in social networks analysis and mining (ASONAM). New York: IEEE, 723–727.
  • Jing, M., et al., 2016a. The application of social media image analysis to an emergency management system. In: 2016 11th international conference on availability, reliability and security (ARES). New York: IEEE, 805–810.
  • Jing, M., et al., 2016b. Integration of text and image analysis for flood event image recognition. In: 2016 27th Irish signals and systems conference (ISSC). New York: IEEE, 1–6.
  • Johnson, B., 2020. Fake news during disasters putting people’s lives at risk, Warns Intel Bulletin. https://www.hstoday.us/subject-matter-areas/emergency-preparedness/fake-news-during-disasters-putting-peoples-lives-at-risk-warns-intel-bulletin/ [Accessed 07 May 2021].
  • Joulin, A., et al., 2017. Bag of tricks for efficient text classification. In: Proceedings of the 15th conference of the European chapter of the association for computational linguistics: volume 2, short papers, April. Morristown, NJ: Association for Computational Linguistics, 427–431.
  • Karimi, S., Yin, J., and Paris, C., 2013. Classifying microblogs for disasters. In: Proceedings of the 18th Australasian document computing symposium, Brisbane, Australia, 5–6 December 2013, 26–33.
  • Karras, T., Laine, S., and Aila, T., 2019. A style-based generator architecture for generative adversarial networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Long Beach, CA, 16–20 June 2019, 4401–4410.
  • Kerle, N., and Hoffman, R.R., 2013. Collaborative damage mapping for emergency response: the role of cognitive systems engineering. Natural Hazards and Earth System Sciences, 13 (1), 97–113.
  • Kersten, J., and Klan, F., 2020. What happens where during disasters? A workflow for the multifaceted characterization of crisis events based on twitter data. Journal of Contingencies and Crisis Management, 28 (3), 262–280.
  • Khare, P., Burel, G., and Alani, H., 2018. Classifying crises-information relevancy with semantics. In: European semantic web conference. New York: Springer, 367–383.
  • Kim, Y., 2014. Convolutional neural networks for sentence classification. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), Doha, Qatar, 25–29 October 2014, 1746–1751.
  • Klonner, C., et al., 2016. Volunteered geographic information in natural hazard analysis: a systematic literature review of current approaches with a focus on preparedness and mitigation. ISPRS International Journal of Geo-Information, 5 (7), 103.
  • Klonner, C., et al., 2018. Capturing flood risk perception via sketch maps. ISPRS International Journal of Geo-Information, 7 (9), 359.
  • Kogan, M., Palen, L., and Anderson, K.M., 2015. Think local, retweet global: Retweeting by the geographically-vulnerable during hurricane sandy. In: Proceedings of the 18th ACM conference on computer supported cooperative work & social computing, Vancouver, Canada, 14–18 March 2015, 981–993.
  • Kutija, V., et al., 2014. Model validation using crowd-sourced data from a large pluvial flood. In: 11th international conference on hydroinformatics, New York, USA, 17–21 August 2014. New York: CUNY Academic Works.
  • Lagerstrom, R., et al., 2016. Image classification to support emergency situation awareness. Frontiers in Robotics and AI, 3, 54.
  • Le Boursicaud, R., et al., 2016. Gauging extreme floods on YouTube: application of LSPIV to home movies for the post-event determination of stream discharges. Hydrological Processes, 30 (1), 90–105.
  • Le Coz, J., et al., 2016. Crowdsourced data for flood hydrology: feedback from recent citizen science projects in Argentina, France and New Zealand. Journal of Hydrology, 541, 766–777.
  • Levin, S., et al., 2018. Machine-learning-based electronic triage more accurately differentiates patients with respect to Clinical Outcomes Compared With the Emergency Severity Index. Annals of Emergency Medicine, 71 (5), 565–574.
  • Li, L., and Fox, E.A., 2019. Understanding patterns and mood changes through tweets about disasters. In: Proceedings of the 16th international conference on information systems for crisis response and management, Valencia, Spain, 19–22 May 2019, 756–767.
  • Li, L., et al., 2015. Sub-pixel flood inundation mapping from multispectral remotely sensed images based on discrete particle swarm optimization. ISPRS Journal of Photogrammetry and Remote Sensing, 101, 10–21.
  • Li, X., et al., 2019. Identifying disaster damage images using a domain adaptation approach. In: Proceedings of the international ISCRAM conference, Valencia, Spain, 19–22 May 2019, 633–645.
  • Li, Z., et al., 2018. A novel approach to leveraging social media for rapid flood mapping: a case study of the 2015 South Carolina floods. Cartography and Geographic Information Science, 45 (2), 97–110.
  • Liu, P., Qiu, X., and Huang, X., 2016. Recurrent neural network for text classification with multi-task learning. arXiv preprint arXiv:1605.05101.
  • Lopez-Fuentes, L., et al., 2017. Multi-modal deep learning approach for flood detection. In: Working notes proceedings of the MediaEval 2017 workshop, Dublin, Ireland, 13–15 September 2017.
  • MacEachren, A.M., et al., 2011. Senseplace2: Geotwitter analytics support for situational awareness. In: 2011 IEEE conference on visual analytics science and technology (VAST). New York: IEEE, 181–190.
  • Madichetty, S., and Sridevi, M., 2019. Disaster damage assessment from the tweets using the combination of statistical features and informative words. Social Network Analysis and Mining, 9 (1), 42.
  • Mandel, B., et al., 2012. A demographic analysis of online sentiment during Hurricane Irene. In: Proceedings of the second workshop on language in social media, Montreal, Canada, 7 June 2012, 27–36.
  • McDougall, K., 2011a. Understanding the impact of volunteered geographic information during the Queensland floods. In: Proceedings of the 7th international symposium on digital earth (ISDE 7). Midland, WA: Western Australian Land Information System, 66–74.
  • McDougall, K., 2011b. Using volunteered information to map the Queensland floods. In: Proceedings of the 2011 surveying and spatial sciences conference: innovation in action: working smarter (SSSC 2011). South Brisbane: Surveying and Spatial Sciences Institute, 13–23.
  • McDougall, K., and Temple-Watts, P., 2012. The use of LiDAR and volunteered geographic information to map flood extents and inundation. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, I-4, 251–256.
  • Meel, P., and Vishwakarma, D.K., 2020. Fake news, rumor, information pollution in social media and web: a contemporary survey of state-of-the-arts, challenges and opportunities. Expert Systems with Applications, 153, 112986.
  • Middleton, S.E., et al., 2013. Multi-disciplinary approaches to intelligently sharing large-volumes of real-time sensor data during natural disasters. Data Science Journal, 12, WDS109–WDS113.
  • Mikolov, T., et al., 2013a. Efficient estimation of word representations in vector space. In: 1st International conference on learning representations, ICLR 2013 – workshop track proceedings. Scottsdale, AZ, 2–4 May 2013.
  • Mikolov, T., et al., 2013b. Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems, Lake Tahoe, 5–10 December 2013, 3111–3119.
  • Moher, D., et al., 2009. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Medicine, 6 (7), e1000097.
  • Molina-Pico, A., et al., 2016. Forest monitoring and wildland early fire detection by a hierarchical wireless sensor network. Journal of Sensors, 2016, 1–8.,
  • Moumtzidou, A., et al., 2018. Flood relevance estimation from visual and textual content in social media streams. In: Companion proceedings of the web conference 2018, Lyon, France, 23–27 April 2018, 1621–1627.
  • Mouzannar, H., Rizk, Y., and Awad, M., 2018. Damage identification in social media posts using multimodal deep learning. In: Proceedings of the International ISCRAM Conference. Rochester, NY, 20–23 May 2018, 529–543.
  • Muller-Budack, E., Pustu-Iren, K., and Ewerth, R., 2018. Geolocation estimation of photos using a hierarchical model and scene classification. In: Proceedings of the European conference on computer vision (ECCV), Munich, Germany, 8–14 September 2018, 563–579.
  • Murthy, D., and Longwell, S.A., 2013. Twitter and disasters: the uses of twitter during the 2010 Pakistan floods. Information, Communication & Society, 16 (6), 837–855.
  • Neal, D.M., 1997. Reconsidering the phases of disasters. International Journal of Mass Emergencies and Disasters, 15 (2), 239–264.
  • Nguyen, D., et al., 2017a. Robust classification of crisis-related data on social networks using convolutional neural networks. In: Proceedings of the international AAAI conference on web and social media, Montreal, Canada, 15–18 May 2017, 632–635.
  • Nguyen, D.T., et al., 2017b. Damage assessment from social media imagery data during disasters. In: Proceedings of the 2017 IEEE/ACM international conference on advances in social networks analysis and mining 2017, Sydney, Australia, 31 July – 3 August 2017, 569–576.
  • Nia, K.R., and Mori, G., 2017. Building damage assessment using deep learning and ground-level image data. In: 2017 14th conference on computer and robot vision (CRV). New York: IEEE, 95–102.
  • Ning, H., et al., 2020. Prototyping a social media flooding photo screening system based on deep learning. ISPRS International Journal of Geo-Information, 9 (2), 104.
  • Nogueira, K., et al., 2017. Data-driven flood detection using neural networks. In: Working notes proceedings of the MediaEval 2017 Workshop, Dublin, Ireland, 13–15 September 2017.
  • Ofli, F., Imran, M., and Alam, F., 2020. Using artificial intelligence and social media for disaster response and management: an overview. In: T.V. Vijay Kumar and K. Sud, eds. AI and robotics in disaster studies. Singapore: Springer Singapore, 63–81.
  • Ogie, R.I., et al., 2019. Crowdsourced social media data for disaster management: lessons from the petajakarta.org project. Computers, Environment and Urban Systems, 73, 108–117.
  • Olteanu, A., et al., 2014. Crisislex: a lexicon for collecting and filtering microblogged communications in crises. In: Proceedings of the international AAAI conference on web and social media, Ann Arbor, MI, 1–4 June 2014, 376–385.
  • Olteanu, A., Vieweg, S., and Castillo, C., 2015. What to expect when the unexpected happens: Social media communications across crises. In: Proceedings of the 18th ACM conference on computer supported cooperative work & social computing, Vancouver, Canada, 14–18 March 2015, 994–1009.
  • Ord, J.K., and Getis, A., 2010. Local spatial autocorrelation statistics: distributional issues and an application. Geographical Analysis, 27 (4), 286–306.
  • Ostermann, F.O., and Spinsanti, L., 2011. A conceptual workflow for automatically assessing the quality of volunteered geographic information for crisis management. In: Proceedings of AGILE, Utrecht, Netherlands, 1–6.
  • Panteras, G., and Cervone, G., 2018. Enhancing the temporal resolution of satellite-based flood extent generation using crowdsourced data for disaster monitoring. International Journal of Remote Sensing, 39 (5), 1459–1474.
  • Park, S., et al., 2021. Computer vision–based estimation of flood depth in flooded-vehicle images. Journal of Computing in Civil Engineering, 35 (2), 04020072.
  • Pegelonline. 2020. PEGELONLINE. https://www.pegelonline.wsv.de/gast/start [Accessed 07 May 2021].
  • Pennington, J., Socher, R., and Manning, C.D., 2014. Glove: global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), Doha, Qatar, 25–29 October 2014, 1532–1543.
  • Pereira, J., et al., 2019. Assessing flood severity from georeferenced photos. In: Proceedings of the 13th workshop on geographic information retrieval, Lyon, France, 28–29 November 2019, 1–10.
  • Peters, M.E., et al., 2018. Deep contextualized word representations. In: Proceedings of NAACL-HLT. New Orleans, LA, 1–6 June 2018, 2227–2237.
  • Pham, H.X., et al., 2017. A distributed control framework for a team of unmanned aerial vehicles for dynamic wildfire tracking. In: 2017 IEEE/RSJ international conference on intelligent robots and systems (IROS). New York: IEEE, 6648–6653.
  • Power, R., et al., 2015. A case study for monitoring fires with twitter. In: ISCRAM 2015 Conference Proceedings. Kristiansand, Norway, 24–27 May 2015.
  • Power, R., Robinson, B., and Ratcliffe, D., 2013. Finding fires with twitter. In: Proceedings of the Australasian Language Technology Association workshop 2013 (ALTA 2013), Brisbane, Australia, 4–6 December 2013, 80–89.
  • Quan, K.A.C., et al., 2020. Flood level prediction via human pose estimation from social media images. In: Proceedings of the 2020 international conference on multimedia retrieval, Dublin, Ireland, 8–11 June 2020, 479–485.
  • Ramachandran, D., and Ramasubramanian, P., 2018. Event detection from twitter–a survey. International Journal of Web Information Systems, 14 (3), 262–280.
  • Rashid, M.T., et al., 2020. Compdrone: towards integrated computational model and social drone based wildfire monitoring. In: 2020 16th international conference on distributed computing in sensor systems (DCOSS). New York: IEEE, 43–50.
  • Ratcliffe, J.H., 2004. The hotspot matrix: a framework for the spatio-temporal targeting of crime reduction. Police Practice and Research, 5 (1), 5–23.
  • Resch, B., Usländer, F., and Havas, C., 2018. Combining machine-learning topic models and spatiotemporal analysis of social media data for disaster footprint and damage assessment. Cartography and Geographic Information Science, 45 (4), 362–376.
  • Roheda, S., et al., 2018. Decision level fusion: an event driven approach. In: 2018 26th European signal processing conference (EUSIPCO). Rome, Italy, 3–7 September 2018, New York: IEEE, 2598–2602.
  • Rosser, J.F., Leibovici, D., and Jackson, M., 2017. Rapid flood inundation mapping using social media, remote sensing and topographic data. Natural Hazards, 87 (1), 103–120.
  • Said, N., et al., 2018. Deep learning approaches for flood classification and flood aftermath detection. In: Working notes proceedings of the MediaEval 2018 workshop, Sophia Antipolis, France, 29–31 October 2018.
  • Sakaki, T., Okazaki, M., and Matsuo, Y., 2010. Earthquake shakes twitter users: real-time event detection by social sensors. In: Proceedings of the 19th international conference on World Wide Web. Raleigh, NC, 26–30 April 2010, 851–860.
  • Salton, G., and Buckley, C., 1988. Term-weighting approaches in automatic text retrieval. Information Processing & Management, 24 (5), 513–523.
  • Sarker, C., et al., 2019. Flood mapping with convolutional neural networks using spatio-contextual pixel information. Remote Sensing, 11 (19), 2331.
  • Sattler, T., et al., 2017. Are large-scale 3d models really necessary for accurate visual localization? In: Proceedings of the IEEE conference on computer vision and pattern recognition, 1637–1646.
  • Schnebele, E., and Cervone, G., 2013. Improving remote sensing flood assessment using volunteered geographical data. Natural Hazards and Earth System Sciences, 13 (3), 669–677.
  • Schnebele, E., Cervone, G., and Waters, N., 2014a. Road assessment after flood events using non-authoritative data. Natural Hazards and Earth System Sciences, 14 (4), 1007–1015.
  • Schnebele, E., et al., 2014b. Real time estimation of the Calgary floods using limited remote sensing data. Water, 6 (2), 381–398.
  • Sermanet, P., et al., 2013. Overfeat: integrated recognition, localization and detection using convolutional networks. In: 2nd International conference on learning representations, ICLR 2014 – conference track proceedings. Banff, Canada, 14–16 April 2014.
  • Sester, M., et al., 2014. Integrating and generalising volunteered geographic information. In: Abstracting geographic information in a data rich world. Cham: Springer, 119–155.
  • Simonyan, K., and Zisserman, A., 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556.
  • Sit, M.A., Koylu, C., and Demir, I., 2019. Identifying disaster-related tweets and their semantic, spatial and temporal context using deep learning, natural language processing and spatial analysis: a case study of Hurricane Irma. International Journal of Digital Earth, 12 (11), 1205–1229.
  • Smith, L., et al., 2017. Assessing the utility of social media as a data source for flood risk management using a real-time modelling framework. Journal of Flood Risk Management, 10 (3), 370–380.
  • Socher, R., et al., 2013. Recursive deep models for semantic compositionality over a sentiment treebank. In: Proceedings of the 2013 conference on empirical methods in natural language processing, Seattle, WA, 18–21 October 2013, 1631–1642.
  • Stefanidis, A., Crooks, A., and Radzikowski, J., 2013. Harvesting ambient geospatial information from social media feeds. GeoJournal, 78 (2), 319–338.
  • Steiger, E., De Albuquerque, J.P., and Zipf, A., 2015. An advanced systematic literature review on spatiotemporal analyses of twitter data. Transactions in GIS, 19 (6), 809–834.
  • Stock, K., 2018. Mining location from social media: a systematic review. Computers, Environment and Urban Systems, 71, 209–240.
  • Stowe, K., et al., 2016. Identifying and categorizing disaster-related tweets. In: Proceedings of The fourth international workshop on natural language processing for social media, Austin, TX, 1 November 2016, 1–6.
  • Sural, S., Qian, G., and Pramanik, S., 2002. Segmentation and histogram generation using the HSV color space for image retrieval. In: Proceedings. International conference on image processing. New York: IEEE, vol. 2, II.
  • Szegedy, C., et al., 2016. Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, 26 June – 1 July 2016, 2818–2826.
  • Tan, M., and Le, Q., 2019. Efficientnet: rethinking model scaling for convolutional neural networks. In: International conference on machine learning, Long Beach, CA, 9–15 June 2019, 6105–6114.
  • Thies, J., et al., 2020. Neural voice puppetry: audio-driven facial reenactment. In: European conference on computer vision. Glasgow, UK, 23–28 August 2020. Cham: Springer, 716–731.
  • Tkachenko, N., Zubiaga, A., and Procter, R., 2017. Wisc at mediaeval 2017: multimedia satellite task. In: Working notes proceedings of the MediaEval 2017 workshop, Dublin, Ireland, 13–15 September 2017.
  • Truelove, M., Vasardani, M., and Winter, S., 2015. Towards credibility of micro-blogs: characterising witness accounts. GeoJournal, 80 (3), 339–359.
  • Ukkusuri, S.V., et al., 2014. Use of social media data to explore crisis informatics: study of 2013 Oklahoma Tornado. Transportation Research Record: Journal of the Transportation Research Board, 2459 (1), 110–118.
  • Vaswani, A., et al., 2017. Attention is all you need. In: Advances in neural information processing systems, Long Beach, CA, 4–9 December 2017, 5998–6008.
  • Vieweg, S.E., 2012. Situational awareness in mass emergency: a behavioral and linguistic analysis of microblogged communications. Thesis (PhD). Citeseer.
  • Vosoughi, S., Roy, D., and Aral, S., 2018. The spread of true and false news online. Science, 359 (6380), 1146–1151.
  • Wallemacq, P., and House, R., 2018. Economic losses, poverty and disasters 1998-2017. Geneva, Switzerland: The United Nations Office for Disaster Risk Reduction, 33.
  • Wang, H., et al., 2018a. Fusing heterogeneous data: a case for remote sensing and social media. IEEE Transactions on Geoscience and Remote Sensing, 56 (12), 6956–6968.
  • Wang, R.Q., et al., 2018b. Hyper-resolution monitoring of urban flooding with social media and crowdsourcing data. Computers & Geosciences, 111, 139–147.
  • Wang, R.Q., et al., 2020. Tracking flooding phase transitions and establishing a passive hotline with AI-enabled social media data. IEEE Access, 8, 103395–103404.
  • Wang, Y., et al., 2016a. Using social media for emergency response and urban sustainability: a case study of the 2012 Beijing rainstorm. Sustainability, 8 (1), 25.
  • Wang, Z., and Ye, X., 2018. Social media analytics for natural disaster management. International Journal of Geographical Information Science, 32 (1), 49–72.
  • Wang, Z., Ye, X., and Tsou, M.H., 2016b. Spatial, temporal, and content analysis of twitter for wildfire hazards. Natural Hazards, 83 (1), 523–540.
  • Weber, E., et al., 2020. Detecting natural disasters, damage, and incidents in the wild. In: European conference on computer vision. Glasgow, UK, 23–28 August 2020. Cham: Springer, 331–350.
  • Wolfswinkel, J.F., Furtmueller, E., and Wilderom, C.P., 2013. Using grounded theory as a method for rigorously reviewing literature. European Journal of Information Systems, 22 (1), 45–55.
  • Xiao, Y., Li, B., and Gong, Z., 2018. Real-time identification of urban rainstorm waterlogging disasters based on Weibo big data. Natural Hazards, 94 (2), 833–842.
  • Xiao, Y., and Watson, M., 2019. Guidance on conducting a systematic literature review. Journal of Planning Education and Research, 39 (1), 93–112.
  • Yan, Y., et al., 2020. Volunteered geographic information research in the first decade: a narrative review of selected journal articles in GIScience. International Journal of Geographical Information Science, 0 (0), 1–27.
  • Yang, Y., et al., 2011. Hierarchical disaster image classification for situation report enhancement. In: 2011 IEEE international conference on information reuse & integration. New York: IEEE, 181–186.
  • Yao, W., et al., 2020. Weakly-supervised fine-grained event recognition on social media texts for disaster management. In: Proceedings of the AAAI conference on artificial intelligence, New York, 7–12 February 2020, 532–539.
  • Yin, J., et al., 2012. Using social media to enhance emergency situation awareness. IEEE Intelligent Systems, 27 (6), 52–59.
  • Yu, M., et al., 2019. Deep learning for real-time social media text classification for situation awareness–using hurricanes Sandy, Harvey, and Irma as case studies. International Journal of Digital Earth, 12 (11), 1230–1247.
  • Zahra, K., Imran, M., and Ostermann, F.O., 2020. Automatic identification of eyewitness messages on twitter during disasters. Information Processing & Management, 57 (1), 102107.
  • Zhao, Q., et al., 2019. Extracting and classifying typhoon disaster information based on volunteered geographic information from Chinese Sina Microblog. Concurrency and Computation: Practice and Experience, 31 (9), e4910.
  • Zhao, Z., and Larson, M., 2017. Retrieving social flooding images based on multimodal information. In: Working notes proceedings of the MediaEval 2017 workshop, Dublin, Ireland, 13–15 September 2017.
  • Zhou, B., et al., 2018. Places: a 10 million image database for scene recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40 (6), 1452–1464.
  • Zhou, P., et al., 2016. Text classification improved by integrating bidirectional lstm with two-dimensional max pooling. In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers, Osaka, Japan, 11–16 December 2016, 3485–3495.
  • Zhou, X., and Zafarani, R., 2020. A survey of fake news: fundamental theories, detection methods, and opportunities. ACM Computing Surveys, 53 (5), 1–40.
  • Zhu, R., et al., 2018. Geo-tagged social media data-based analytical approach for perceiving impacts of social events. ISPRS International Journal of Geo-Information, 8 (1), 15.
  • Zourlidou, S., and Sester, M., 2019. Traffic regulator detection and identification from crowdsourced data—a systematic literature review. ISPRS International Journal of Geo-Information, 8 (11), 491.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.