A visual–textual fused approach to automated tagging of flood-related tweets during a flood event

References

• Avgerinakis, K., A. Moumtzidou, S. Andreadis, E. Michail, I. Gialampoukidis, S. Vrochidis, and I. Kompatsiaris. 2017. “Visual and Textual Analysis of Social Media and Satellite Images for Flood Detection@ Multimedia Satellite Task MediaEval 2017.” Proceedings of the working notes proceeding MediaEval workshop, Dublin, Ireland (pp. 13–15).
   Google Scholar
• Bischke, B., P. Bhardwaj, A. Gautam, P. Helber, D. Borth, and A. Dengel. 2017. “Detection of Flooding Events in Social Multimedia and Satellite Imagery Using Deep Neural Networks.” Proceedings of the working notes proceeding MediaEval workshop, Dublin, Ireland (pp. 13–15).
   Google Scholar
• Blake, E., and D. Zelinsky. n.d. “National Hurricane Center Tropical Cyclone Report: Hurricane Harvey (Rep.).” Accessed May 11, 2018 from National Hurricane Center Website: https://www.nhc.noaa.gov/data/tcr/AL092017_Harvey.pdf.
   Google Scholar
• Boiman, O., E. Shechtman, and M. Irani. 2008. “Defense of Nearest-Neighbor Based Image Classification.” IEEE conference on Computer Vision and Pattern Recognition (CVPR'08) (pp. 1–8). IEEE.
   Google Scholar
• Caragea, C., A. C. Squicciarini, S. Stehle, K. Neppalli, and A. H. Tapia. 2014. “Mapping Moods: Geo-Mapped Sentiment Analysis During Hurricane Sandy.” ISCRAM.
   Google Scholar
• Chew, C., and G. Eysenbach. 2010. “Pandemics in the age of Twitter: Content Analysis of Tweets During the 2009 H1N1 Outbreak.” PloS One 5 (11): e14118. doi: 10.1371/journal.pone.0014118
   PubMed Web of Science ®Google Scholar
• Chollet, F. (2015) . Keras. https://keras.io/.
   Google Scholar
• Ciregan, D., U. Meier, and J. Schmidhuber. 2012. “Multi-Column Deep Neural Networks for Image Classification.” IEEE conference on Computer Vision and Pattern Recognition (CVPR'12), June (pp. 3642–3649). IEEE.
   Google Scholar
• Ciresan, D. C., U. Meier, J. Masci, L. Maria Gambardella, and J. Schmidhuber. 2011. “Flexible, High Performance Convolutional Neural Networks for Image Classification.” IJCAI'11 Proceedings of the 22nd international joint conference on Artificial Intelligence, Barcelona, Catalonia, Spain, July 16–22 (pp. 1237–1242).
   Google Scholar
• De Albuquerque, J. P., B. Herfort, A. Brenning, and A. Zipf. 2015. “A Geographic Approach for Combining Social Media and Authoritative Data Towards Identifying Useful Information for Disaster Management.” International Journal of Geographical Information Science 29 (4): 667–689. doi: 10.1080/13658816.2014.996567
   Web of Science ®Google Scholar
• Dredze, M. 2012. “How Social Media Will Change Public Health.” IEEE Intelligent Systems 27 (4): 81–84. doi: 10.1109/MIS.2012.76
   Web of Science ®Google Scholar
• Fakhari, A., and A. M. E. Moghadam. 2013. “Combination of Classification and Regression in Decision Tree for Multi-Labeling Image Annotation and Retrieval.” Applied Soft Computing 13 (2): 1292–1302. doi: 10.1016/j.asoc.2012.10.019
   Web of Science ®Google Scholar
• Feick, R., and S. Roche. 2013. “Understanding the Value of VGI.” In Crowdsourcing Geographic Knowledge, 15–29. Dordrecht: Springer.
   Google Scholar
• Feng, Y., and M. Sester. 2018. “Extraction of Pluvial Flood Relevant Volunteered Geographic Information (VGI) by Deep Learning from User Generated Texts and Photos.” ISPRS International Journal of Geo-Information 7 (2): 39. doi: 10.3390/ijgi7020039
   Web of Science ®Google Scholar
• Fohringer, J., D. Dransch, H. Kreibich, and K. Schröter. 2015. “Social Media as an Information Source for Rapid Flood Inundation Mapping.” Natural Hazards and Earth System Sciences 15 (12): 2725–2738. doi: 10.5194/nhess-15-2725-2015
   Web of Science ®Google Scholar
• Goodchild, M. F. 2007. “Citizens as Sensors: The World of Volunteered Geography.” GeoJournal 69 (4): 211–221. doi: 10.1007/s10708-007-9111-y
   Google Scholar
• Herfort, B., J. P. de Albuquerque, S. J. Schelhorn, and A. Zipf. 2014. “Exploring the Geographical Relations Between Social Media and Flood Phenomena to Improve Situational Awareness.” Connecting a Digital Europe Through Location and Place (pp. 55–71). Cham: Springer.
   Google Scholar
• Ho, T. Y., P. M. Lam, and C. S. Leung. 2008. “Parallelization of Cellular Neural Networks on GPU.” Pattern Recognition 41 (8): 2684–2692. doi: 10.1016/j.patcog.2008.01.018
   Web of Science ®Google Scholar
• Huang, X., C. Wang, and Z. Li. 2018a. “A Near Real-Time Flood Mapping Approach by Integrating Social Media and Post-Event Satellite Imagery.” Annals of GIS, 24(2), 113–123. doi: 10.1080/19475683.2018.1450787
   Web of Science ®Google Scholar
• Huang, X., C. Wang, and Z. Li. 2018b. “Reconstructing Flood Inundation Probability by Enhancing Near Real-Time Imagery with Real-Time Gauges and Tweets.” IEEE Transactions on Geoscience and Remote Sensing, 56(8), 4691–4701. doi: 10.1109/TGRS.2018.2835306
   Web of Science ®Google Scholar
• Iglewicz, B., and D. C. Hoaglin. 1993. How to Detect and Handle Outliers. Vol. 16. Milwaukee, WI: ASQC Quality Press.
   Google Scholar
• Jancsary, J., S. Nowozin, T. Sharp, and C. Rother. 2012. “Regression Tree Fields – An Efficient, Non-Parametric Approach to Image Labeling Problems.” 2012 IEEE conference on Computer Vision and Pattern Recognition (CVPR) (pp. 2376–2383). IEEE.
   Google Scholar
• Krizhevsky, A., I. Sutskever, and G. E. Hinton. 2012. “ImageNet Classification with Deep Convolutional Neural Networks.” Proceedings of the 25th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, December 3–6 (pp. 1097–1105).
   Google Scholar
• Lachlan, K. A., P. R. Spence, X. Lin, and M. Del Greco. 2014. “Screaming Into the Wind: Examining the Volume and Content of Tweets Associated with Hurricane Sandy.” Communication Studies 65 (5): 500–518. doi: 10.1080/10510974.2014.956941
   Google Scholar
• Li, Z., C. Wang, C. T. Emrich, and D. Guo. 2018. “A Novel Approach to Leveraging Social Media for Rapid Flood Mapping: A Case Study of the 2015 South Carolina Floods.” Cartography and Geographic Information Science 45 (2): 97–110. doi: 10.1080/15230406.2016.1271356
   Web of Science ®Google Scholar
• Longueville, B. D., G. Luraschi, P. Smits, S. Peedell, and T. D. Groeve. 2010. “Citizens as Sensors for Natural Hazards: A VGI Integration Workflow.” Geomatica 64 (1): 41–59.
   Google Scholar
• Martín, Y., Z. Li, and S. L. Cutter. 2017. “Leveraging Twitter to Gauge Evacuation Compliance: Spatiotemporal Analysis of Hurricane Matthew.” PLoS One 12 (7): e0181701. doi: 10.1371/journal.pone.0181701
   PubMed Web of Science ®Google Scholar
• Masci, J., A. Giusti, D. Ciresan, G. Fricout, and J. Schmidhuber. 2013. “A Fast Learning Algorithm for Image Segmentation with Max-Pooling Convolutional Networks.” 20th IEEE International Conference on Image Processing (ICIP'13) (pp. 2713–2717). IEEE.
   Google Scholar
• McCann, S., and D. G. Lowe. 2012. “Local Naive Bayes Nearest Neighbor for Image Classification.” 2012 IEEE conference on Computer Vision and Pattern Recognition (CVPR), June (pp. 3650–3656). IEEE.
   Google Scholar
• McDougall, K. 2011. “Using Volunteered Information to Map the Queensland Floods.” Proceedings of the 2011 Surveying and Spatial Sciences Conference: Innovation in Action: Working Smarter (SSSC'11) (pp. 13–23). Surveying and Spatial Sciences Institute.
   Google Scholar
• Nagi, J., F. Ducatelle, G. A. Di Caro, D. Cireşan, U. Meier, A. Giusti, and L. M. Gambardella. 2011. “Max-Pooling Convolutional Neural Networks for Vision-Based Hand Gesture Recognition.” 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), November (pp. 342–347). IEEE.
   Google Scholar
• Ovtcharov, K., O. Ruwase, J. Y. Kim, J. Fowers, K. Strauss, and E. S. Chung. 2015. “Accelerating Deep Convolutional Neural Networks Using Specialized Hardware.” Microsoft Research Whitepaper 2 (11): 1–4.
   Google Scholar
• Pinheiro, P., and R. Collobert. 2014. “Recurrent Convolutional Neural Networks for Scene Labeling.” International Conference on Machine Learning 32: 82–90.
   Google Scholar
• Riedmiller, M., and H. Braun. 1993. “A Direct Adaptive Method for Faster Backpropagation Learning: The RPROP Algorithm.” IEEE international conference on Neural Networks (pp. 586–591). IEEE.
   Google Scholar
• Ronneberger, O., P. Fischer, and T. Brox. 2015. “U-NET: Convolutional Networks for Biomedical Image Segmentation.” International conference on Medical Image Computing and Computer-assisted Intervention, October (pp. 234–241). Cham: Springer.
   Google Scholar
• Sakaki, T., M. Okazaki, and Y. Matsuo. 2010. “Earthquake Shakes Twitter Users: Real-Time Event Detection by Social Sensors.” Proceedings of the 19th International Conference on World Wide Web, April (pp. 851–860). ACM.
   Google Scholar
• Schnebele, E., G. Cervone, S. Kumar, and N. Waters. 2014. “Real Time Estimation of the Calgary Floods Using Limited Remote Sensing Data.” Water 6 (2): 381–398. doi: 10.3390/w6020381
   Web of Science ®Google Scholar
• Schnebele, E., and N. Waters. 2014. “Road Assessment After Flood Events Using Non-Authoritative Data.” Natural Hazards and Earth System Sciences 14 (4): 1007. doi: 10.5194/nhess-14-1007-2014
   Web of Science ®Google Scholar
• Simard, P. Y., D. Steinkraus, and J. C. Platt. 2003, August. “Best Practices for Convolutional Neural Networks Applied to Visual Document Analysis.” ICDAR 3: 958–962.
   Google Scholar
• Simonyan, K., and A. Zisserman. 2014. “Very Deep Convolutional Networks for Large-Scale Image Recognition.” arXiv preprint arXiv:1409.1556.
   Google Scholar
• Skoric, M., N. Poor, P. Achananuparp, E. P. Lim, and J. Jiang. 2012. “Tweets and Votes: A Study of the 2011 Singapore General Election.” 45th Hawaii International Conference on System Science (HICSS'12), January (pp. 2583–2591). IEEE.
   Google Scholar
• Small, T. A. 2011. “What the Hashtag? A Content Analysis of Canadian Politics on Twitter. Information.” Communication & Society 14 (6): 872–895. doi: 10.1080/1369118X.2011.554572
   Web of Science ®Google Scholar
• Suykens, J. A., and J. Vandewalle. 1999. “Least Squares Support Vector Machine Classifiers.” Neural Processing Letters 9 (3): 293–300. doi: 10.1023/A:1018628609742
   Web of Science ®Google Scholar
• Triglav-Čekada, M., and D. Radovan. 2013. “Using Volunteered Geographical Information to Map the November 2012 Floods in Slovenia.” Natural Hazards and Earth System Sciences 13 (11): 2753. doi: 10.5194/nhess-13-2753-2013
   Web of Science ®Google Scholar
• Vieweg, S., A. L. Hughes, K. Starbird, and L. Palen. 2010. “Microblogging During Two Natural Hazards Events: What Twitter May Contribute to Situational Awareness.” Proceedings of the SIGCHI conference on Human Factors in Computing Systems, April (pp. 1079–1088). ACM.
   Google Scholar
• Wang, C., Z. Li, and X. Huang. 2018. “Geospatial Assessment of Wetness Dynamics in the October 2015 SC Flood with Remote Sensing and Social Media.” Southeastern Geographer 58 (2): 164–180. doi: 10.1353/sgo.2018.0020
   Web of Science ®Google Scholar
• Wang, J., Y. Yang, J. Mao, Z. Huang, C. Huang, and W. Xu. 2016. “CNN–RNN: A Unified Framework for Multi-Label Image Classification.” 2016 IEEE conference on Computer Vision and Pattern Recognition (CVPR) (pp. 2285–2294). IEEE.
   Google Scholar
• Wei, Z., J. Chen, W. Gao, B. Li, L. Zhou, Y. He, and K. F. Wong. 2013. “An Empirical Study on Uncertainty Identification in Social Media Context.” Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) (pp. 58–62).
   Google Scholar
• Wei, Y., W. Xia, M. Lin, J. Huang, B. Ni, J. Dong, and S. Yan. 2016. “HCP: A Flexible CNN Framework for Multi-Label Image Classification.” IEEE Transactions on Pattern Analysis and Machine Intelligence 38 (9): 1901–1907. doi: 10.1109/TPAMI.2015.2491929
   PubMed Web of Science ®Google Scholar
• Wu, K., and K. H. Yap. 2006. “Fuzzy SVM for Content-Based Image Retrieval: A Pseudo-Label Support Vector Machine Framework.” IEEE Computational Intelligence Magazine 1 (2): 10–16. doi: 10.1109/MCI.2006.1626490
   Google Scholar