A method to evaluate task-specific importance of spatio-temporal units based on explainable artificial intelligence

References

• Allam, Z. and Dhunny, Z.A., 2019. On big data, artificial intelligence and smart cities. Cities, 89, 80–91.
   Web of Science ®Google Scholar
• An, L., et al., 2015. Space-time analysis: concepts, quantitative methods, and future directions. Annals of the Association of American Geographers, 105 (5), 891–914.
   Web of Science ®Google Scholar
• Anselin, L., 1995. Local indicators of spatial association—LISA. Geographical Analysis, 27 (2), 93–115.
   Web of Science ®Google Scholar
• Bach, S., et al., 2015. On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLoS ONE, 10 (7), e0130140.
   PubMed Web of Science ®Google Scholar
• Birant, D. and Kut, A., 2007. ST-DBSCAN: an algorithm for clustering spatial–temporal data. Data and Knowledge Engineering, 60 (1), 208–221.
   Web of Science ®Google Scholar
• Breiman, L., 2001. Random forests. Machine Learning, 45 (1), 5–32.
   Web of Science ®Google Scholar
• Cheng, T., Haworth, J., and Wang, J., 2012. Spatio-temporal autocorrelation of road network data. Journal of Geographical Systems, 14 (4), 389–413.
   Web of Science ®Google Scholar
• De Lathauwer, L., 1997. Signal processing based on multilinear algebra. Leuven: Katholieke Universiteit Leuven.
   Google Scholar
• Erhan, D., et al. (2009). Visualizing higher-layer features of a deep network. University of Montreal, 1–13.
   Google Scholar
• Gahegan, M., 2020. Fourth paradigm GIScience? Prospects for automated discovery and explanation from data. International Journal of Geographical Information Science, 34 (1), 1–21.
   Web of Science ®Google Scholar
• Gao, S., 2015. Spatio-temporal analytics for exploring human mobility patterns and urban dynamics in the mobile age. Spatial Cognition and Computation, 15 (2), 86–114.
   Web of Science ®Google Scholar
• Hägerstraand, T., 1970. What about people in regional science? Papers in Regional Science, 24 (1), 7–24.
   Google Scholar
• Hinton, G.E., Osindero, S., and Teh, Y.W., 2006. A fast learning algorithm for deep belief nets. Neural Computation, 18 (7), 1527–1554.
   PubMed Web of Science ®Google Scholar
• Hinton, G.E. and Salakhutdinov, R.R., 2006. Reducing the dimensionality of data with neural networks. Science, 313 (5786), 504–507.
   PubMed Web of Science ®Google Scholar
• Hochreiter, S. and Schmidhuber, J., 1997. Long short-term memory. Neural Computation, 9 (8), 1735–1780.
   PubMed Web of Science ®Google Scholar
• Homma, T. and Saltelli, A., 1996. Importance measures in global sensitivity analysis of nonlinear models. Reliability Engineering and System Safety, 52 (1), 1–17.
   Web of Science ®Google Scholar
• Huang, B., Zhao, B., and Song, Y., 2018. Urban land-use mapping using a deep convolutional neural network with high spatial resolution multispectral remote sensing imagery. Remote Sensing of Environment, 214, 73–86.
   Web of Science ®Google Scholar
• Janowicz, K., et al., 2020. GeoAI: spatially explicit artificial intelligence techniques for geographic knowledge discovery and beyond. International Journal of Geographical Information Science, 34 (4), 625–636.
   Web of Science ®Google Scholar
• Lapuschkin, S., et al., 2016. The LRP toolbox for artificial neural networks. The Journal of Machine Learning Research, 17 (1), 3938–3942.
   Google Scholar
• Lapuschkin, S., et al., 2019. Unmasking Clever Hans predictors and assessing what machines really learn. Nature Communications, 10 (1), 1–8.
   PubMed Web of Science ®Google Scholar
• LeCun, Y., Bengio, Y., and Hinton, G., 2015. Deep learning. Nature, 521 (7553), 436–444.
   PubMed Web of Science ®Google Scholar
• Li, S., et al. 2016. Geospatial big data handling theory and methods: A review and research challenges. ISPRS Journal of Photogrammetry and Remote Sensing, 115, 119–133.
   Web of Science ®Google Scholar
• Li, W. and Hsu, C.Y., 2020. Automated terrain feature identification from remote sensing imagery: A deep learning approach. International Journal of Geographical Information Science, 34 (4), 637–660.
   Web of Science ®Google Scholar
• Liu, X., et al., 2016. Incorporating spatial interaction patterns in classifying and understanding urban land use. International Journal of Geographical Information Science, 30 (2), 334–350.
   Web of Science ®Google Scholar
• Liu, X., et al., 2018. Characterizing mixed-use buildings based on multi-source big data. International Journal of Geographical Information Science, 32 (4), 738–756.
   Web of Science ®Google Scholar
• Liu, Y., et al., 2012. Urban land uses and traffic ‘source-sink areas’: evidence from GPS-enabled taxi data in Shanghai. Landscape and Urban Planning, 106 (1), 73–87.
   Web of Science ®Google Scholar
• Liu, Y., et al., 2015. Social sensing: A new approach to understanding our socioeconomic environments. Annals of the Association of American Geographers, 105 (3), 512–530.
   Web of Science ®Google Scholar
• Ma, X., et al., 2015a. Large-scale transportation network congestion evolution prediction using deep learning theory. PLoS ONE, 10 (3), e0119044.
   PubMed Web of Science ®Google Scholar
• Ma, Y., et al. 2015b. Remote sensing big data computing: challenges and opportunities. Future Generation Computer Systems, 51, 47–60.
   Web of Science ®Google Scholar
• Montavon, G., Samek, W., and Müller, K.R., 2018. Methods for interpreting and understanding deep neural networks. Digital Signal Processing, 73, 1–15.
   Web of Science ®Google Scholar
• Openshaw, S., and Taylor, P. J. (1979). A million or so correlation coefficients: three experiments on the modifiable areal unit problem. In N. Wrigley (Ed.), Statistical applications in the spatial sciences. 127–144. London: Pion.
   Google Scholar
• Pedregosa, F., et al. 2011. Scikit-learn: machine learning in Python. Journal of Machine Learning Research, 12, 2825–2830.
   Web of Science ®Google Scholar
• Pei, T., et al., 2014. A new insight into land use classification based on aggregated mobile phone data. International Journal of Geographical Information Science, 28 (9), 1988–2007.
   Web of Science ®Google Scholar
• Protas, É., et al., 2018. Visualization methods for image transformation convolutional neural networks. IEEE Transactions on Neural Networks and Learning Systems, 30 (7), 2231–2243.
   PubMed Web of Science ®Google Scholar
• Ratti, C., et al., 2006. Mobile landscapes: using location data from cell phones for urban analysis. Environment and Planning B: Planning and Design, 33 (5), 727–748.
   Web of Science ®Google Scholar
• Reichstein, M., et al., 2019. Deep learning and process understanding for data-driven Earth system science. Nature, 566 (7743), 195–204.
   PubMed Web of Science ®Google Scholar
• Saltelli, A., 2002. Sensitivity analysis for importance assessment. Risk Analysis, 22 (3), 579–590.
   PubMed Web of Science ®Google Scholar
• Samek, W., et al., 2017. Evaluating the visualization of what a deep neural network has learned. IEEE Transactions on Neural Networks and Learning Systems, 28 (11), 2660–2673.
   PubMed Web of Science ®Google Scholar
• Samek, W., et al., 2019. Explainable AI: interpreting, explaining and visualizing deep learning. Cham: Springer.
   Google Scholar
• Schmidhuber, J., 2015. Deep learning in neural networks: an overview. Neural Networks, 61, 85–117.
   PubMed Web of Science ®Google Scholar
• Seabold, S. and Perktold, J., 2010. Statsmodels: econometric and statistical modeling with Python. In: Proceedings of the 9th Python in Science Conference, Austin, TX, USA, 57–61.
   Google Scholar
• Selvaraju, R.R., et al., 2017. Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 618–626.
   Google Scholar
• Shi, L., Gangopadhyay, A., and Janeja, V.P., 2015. STenSr: spatio-temporal tensor streams for anomaly detection and pattern discovery. Knowledge and Information Systems, 43 (2), 333–353.
   Web of Science ®Google Scholar
• Silver, D., et al., 2016. Mastering the game of Go with deep neural networks and tree search. Nature, 529 (7587), 484–489.
   PubMed Web of Science ®Google Scholar
• Silverman, B. W., 1986. Density estimation for statistics and data analysis, London: Chapman and Hall.
   Google Scholar
• Tobler, W.R., 1970. A computer movie simulating urban growth in the Detroit region. Economic Geography, 46 (sup1), 234–240.
   Web of Science ®Google Scholar
• Wu, L., et al., 2020. A framework for mixed-use decomposition based on temporal activity signatures extracted from big geo-data. International Journal of Digital Earth, 13 (6), 708–726.
   Web of Science ®Google Scholar
• Xie, S., Hu, H., and Wu, Y., 2019. Deep multi-path convolutional neural network joint with salient region attention for facial expression recognition. Pattern Recognition, 92, 177–191.
   Web of Science ®Google Scholar
• Yu, H., et al., 2017. Spatiotemporal recurrent convolutional networks for traffic prediction in transportation networks. Sensors, 17 (7), 1501.
   PubMed Web of Science ®Google Scholar
• Zang, D., et al., 2018. Long-term traffic speed prediction based on multiscale spatio-temporal feature learning network. IEEE Transactions on Intelligent Transportation Systems, 20 (10), 3700–3709.
   Web of Science ®Google Scholar
• Zeiler, M.D. and Fergus, R., 2014. Visualizing and understanding convolutional networks. In: European Conference on Computer Vision, Zurich, Switzerland, 818–833.
   Google Scholar
• Zhang, F., Du, B., and Zhang, L., 2016. Scene classification via a gradient boosting random convolutional network framework. IEEE Transactions on Geoscience and Remote Sensing, 54 (3), 1793–1802.
   Web of Science ®Google Scholar
• Zhang, J., et al., 2018a. Top-down neural attention by excitation backprop. International Journal of Computer Vision, 126 (10), 1084–1102.
   Web of Science ®Google Scholar
• Zhang, J., et al. 2018b. Predicting citywide crowd flows using deep spatio-temporal residual networks. Artificial Intelligence, 259, 147–166.
   Web of Science ®Google Scholar
• Zheng, Y., et al., 2011. Urban computing with taxicabs. In: Proceedings of the 13th International Conference on Ubiquitous Computing, Beijing, China, 89–98.
   Google Scholar
• Zhou, B., et al., 2016. Learning deep features for discriminative localization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 2921–2929.
   Google Scholar
• Zhou, H., et al., 2015a. Spatio-temporal tensor completion for imputing missing internet traffic data. In: 2015 IEEE 34th International Performance Computing and Communications Conference (IPCCC), Nanjing, China, 1–7.
   Google Scholar
• Zhou, Y., et al. 2015b. Functionally critical locations in an urban transportation network: identification and space-time analysis using taxi trajectories. Computers, Environment and Urban Systems, 52, 34–47.
   Web of Science ®Google Scholar
• Zhu, D., et al., 2020. Understanding place characteristics in geographic contexts through graph convolutional neural networks. Annals of the American Association of Geographers, 110 (2), 408–420.
   Web of Science ®Google Scholar