GSio: A programmatic interface for delivering Big Earth data-as-a-service

References

• Abadi, D. J., Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Lee, S., … Zdonik, S. (2003). Aurora: A new model and architecture for data stream management. The VLDB Journal – The International Journal on Very Large Data Bases, 12(2), 120–139.10.1007/s00778-003-0095-z
   Google Scholar
• Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., … Devin, M. (2016). Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:1603.04467.
   Google Scholar
• Baumann, P., Dehmel, A., Furtado, P., Ritsch, R., & Widmann, N. (1998). The multidimensional database system RasDaMan. Proceedings of the 1998 ACM SIGMOD international conference on Management of data, 575–7. Seattle, Washington: ACM.
   Google Scholar
• Baumann, P., Mazzetti, P., Ungar, J., Barbera, R., Barboni, D., Beccati, A., … Calanducci, A. (2016). Big data analytics for earth sciences: The earthserver approach. International Journal of Digital Earth, 9(1), 3–29.10.1080/17538947.2014.1003106
   Web of Science ®Google Scholar
• Borthakur, D. (2008). HDFS architecture guide. Hadoop Apache Project 53.
   Google Scholar
• Dean, J., & Ghemawat, S. (2008). MapReduce: Simplified data processing on large clusters. Communications of the ACM, 51(1), 107–113.10.1145/1327452
   Web of Science ®Google Scholar
• Dee, D. P., Uppala, S. M., Simmons, A. J., Berrisford, P., Poli, P., Kobayashi, S., … Bauer, P. (2011). The ERA-interim reanalysis: Configuration and performance of the data assimilation system. Quarterly Journal of the Royal Meteorological Society, 137(656), 553–597.10.1002/qj.v137.656
   Web of Science ®Google Scholar
• Deoliveira, J. (2008). GeoServer: Uniting the GeoWeb and spatial data infrastructures. Paper presented at the Proceedings of the 10th International Conference for Spatial Data Infrastructure, St. Augustine, Trinidad.
   Google Scholar
• Domenico, B., Caron, J., Davis, E., Kambic, R., & Nativi, S. (2006). Thematic real-time environmental distributed data services (thredds): Incorporating interactive analysis tools into nsdl. Journal of Digital Information, 2(4).
   Google Scholar
• Evans, B., Wyborn, L., Pugh, T., Allen, C., Antony, J., Gohar, K., … Wang, J. (2015). The NCI high performance computing and high performance data platform to support the analysis of petascale environmental data collections. Paper presented at the International Symposium on Environmental Software Systems.
   Google Scholar
• GitHub.com. (2017). S2 geometry libary in go. Retrieved October 18, 2017 from https://github.com/golang/geo
   Google Scholar
• Google. (2017a). Go concurrency patters: Pipelines and cancellation. Retrieved October 18, 2017 from https://blog.golang.org/pipelines
   Google Scholar
• Google. (2017b). grpc.io. Retrieved October 18, 2017 from https://grpc.io/
   Google Scholar
• GopherAcademy. (2017). Composable pipelines improved. Retreived October 18, 2017, from https://blog.gopheracademy.com/advent-2015/composable-pipelines-improvements/
   Google Scholar
• Gorelick, N., Hancher, M., Dixon, M., Ilyushchenko, S., Thau, D., & Moore, R. (2017). Google earth engine: Planetary-scale geospatial analysis for everyone. Remote Sensing of Environment.
   Web of Science ®Google Scholar
• Guerschman, J. P., Held, A. A., Donohue, R. J., Renzullo, L. J., Sims, N., Kerblat, F., & Grundy, M. (2015). The GEOGLAM rangelands and pasture productivity activity: Recent progress and future directions. Paper presented at the AGU Fall Meeting Abstracts.
   Google Scholar
• Guo, H., Wang, L., Chen, F., & Liang, D. (2014). Scientific big data and digital earth. Chinese Science Bulletin, 59(35), 5066–5073.10.1007/s11434-014-0645-3
   Google Scholar
• Guo, H., Wang, L., & Liang, D. (2016). Big earth data from space: A new engine for Earth science. Science Bulletin, 61(7), 505–513.10.1007/s11434-016-1041-y
   Web of Science ®Google Scholar
• Haller, P. (2012). On the integration of the actor model in mainstream technologies: The scala perspective. Paper presented at the Proceedings of the 2nd edition on Programming systems, languages and applications based on actors, agents, and decentralized control abstractions.
   Google Scholar
• HDF-Group. (2017). HDF-cloud. Retrieved from https://www.hdfgroup.org/hdf-cloud/
   Google Scholar
• Iglovikov, V., Mushinskiy, S., & Osin, V. (2017). Satellite imagery feature detection using deep convolutional neural network: A Kaggle competition. arXiv preprint arXiv:1706.06169.
   Google Scholar
• Kini, A., & Emanuele, R. (2014). Geotrellis: Adding geospatial capabilities to spark. Spark Summit.
   Google Scholar
• Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. Paper presented at the Advances in neural information processing systems.
   Google Scholar
• Larraondo, P. R., Inza, I., & Lozano, J. A. (2017). Automating weather forecasts based on convolutional networks. In Proceedings of ICML Workshop on Deep Structured Predictions.
   Google Scholar
• Larraondo, P. R., Pringle, S., Antony, J., & Evans, B. (2017). GSKY: A scalable, distributed geospatial data-server. In Proceedings of the Academic Research Stream at the Annual Conference Locate, Research@Locate 2017, co-located with Digital Earth & Locate 2017 1913 (pp. 7–12).
   Google Scholar
• Lewis, A., Oliver, S., Lymburner, L., Evans, B., Wyborn, L., Mueller, N., … Sixsmith, J. (2017). The Australian geoscience data cube – Foundations and lessons learned. Remote Sensing of Environment.
   Web of Science ®Google Scholar
• Li, Y., Tao, C., Tan, Y., Shang, K., & Tian, J. (2016). Unsupervised multilayer feature learning for satellite image scene classification. IEEE Geoscience and Remote Sensing Letters, 13(2), 157–161.10.1109/LGRS.2015.2503142
   Web of Science ®Google Scholar
• Lienou, M., Maitre, H., & Datcu, M. (2010). Semantic annotation of satellite images using latent Dirichlet allocation. IEEE Geoscience and Remote Sensing Letters, 7(1), 28–32.10.1109/LGRS.2009.2023536
   Web of Science ®Google Scholar
• Michailidis, P. D., & Margaritis, K. G. (2016). Scientific computations on multi-core systems using different programming frameworks. Applied Numerical Mathematics, 104, 62–80.10.1016/j.apnum.2014.12.008
   Web of Science ®Google Scholar
• Morrison, J. P. (2010). Flow-based programming: A new approach to application development: CreateSpace. Retrieved from https://dl.acm.org/citation.cfm?id=1859470
   Google Scholar
• Nativi, S., Caron, J., Domenico, B., & Bigagli, L. (2008). Unidata’s common data model mapping to the ISO 19123 data model. Earth Science Informatics, 1(2), 59–78.10.1007/s12145-008-0011-6
   Web of Science ®Google Scholar
• Palankar, M. R., Iamnitchi, A., Ripeanu, M., & Garfinkel, S. (2008). Amazon S3 for science grids: A viable solution? Paper presented at the Proceedings of the 2008 international workshop on Data-aware distributed computing.
   Google Scholar
• Pike, R. (2012). Go at Google. Proceedings of the 3rd annual conference on Systems, programming, and applications: Software for humanity, 5–6. Tucson, Arizona: ACM.
   Google Scholar
• Sagar, S., Roberts, D., Bala, B., & Lymburner, L. (2017). Extracting the intertidal extent and topography of the Australian coastline from a 28 year time series of Landsat observations. Remote Sensing of Environment, 195, 153–169.10.1016/j.rse.2017.04.009
   Web of Science ®Google Scholar
• Schwan, P. (2003). Lustre: Building a file system for 1000-node clusters. Paper presented at the Proceedings of the 2003 Linux symposium.
   Google Scholar
• Stonebraker, M., Brown, P., Zhang, D., & Becla, J. (2013). SciDB: A database management system for applications with complex analytics. Computing in Science & Engineering, 15(3), 54–62.10.1109/MCSE.2013.19
   Web of Science ®Google Scholar
• Wagemann, J., Clements, O., Figuera, R. M., Rossi, A. P., & Mantovani, S. (2017). Geospatial web services pave new ways for server-based on-demand access and processing of Big Earth Data. International Journal of Digital Earth, 1–19.10.1080/17538947.2017.1351583
   Web of Science ®Google Scholar
• Warmerdam, F. (2008). The geospatial data abstraction library. Open Source Approaches in Spatial Data Handling, 87–104.10.1007/978-3-540-74831-1
   Google Scholar
• West, P., Fox, P. A., Gallagher, J., Potter, N., Holloway, D., & Zednik, S. (2011). OPeNDAP Hyrax: An extensible data access framework within the Earth System Grid Federation. Paper presented at the AGU Fall Meeting Abstracts.
   Google Scholar
• Wyborn, L., & Evans, B. J. K. (2015). Integrating ‘Big’ geoscience data into the petascale national environmental research interoperability platform (NERDIP): Successes and unforeseen challenges. Paper presented at the Big Data (Big Data), 2015 IEEE International Conference.
   Google Scholar
• Zheng, Z., Zhu, J., & Lyu, M. R. (2013). Service-generated big data and big data-as-a-service: An overview. Paper presented at the Big Data (BigData Congress), 2013 IEEE International Conference.
   Google Scholar