Integrating memory-mapping and N-dimensional hash function for fast and efficient grid-based climate data query

References

• Baumann, P. 1999. “A Database Array Algebra for Spatio-temporal Data and Beyond.” In International Workshop on Next Generation Information Technologies and Systems, 76–93. Berlin, Heidelberg: Springer.
   Google Scholar
• Baumann, P., A. Dehmel, P. Furtado, R. Ritsch, and N. Widmann. 1998. “The Multidimensional Database System RasDaMan.” Acm Sigmod Record 27 (2): 575–577. doi:10.1145/276305.
   Google Scholar
• Baumann, P., A. Dehmel, P. Furtado, R. Ritsch, and N. Widmann. 1999. “Spatio-temporal Retrieval with RasDaMan.” In VLDB, 746–749. The 25th VLDB Conference, Edinburgh, Scotland.
   Google Scholar
• Baumann, P., A. M. Dumitru, and V. Merticariu. 2013. “The Array Database that Is Not a Database: File Based Array Query Answering in Rasdaman.” In International Symposium on Spatial and Temporal Databases, 478–483. Berlin, Heidelberg: Springer.
   Google Scholar
• Blumenfeld, J., 2015. Getting Petabytes To People: How EOSDIS Facilitates Earth Observing Data Discovery And Use | Earthdata. [online] Earthdata.nasa.gov
   Google Scholar
• Boncz, P. A., M. Zukowski, and N. Nes. 2005. “MonetDB/X100: Hyper-Pipelining Query Execution.” In Cidr 5: 225–237.
   Google Scholar
• Boncz, P. A., M. L. Kersten, and S. Manegold. 2008. “Breaking the Memory Wall in MonetDB.” Communications of the ACM 51 (12): 77–85. doi:10.1145/1409360.1409380.
   Web of Science ®Google Scholar
• Brown, P. G. 2010. “Overview of SciDB: Large Scale Array Storage, Processing and Analysis.” In Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, 963–968. Indianapolis, Indiana: ACM.
   Google Scholar
• Cudre-Mauroux, P., H. Kimura, K.-T. Lim, J. Rogers, S. Madden, M. Stonebraker, S. B. Zdonik, and P. G. Brown. 2010. “Ss-db: A Standard Science Dbms Benchmark.” Under submission.
   Google Scholar
• Cudré-Mauroux, P., K.-T. Hideaki Kimura, J. R. Lim, R. Simakov, E. Soroush, P. Velikhov et al. 2009. “A Demonstration of SciDB: A Science-oriented DBMS.” Proceedings of the VLDB Endowment 2 (2), 1534–1537.
   Google Scholar
• Cuzzocrea, A., I.-Y. Song, and K. C. Davis. 2011. “Analytics over Large-scale Multidimensional Data: The Big Data Revolution!” In Proceedings of the ACM 14th international workshop on Data Warehousing and OLAP, 101–104. Glasgow Scotland: ACM.
   Google Scholar
• Das, K., T. Clune, K. S. Kuo, C. A. Mattmann, T. Huang, D. Duffy, C. P. Yang, and T. Habermann, 2015. “Evaluation of Big Data Containers for Popular Storage, Retrieval, and Computation Primitives in Earth Science Analysis.” In AGU Fall Meeting Abstracts, December. San Francisco.
   Google Scholar
• Hu, F., X. Mengchao, J. Yang, Y. Liang, K. Cui, M. Little, C. Lynnes, D. Duffy, and C. Yang. 2018. “Evaluating the Open Source Data Containers for Handling Big Geospatial Raster Data.” ISPRS International Journal of Geo-Information 7 (4): 144. doi:10.3390/ijgi7040144.
   Web of Science ®Google Scholar
• Idreos, S., F. Groffen, N. Nes, S. Manegold, S. Mullender, and M. Kersten. 2012. “MonetDB: Two Decades of Research in Column-oriented Database.”
   Google Scholar
• Kersten, M., Y. Zhang, M. Ivanova, and N. Nes. 2011. “SciQL, a Query Language for Science Applications.” In Proceedings of the EDBT/ICDT 2011 Workshop on Array Databases, 1–12. Uppsala, Sweden: ACM.
   Google Scholar
• Li, Z., H. Fei, J. L. Schnase, D. Q. Duffy, T. Lee, M. K. Bowen, and C. Yang. 2017. “A Spatiotemporal Indexing Approach for Efficient Processing of Big Array-based Climate Data with MapReduce.” International Journal of Geographical Information Science 31 (1): 17–35. doi:10.1080/13658816.2015.1131830.
   Web of Science ®Google Scholar
• Libkin, L., R. Machlin, and L. Wong. 1996. “A Query Language for Multidimensional Arrays: Design, Implementation, and Optimization Techniques.” ACM SIGMOD Record 25 (2): 228–239. ACM. doi: 10.1145/235968.
   Google Scholar
• Marathe, A. P., and K. Salem. 1997. “A Language for Manipulating Arrays.” VLDB 97: 46–55.
   Google Scholar
• Planthaber, G., M. Stonebraker, and J. Frew. 2012. “EarthDB: Scalable Analysis of MODIS Data Using SciDB.” In Proceedings of the 1st ACM SIGSPATIAL International Workshop on Analytics for Big Geospatial Data, 11–19. Redondo Beach, California: ACM.
   Google Scholar
• Reiner, B., K. Hahn, G. Höfling, and P. Baumann. 2002. “Hierarchical Storage Support and Management for Large-scale Multidimensional Array Database Management Systems.” In International Conference on Database and Expert Systems Applications, 689–700. Berlin, Heidelberg: Springer.
   Google Scholar
• Song, J., C. Guo, Z. Wang, Y. Zhang, Y. Ge, and J.-M. Pierson. 2015. “HaoLap: A Hadoop Based OLAP System for Big Data.” Journal of Systems and Software 102: 167–181. doi:10.1016/j.jss.2014.09.024.
   Web of Science ®Google Scholar
• Soroush, E., and M. Balazinska. 2013. “Time Travel in a Scientific Array Database.” In 2013 IEEE 29th International Conference on Data Engineering (ICDE), 98–109. Brisbane, QLD, Australia: IEEE.
   Google Scholar
• Stonebraker, M., J. Duggan, L. Battle, and O. Papaemmanouil. 2013b. “SciDB DBMS Research at MIT.” IEEE Data Engineering Bulletin 36 (4): 21–30.
   Google Scholar
• Stonebraker, M., P. Brown, D. Zhang, and J. Becla. 2013a. “SciDB: A Database Management System for Applications with Complex Analytics.” Computing in Science & Engineering 15 (3): 54. doi:10.1109/MCSE.2013.19.
   Web of Science ®Google Scholar
• Tan, Z., and P. Yue. 2016. “A Comparative Analysis to the Array Database Technology and Its Use in Flexible VCI Derivation.” In 2016 Fifth International Conference on Agro-Geoinformatics (Agro-Geoinformatics), 1–5. Tianjin, China: IEEE.
   Google Scholar
• van Ballegooij, A., R. Cornacchia, A. P. de Vries, and M. Kersten. 2005. “Distribution Rules for Array Database Queries.” In International Conference on Database and Expert Systems Applications, 55–64. Berlin, Heidelberg: Springer.
   Google Scholar
• van Ballegooij, A. R. 2004. “RAM: A Multidimensional Array DBMS.” In International Conference on Extending Database Technology, 154–165. Berlin, Heidelberg: Springer.
   Google Scholar
• Yang, C., Q. Huang, L. Zhenlong, K. Liu, and H. Fei. 2017. “Big Data and Cloud Computing: Innovation Opportunities and Challenges.” International Journal of Digital Earth 10 (1): 13–53. doi:10.1080/17538947.2016.1239771.
   Web of Science ®Google Scholar
• Zhang, Y., M. Kersten, M. Ivanova, and N. Nes. 2011. “SciQL: Bridging the Gap between Science and Relational DBMS.” In Proceedings of the 15th Symposium on International Database Engineering & Applications, 124–133. Lisboa, Portugal: ACM.
   Google Scholar