Advanced search
Publication Cover
International Journal of Digital Earth Volume 9, 2016 - Issue 1
Submit an article Journal homepage
3,837
Views
126
CrossRef citations to date
0
Altmetric
Original Articles

Big Data Analytics for Earth Sciences: the EarthServer approach

Peter BaumannLarge-Scale Scientific Information Systems, Jacobs University, Bremen, Germany;Rasdaman GmbH, Bremen, GermanyCorrespondence[email protected]
View further author information
,
Paolo MazzettiCNR-IIA, National Research Council of Italy, Institute of Atmospheric Pollution Research, Florence, ItalyView further author information
,
Joachim UngarEOX IT Services GmbH, Vienna, AustriaView further author information
,
Roberto BarberaConsorzio COMETA, Catania, Italy;Division of Catania, Italian National Institute for Nuclear Physics, Catania, Italy;Department of Physics and Astronomy, University of Catania, Catania, ItalyView further author information
,
Damiano BarboniMEEO S.r.l., Ferrara, ItalyView further author information
,
Alan BeccatiLarge-Scale Scientific Information Systems, Jacobs University, Bremen, GermanyView further author information
,
Lorenzo BigagliCNR-IIA, National Research Council of Italy, Institute of Atmospheric Pollution Research, Florence, ItalyView further author information
,
Enrico BoldriniCNR-IIA, National Research Council of Italy, Institute of Atmospheric Pollution Research, Florence, ItalyView further author information
,
Riccardo BrunoConsorzio COMETA, Catania, Italy;Division of Catania, Italian National Institute for Nuclear Physics, Catania, ItalyView further author information
,
Antonio CalanducciDivision of Catania, Italian National Institute for Nuclear Physics, Catania, ItalyView further author information
,
Piero CampalaniLarge-Scale Scientific Information Systems, Jacobs University, Bremen, GermanyView further author information
,
Oliver ClementsPlymouth Marine Laboratory, Plymouth, UKView further author information
,
Alex DumitruLarge-Scale Scientific Information Systems, Jacobs University, Bremen, GermanyView further author information
,
Mike GrantPlymouth Marine Laboratory, Plymouth, UKView further author information
,
Pasquale HerzigFraunhofer IGD, Darmstadt, GermanyView further author information
,
George KakaletrisAthena Research and Innovation Center in Information Communication & Knowledge Technologies, Athens, GreeceView further author information
,
John LaxtonBritish Geological Survey, Edinburgh, UKView further author information
,
Panagiota KoltsidaAthena Research and Innovation Center in Information Communication & Knowledge Technologies, Athens, GreeceView further author information
,
Kinga LipskochLarge-Scale Scientific Information Systems, Jacobs University, Bremen, GermanyView further author information
,
Alireza Rezaei MahdirajiLarge-Scale Scientific Information Systems, Jacobs University, Bremen, GermanyView further author information
,
Simone MantovaniMEEO S.r.l., Ferrara, ItalyView further author information
,
Vlad MerticariuLarge-Scale Scientific Information Systems, Jacobs University, Bremen, GermanyView further author information
,
Antonio MessinaSoftware Engineering Italia S.r.l., Catania, ItalyView further author information
,
Dimitar MisevLarge-Scale Scientific Information Systems, Jacobs University, Bremen, GermanyView further author information
,
Stefano NataliMEEO S.r.l., Ferrara, ItalyView further author information
,
Stefano NativiCNR-IIA, National Research Council of Italy, Institute of Atmospheric Pollution Research, Florence, ItalyView further author information
,
Jelmer OosthoekLarge-Scale Scientific Information Systems, Jacobs University, Bremen, GermanyView further author information
,
Marco PappalardoSoftware Engineering Italia S.r.l., Catania, ItalyView further author information
,
James PassmoreBritish Geological Survey, Keyworth, UKView further author information
,
Angelo Pio RossiLarge-Scale Scientific Information Systems, Jacobs University, Bremen, GermanyView further author information
,
Francesco RundoConsorzio COMETA, Catania, ItalyView further author information
,
Marcus SenBritish Geological Survey, Keyworth, UKView further author information
,
Vittorio SorberaConsorzio COMETA, Catania, ItalyView further author information
,
Don SullivanNASA Ames Research Center, Moffett Field, CA, USAView further author information
,
Mario TorrisiDivision of Catania, Italian National Institute for Nuclear Physics, Catania, ItalyView further author information
,
Leonardo TrovatoSoftware Engineering Italia S.r.l., Catania, ItalyView further author information
,
Maria Grazia VeratelliMEEO S.r.l., Ferrara, ItalyView further author information
&
Sebastian WagnerFraunhofer IGD, Darmstadt, GermanyView further author information
 show all
Pages 3-29 | Received 03 Oct 2014, Accepted 23 Dec 2014, Published online: 02 Mar 2015

References

  • Aiordachioaie, Andrei, and Peter Baumann. 2010. “PetaScope: An Open-source Implementation of the OGC WCS Geo Service Standards Suite.” In Proceedings of the 22nd International Conference on Scientific and Statistical Database Management, edited by Michael, Gertz, and Bertram Ludäscher, 160–168. Heidelberg: Springer.
  • ARDA Project. 2012. AMGA – Overview. Aprile 16. http://amga.web.cern.ch/amga/.
  • “Array DBMS.” 2014. Wikipedia, Agosto 20. http://en.wikipedia.org/wiki/Array_DBMS.
  • Bargellini, Pier, Cheli Simonetta, Yves-Louis Desnos, Bruno Greco, veronica Guidetti, Marchetti Pier Giorgio, Carmen Comparetto, Stefano Nativi, and Geoff Sawyer. 2013. Big Data from Space – Event Report. Frascati: ESA. http://www.congrexprojects.com/docs/default-source/13c10_docs/13c10_event_report.pdf?sfvrsn=2.
  • Baumann, Peter. 1994. “Management of Multidimensional Discrete Data.” The VLDB Journal 3 (4): 401–444. doi:10.1007/BF01231603.
  • Baumann, Peter. 2008. Web Coverage Processing Service (WCPS) Implementation Specification, OGC 08-068. Version 1.0. OGC. http://www.opengeospatial.org/standards/.
  • Baumann, P. 2009. “Array Databases and Raster Data Management.” In Encyclopedia of Database Systems, edited by L. Liu, and T. Özsu. Heidelberg: Springer. www.opengeospatial.org/standards/.
  • Baumann, Peter. 2010. “The OGC Web Coverage Processing Service (WCPS) Standard.” Geoinformatica 14 (4): 447–479. doi:10.1007/s10707-009-0087-2.
  • Baumann, Peter. 2012a. “OGC GML Application Schema – Coverages.” OGC 09-146r2. Version 1.0. OGC.
  • Baumann, Peter. 2012b. “OGC® WCS 2.0 Interface Standard – Core.” OGC 09-110r4. Version 2.0. OGC.
  • Baumann, Peter, Piero Campalani, Jinsongdi Yu, and Dimitar Misev. 2012. “Finding My CRS: A Systematic Way of Identifying CRSs.” In Proceedings of the 20th International Conference on Advances in Geographic Information Systems, 71–78. Redondo Beach, CA: ACM, ISBN 978-1-4503-1697-2.
  • Baumann, Peter, Bill Howe, Kjell Orsborn, and Silvia Stefanova. 2011. “EDBT/ICDT Workshop on Array Databases.” Proceedings of 2011 EDBT/ICDT Workshop on Array Databases, Uppsala, Sweden.
  • Baumann, Peter, and Stephan Meissl. 2010. OGC WCS 2.0 Application Profile Earth Observation. OGC 10-140. Version 1.0. OGC.
  • BGS. 2013. Geology Service Home Page. British Geological Survey. Accessed September 1, 2013. http://earthserver.bgs.ac.uk/.
  • Bruno, Riccardo, and Roberto Barbera. 2013. “The EarthServer Project and Its Lighthouse Applications: Exploiting Science Gateways and Mobile Clients for Big Earth Data Analysis.” In Proceedings International Symposium on Grids and Clouds (ISGC). Taipei: Academia Sinica.
  • Cantini, Federico, Angelo Pio Rossi, Roberto Orosei, Peter Baumann, Dimitar Misev, Jelmer Oosthoek, Alan Beccati, Piero Campalani, and Vikram Unnitan. 2014. MARSIS Data and Simulation Exploited Using Array Databases: PlanetServer/EarthServer for Sounding Radars. Vienna: Geophysical Research Abstracts.
  • Clements, Oliver, and Peter Walker. 2013. EarthServer Project Deliverable D240.12. Plymouth: PML.
  • D3. 2013. Data-Driven Documents. Accessed 2014. http://d3js.org/.
  • Domenico, Ben. 2010. OGC CF-netCDF Core and Extensions Primer. OGC 10-091r1. Version 1.0. OGC.
  • Domenico, Ben. 2011. OGC Network Common Data form (NetCDF) Core Encoding Standard Version 1.0. OGC. http://portal.opengeospatial.org/files/?artifact_id=43732.
  • Domenico, Ben. 2012. OGC Network Common Data form (NetCDF) NetCDF Enhanced Data Model Extension Standard. OGC. https://portal.opengeospatial.org/files/?artifact_id=50294.
  • Domenico, Ben, and Stefano Nativi. 2013. CF-netCDF3 Data Model Extension Standard. OGC. https://portal.opengeospatial.org/files/?artifact_id=51908.
  • Dumitru, A., V. Merticariu, P. Baumann. 2014. Exploring Cloud Opportunities from an Array Database Perspective. Snowbird, USA: Proceeding of the ACM SIGMOD Workshop on Data analytics in the Cloud (DanaC’2014).
  • EOX. 2013. CryoService Home Page. EOX. Accessed September 1, 2013. http://earthserver.eox.at.
  • ESA. 2014. Multi-sensor Evolution Analysis. 28 Aprile. http://wiki.services.eoportal.org/tiki-index.php?page=Multi-sensor+Evolution+Analysis.
  • Gupta, R. P. 2003. Remote Sensing Geology. Berlin: Springer.
  • Gwinner, Klaus, Frank Scholten, Frank Preusker, Stephan Elgner, Thomas Roatsch, Michael Spiegel, Ralph Schmidt, Jurgen Oberst, Ralf Jaumann, and Christian Heipke. 2010. “Topography of Mars from Global Mapping by HRSC High-resolution Digital Terrain Models and Orthoimages: Characteristics and Performance.” Earth and Planetary Science Letters 294 (3): 506–519. doi:10.1016/j.epsl.2009.11.007.
  • Heather, David J, Maud Barthelemy, Nicolas Manaud, Santa Martinez, Marek Szumlas, Jose Luis Vazquez, and Pedro Osuna. 2013. “ESA's Planetary Science Archive: Status, Activities and Plans.” European Planetary Science Congress. http://www.epsc2013.eu/.
  • Herzig, Pasquale, Michael Englert, Sebastian Wagner, and Yvonne Jung. 2013. “X3D-EarthBrowser: Visualize Our Earth in Your Web Browser.” Web3D’13 Proceedings of the 18th International Conference on 3D Web Technology. San Sebastian: ACM New York.
  • Hey, Tony, and Anne E. Trefethen. 2002. “The UK e-Science Core Programme and the Grid.” International Journal for e-Learning Security (IJeLS) 1 (1/2): 1017–1031.
  • Hirtl, Marcus, Simone Mantovani, Bernd C. Krüger, Gerhard Triebnig, Claudia Flandorfer, and Maurizio Bottoni. 2014. “Improvement of Air Quality Forecasts with Satellite and Ground Based Particulate Matter Observations.” Atmospheric Environment 1: 20–27.
  • Houghton, Nigel. 2013. “ESA Reprocessing. A Service Based Approach.” Big Data from Space. Frascati. http://www.congrexprojects.com/docs/default-source/13c10_docs/session-2a.zip.
  • Hovmöller, Ernest. 1949. “The Trough-and-Ridge Diagram.” Tellus 1 (2): 62–66.
  • Howard, Andrew, Bill Hatton, Femke Reitsma, and Kenneth Lawrie. 2009. “Developing a Geoscience Knowledge Framework for a National Geological Survey Organisation.” Computers and Geosciences 35 (4): 820–835.
  • Iacono-Manno, Marcello, Marco Fargetta, Roberto Barbera, Alberto Falzone, Giuseppe Andronico, Salvatore Monforte, Annamaria Muoio, et al. 2010. “The Sicilian Grid Infrastructure for High Performance Computing.” International Journal of Distributed Systems and Technologies 1: 40–54.
  • ISO. 2005. Geographic Information – Schema for Coverage Geometry and Functions. ISO 19123:2005.
  • Jacobs University Bremen and Rasdaman GmbH. 2013. Rasdaman Project, Standards and Demonstrator Page. Accessed September 15, 2013. http://standards.rasdaman.org/.
  • Jaumann, Ralf, Gerhard Neukum, Thomas Behnke, Thomas C. Duxbury, Karin Eichentopf, Joachim Flohrer, Stephan van Gasselt, et al. 2007. “The High-resolution Stereo Camera (HRSC) Experiment on Mars Express: Instrument Aspects and Experiment Conduct from Interplanetary Cruise Through the Nominal Mission.” Planetary and Space Science 55 (7): 928–952.
  • Kakaletris, George, Panagiota Koltsida, Thanassis Perperis, and Peter Baumann. 2013. EarthServer Project Deliverable, Query Language Pilot, D330.12. EarthServer Project.
  • Kersten, M., Y. Zhang, M. Ivanova, and N. Nes. 2011. “SciQL, a Query Language for Science Applications.” Proceedings of the Workshop on Array Databases, Uppsala.
  • Laney, Doug. 2001. 3D Data Management. Controlling Data Volume, Velocity, and Variety in Application Delivery Strategy. Stamford: META Group.
  • Lankester, Thomas. 2009. OpenGIS Web Map Services – Profile for EO Products. OGC 07-063r1.
  • Laxton, John, Marcus Sen, James Passmore, and Simon Burden. 2013. EarthServer Project Deliverable D250.11, OGC 07-063r1. Nottingham: BGS.
  • Malin, Michael C., James F. Bell, Bruce A. Cantor, Michael A. Caplinger, Wendy M. Calvin, Robert Todd Clancy, Kenneth S. Edgett, et al. 2007. “Context Camera Investigation on Board the Mars Reconnaissance Orbiter.” Journal of Geophysical Research: Planets 112: 2156–2202. doi:10.1029/2006JE002808.
  • Mantovani, Simone, Damiano Barboni, and Stefano Natali. 2013. EarthServer Project Deliverable D230.12. Ferrara: MEEO.
  • Mazzetti, Paolo, Angelo Pio Rossi, Oliver Clements, Simone Mantovani, Stefano Natali, Maria Grazia Veratelli, Joachim Ungar, and John Laxton. 2013. Community Reporting. EarthServer Deliverable D120.21.
  • Mazzetti, Paolo, John Laxton, Maria Grazia Veratelli, and Mike Grant. 2012. Community Reporting. EarthServer Deliverable D120.21.
  • McMahon, Susan K. 1996. “Overview of the Planetary Data System.” Planetary and Space Science 44 (1): 3–12.
  • MEEO. 2013. Climate Data Service Home Page. MEEO. Accessed September 1, 2013. http://earthserver.services.meeo.it/.
  • Merticariu, George. 2014. “Keeping 1001 Nodes Busy.” BSc diss., Bremen: Jacobs University.
  • Misev, Dimitar, Mihaela Rusu, and Peter Baumann. 2012. “A Semantic Resolver for Coordinate Reference Systems.” Proceedings of 11th International Symposium on Web and Wireless Geographical Information Systems (W2GIS), 47–56. Naples: Springer.
  • Monaghan, A. A., S. L. B. Arkley, K. Whitbread, and M. McCormac. 2014. Clyde Superficial Deposits and Bedrock Models Released to the ASK Network 2014: A Guide for Users. Version 3. Nottingham: British Geological Survey.
  • Murchie, Scott L., Raymond E. Arvidson, Peter Bedini, K. Beisser, J. P. Bibring, J. Bishop, J. Boldt, et al. 2007. “Compact Reconnaissance Imaging Spectrometer for Mars (CRISM) on Mars Reconnaissance Orbiter (MRO).” Journal of Geophysical Research: Planets 112 (5): 2156–2202. doi:10.1029/2006JE002682.
  • OGC. 2007. Abstract Specification Topic 6: Schema for Coverage Geometry and Functions. OGC 07-011. Version 7.0. OGC.
  • Oosthoek, J. H. P., J. Flahaut, A. P. Rossi, P. Baumann, D. Misev, P. Campalani, and V. Unnithan. 2013. “PlanetServer: Innovative Approaches for the Online Analysis of Hyperspectral.” Advances in Space Research 23 (12): 1858–1871. doi:10.1016/j.asr.2013.07.002.
  • Oracle. n.d. Accessed June 10, 2014. http://www.oracle.com.
  • Paragon. n.d. PostGIS. Accessed June 10, 2014. http://www.postgis.org.
  • Petitdidier, Monique, Roberto Cossu, Paolo Mazzetti, Peter Fox, Horst Schwichtenberg, and Wim Som de Cerff. 2009. “Grid in Earth Sciences.” Earth Science Informatics 2: 1–3.
  • PML. 2013a. Ocean Data Service Home Page. PML. Accessed September 1, 2013. http://earthserver.pml.ac.uk/portal.
  • PML. 2013b. WCPS How to Pages (EarthServer: Ocean Data Service). Accessed September 14, 2013. http://earthserver.pml.ac.uk/portal/how_to/.
  • “Rasdaman.” 2013. Wikipedia, December 29. http://en.wikipedia.org/wiki/Rasdaman.
  • Rasdaman GmbH. 2013. Rasdaman Query Language Guide. 8.4 ed., 91. Bremen: Rasdaman GmbH.
  • Rossi, Angelo Pio, and Jelmer Oosthoek. 2013. EarthServer Project Deliverable D260.12. Bremen: Jacobs University Bremen.
  • Sarawagi, Sunita, and Michael Stonebraker. 1994. “Efficient Organization of Large Multidimensional Arrays.” Proceedings of the 11th IEEE ICDE Conference, Hannover, Germany, 328–336.
  • SciDB. n.d. SciDB. Accessed June 10, 2014. http://www.scidb.org.
  • Square. 2012. Cubism.js. https://square.github.io/cubism/.
  • Teradata. n.d. Accessed June 10, 2014. http://www.teradata.com.
  • UCAR. n.d. Network Common Data Form (NetCDF). Accessed March 27, 2014. http://www.unidata.ucar.edu/software/netcdf/.
  • Ungar, Joachim. 2013. EarthServer Project Deliverable D220.12. Wien: EOX.
  • W3C. 2014. “XQuery 3.0: An XML Query Language.” http://www.w3.org/TR/2014/REC-xquery-30-20140408/.
  • X3DOM. n.d. x3dom Homepage. http://www.x3dom.org.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.