136
Views
3
CrossRef citations to date
0
Altmetric
Section B

Integrating data and compute-intensive workflows for uncertainty quantification in large-scale simulation: application to model-based hazard analysis

, &
Pages 730-747 | Received 15 Apr 2013, Accepted 09 Sep 2013, Published online: 16 Jan 2014
 

Abstract

Complex inference from simulation ensembles used in uncertainty quantification leads to twin computational challenges of managing large amount of data and performing CPU-intensive computing. While algorithmic innovations using surrogates, localization and parallelization can make the problem feasible, one still has very large data and compute tasks. The problem of dealing with large data gets compounded when data warehousing and data mining are intertwined with computationally expensive tasks. We present here an approach to solving this problem by using a mix of hardware suitable for each task in a carefully orchestrated workflow. The computing environment is essentially an integration of Netezza database and high-performance cluster. It is based on the simple idea of segregating the data-intensive and compute-intensive tasks and assigning the right architecture for them. We present here the layout of the computing model and the new computational scheme adopted to generate probabilistic hazard maps.

1999 AMS Subject Classification::

Acknowledgements

This research was supported in part by NSF grants ACI 1118260, DMS 1228217. We would like to acknowledge the discussions with Taruna Seth on Netezza implementation.

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 61.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 1,129.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.