A framework for uncertainty assessment in simulation models

Abstract

In this article, we introduce a conceptual framework for systematic identification and assessment of sources of uncertainty in simulation models. This concept builds on a novel typology of uncertainty in model validation and extends the GIScience research focus on uncertainty in spatial data to uncertainty in simulation modelling. Such a concept helps a modeller to interpret and handle uncertainty in order to efficiently optimise a model and better understand simulation results.

To illustrate our approach, we apply the proposed framework for uncertainty assessment to the TREE LIne Model (TREELIM), an individual-based model that simulates forest succession at the alpine tree line. Using this example, uncertainty is identified in the modelling workflow during conceptualisation, formalisation, parameterisation, analysis and validation. With help of a set of indicators we quantify the emerging uncertainties and assess the overall model uncertainty as a function of all occurring sources of uncertainty.

An understanding of the sources of uncertainty in an ecological model proves beneficial for: (1) developing a structurally valid model in a systematic way; (2) deciding if further refinement of the conceptual model is beneficial for the modelling purpose; and (3) interpreting the overall model uncertainty by understanding its sources. Our approach results in a guideline for assessing uncertainty in the validation of simulation models in a feasible and defensible way, and thus functions as a toolbox for modellers. We consider this work as a contribution towards a general concept of uncertainty in spatially explicit simulation models.

Keywords:

• model validation
• uncertainty
• individual based model
• tree line