Sensitivity analysis and related analyses: A review of some statistical techniques

References

• Andres T. H. Sampling methods and sensitivity analysis for large parameter sets 1996 This issue
   Google Scholar
• Balson , W.E. , Welsh , J.L. and Wilson , D.S. 1992 . Using decision analysis and risk analysis to manage utility environmental risk . Interfaces , 22 ( 6 ) : 126 – 139 .
   Web of Science ®Google Scholar
• Bankes , S. 1993 . Exploratory modeling for policy analysis . Operations Research , 41 ( 3 ) : 435 – 449 .
   Web of Science ®Google Scholar
• Bankes S. Lucas T. Statistical approaches for the exploratory modeling of large complex models 1995 This issue
   Google Scholar
• Banks , J. 1989 . Testing, understanding and validating complex simulation models . Proceedings of the 1989 Winter Simulation Conference . 1989 .
   Google Scholar
• Beckman , R.J. and Mckay , M.D. 1987 . Monte Carlo estimation under different distributions using the same simulation . Technometrics , 29 ( 2 ) : 153 – 160 .
   Web of Science ®Google Scholar
• Bedford T. Meeuwissen A. M. H. The distribution of maximum entropy distributions given fixed rank correlation, and numerical approximations for use in sensitivity analyses 1996 This issue
   Google Scholar
• Bettonvil , B. 1990 . Detection of Important Factors by Sequential Bifurcation , Tilburg : Tilburg University Press .
   Google Scholar
• Bettonvil B. Kleijnen J. P. C. Searching for important factors in simulation models with many factors: sequential bifurcation European Journal of Operational Research 1996 accepted
   Web of Science ®Google Scholar
• Birge , J.R. and Rosa , C.H. 1995 . Modeling investment uncertainty in the costs of global CO2 emission policy . European Journal of Operational Research , 83 : 466 – 488 .
   Web of Science ®Google Scholar
• Brady , S.D. and Hillested , R.J. 1995 . “ Modeling the external risks of airports for policy analysis ” . Netherlands : Delft . (MR-605-EACjVW) RAND European-American Center for Policy Analysis
   Google Scholar
• 1992 . Summary description of the methods used in the probabilistic risk assessments for NUREG-1150 . Nuclear Engineering and Design , 135 : 1 – 27 .
   Web of Science ®Google Scholar
• Brehmer , B. , Eriksson , E.A. and Wulff , P. 1994 . Risk management (feature issue) . European Journal of Operational Research , 75 : 477 – 566 .
   Google Scholar
• Cardenosa , J. 1995 . Preface (to Special Issue: European verification and validation of knowledge-based systems) . Expert Systems Hlzth Applications , 8 ( 3 ) : 321 – 397 .
   Web of Science ®Google Scholar
• Cheng R. C. H. Holland W. The sensitivity of computer simulation experiments to errors in input data 1996 This issue
   Google Scholar
• Chang , J. 1990 . Optimization of multivariate simulation output models using a group screening mothod . Computers Industrial Engineering , 18 ( 1 ) : 95 – 103 .
   Web of Science ®Google Scholar
• Cooke , R.M. 1995 . UNICORN: methods and code for uncertainty analysis. The SRD , Risley, , UK : AEA Technology, Thomson House . WA3 6AT
   Google Scholar
• De Wit , M.S. Uncertainty analysis in building thermal modelling . SAM095 Proceedings .
   Google Scholar
• Downing , D.J. , Gardner , R.H. and Hoffman , F.O. 1985 . An examination of responsesurface methodologies for uncertainty analysis in assessment models . Technometrics , 27 ( 1 ) : 151 – 163 .
   Web of Science ®Google Scholar
• Downing , D.J. , Gardner , R.H. and Hoffman , F.O. 1986 . Response to Robert G. Easterling . Technometrics , 28 ( 1 ) : 92 – 93 .
   Google Scholar
• Draper , D. 1995 . Assessment and propagation of model uncertainty . Journal Royal Statistical Society,Series B , 57 ( 1 ) : 45 – 97 .
   Google Scholar
• Easterling , R.G. 1986 . Discussion of Downing, Gardner, and Hoffman (1985) . Technometrics , 28 ( 1 ) : 91 – 92 .
   Google Scholar
• Engemann , K.J. and Miller , H.E. 1992 . Operations risk management at a major bank . Interfaces , 22 ( 6 ) : 140 – 149 .
   Web of Science ®Google Scholar
• FIPS . 1979 . Guidelinesfor automatic data processing risk analysis , Washington : FIPS PUB 65(Federal Information Processing Standards Publication) .
   Google Scholar
• Harbers , A. 1993 . Onzekerheidsanalyse op een simulatiemodel voor het broeikaseffect Tilburg, , Netherlands : Tilburg University, . (Uncertainty analysis of a simulation model for the greenhouse effect.) Working Paper, School of Management and Economics
   Google Scholar
• Haverkort , B.R. and Meeuwissen , A.M.H. 1995 . Sensitivity and uncertainty analysis of Markov-reward models . IEEE Transactions on Reliability , 44 ( 1 ) : 147 – 154 .
   Web of Science ®Google Scholar
• Helton , J.C. 1993 . Uncertainty and sensitivity analysis techniques for use in performance assessment for radioactive waste disposal . Reliability Engineering and System Safety , 42 ( 1 ) : 327 – 367 .
   Web of Science ®Google Scholar
• Helton J. C. Uncertainty and sensitivity analysis in the presence of stochastic and subjective uncertainty 1996 This issue
   Google Scholar
• Helton , J.C. and Breeding , R.J. 1993 . Calculation of reactor accident safety goals . Reliability Engineering and System Safety , 39 ( 1 ) : 129 – 158 .
   Web of Science ®Google Scholar
• Helton J. C. et al. Effect of alternative conceptual models in a preliminary performance assessment for the waste isolation pilot plant Nuclear Engineering and Design 1995a 251 344
   Google Scholar
• 1995b . Robustness of an uncertainty and sensitivity analysis of early exposure results with the MACCS reactor accident consequence model . Reliability Engineering and System Safety , 48 ( 1 ) : 129 – 148 .
   Google Scholar
• Helton J. C. Garner J. W. McCurley R. D. Rudeen D. K. Sensitivity analysis techniques and results for performance assessment at the waste isolation pilot plant 1991 Sandia Report SAND90-7103
   Google Scholar
• Helton , J.C. , Garner , J.W. , Rechard , R.P. , Rudeen , D.K. and Swift , P.N. 1992 . Preliminary comparison with 40 CFR part 191, subpart B for the waste isolation pilot plant , 4 ( 1 ) uncertainty and sensitivity analysis. Sandia Report, SAND91-0893/4
   Google Scholar
• Hertz , D.B. 1964 . “ Risk analysis in capital investments ” . 95 – 106 . Harvard Business Review .
   Google Scholar
• Ho , Y. and Cao , X. 1991 . Perturbation analysis of discrete event systems , Kluwer : Dordrecht .
   Google Scholar
• Hora S. C. Sensitivity, uncertainty, and decision analyses in the prioritization of research 1995 This issue
   Google Scholar
• Iman , R.L. and Conover , W.J. 1980 . Small sample sensitivity analysis techniques for computer models, with an application to risk assessment. (Including comments and rejoinder) . Communications in Statistics , A9 ( 17 ) : 1749 – 1874 .
   Google Scholar
• Jacoby , J.E. and Harrison , S. 1962 . Multi-variable experimentation and simulation models . Naval Research Logistic Quarterly , 9 ( 17 ) : 121 – 136 .
   Google Scholar
• Janssen , P.H.M. , Heuberger , P.S.C. and Sanders , R. 1992 . “ National Institute of Public Health and Environmental Protection (RIVM) ” . In UNCSAM 1.0: a software package for sensitivity and uncertainty analysis manual Bilthoven, , The Netherlands
   Google Scholar
• Karplus , W.J. 1983 . The spectrum of mathematical models . Perspectives in Computing , 3 : 4 – 13 .
   Google Scholar
• Kleijnen , J.P.C. 1974/1975 . Statistical Techniques in Simulation, I and II , New York : Marcel Dekker . Russian translation, Publishing House “Statistics”, Moscow, 1978
   Google Scholar
• Kleijnen , J.P.C. 1979 . Regression metamodels for generalizing simulation results . IEEE Transactions on Systems, Man, and Cybernetics , 9 ( 2 ) : 93 – 96 . SMC
   Web of Science ®Google Scholar
• Kleijnen , J.P.C. 1983 . Risk analysis and sensitivity analysis: antithesis or synthesis? . Simuletter , 14 ( 2 ) : 64 – 72 .
   Google Scholar
• Kleijnen , J.P.C. 1987 . Statistical Tools for Simulation Practitioners , New York : Marcel Dekker .
   Google Scholar
• Kleijnen , J.P.C. 1993 . Simulation and optimization in production planning: a case study . Decision Support Systems , 9 : 269 – 280 .
   Web of Science ®Google Scholar
• Kleijnen , J.P.C. 1994 . “ Sensitivity analysis versus uncertainty analysis: when to use what? ” . In Predictability and nonlinear modeling in natural sciences and economics , Edited by: Grasman , J. and van Straten , G. 322 – 333 . Dordrecht, , The Netherlands : Kluwer . Preprinted in K wantitatieve Methoden, 15, 45, February 1994, 3–15
   Google Scholar
• Kleijnen , J.P.C. 1995a . Verification and validation of simulation models . European Journal of Operational Research , 82 : 145 – 162 .
   Web of Science ®Google Scholar
• Kleijnen , J.P.C. Sensitivity analysis and optimization in simulation: design of experiments and case studies . SAM095 Proceedings . Edited by: Alexopoulos , C. , Kang , K. , Lilegdon , W.R. and Goldsman , D.
   Google Scholar
• Kleijnen , J.P.C. 1995c . Case-study: statistical validation of simulation models . European Journal of Operational Research , 87 : 21 – 34 .
   Web of Science ®Google Scholar
• Kleijnen , J.P.C. 1995d . Sensitivity analysis and optimization of system dynamics models: regression analysis and statistical design of experiments . System Dynamics Review , 11 ( 4 ) : 1 – 14 .
   Web of Science ®Google Scholar
• Kleijnen , J.P.C. and Rubinstein , R.Y. 1996 . Optimization and sensitivity analysis of computer simulation models by the score function method . European Journal of Operational Research , 1 ( 4 ) : 1 – 15 .
   Google Scholar
• Kleijnen J. P. C. Bettonvil B. Van Groenendaal W. Validation of simulation models: a novel regression test Management Science 1996 accepted
   Google Scholar
• Kleijnen , J.P.C. and Van Groenendaal , W. 1992 . Simulation: a Statistical Perspective , Chichester : Wiley .
   Google Scholar
• Kleijnen , J.P.C. , Van Ham , G. and Rotmans , J. 1992 . Techniques for sensitivity analysis of simulation models: a case study of the CO 2 greenhouse effect . Simulation , 58 ( 6 ) : 410 – 417 .
   Google Scholar
• Kleijnen , J.P.C. and Sargent , R. 1996 . “ Metamodelin methodology ” . Tilburg, , Netherlands : Tilburg University .
   Google Scholar
• Kraan B.C.P. Cooke R.M. Joint CEC/USNRC accident consequence code uncertainty analysis using expert judgement 1995 This issue
   Google Scholar
• Krumm , F.V. and Rolle , C.F. 1992 . Management and application of decision and risk analysis in Du Pont . Interface , 22 ( 6 ) : 84 – 93 .
   Google Scholar
• Li , C.H. 1962 . A sequential method for screening experimental variables . American Statistical Association Journal , 57 ( 6 ) : 455 – 477 .
   Web of Science ®Google Scholar
• McKay , M.D. 1992 . “ Latin hypercube sampling as a tool in uncertainty analysis of computer models ” . In 1992 Winter Simulation Conference Proceedings New York Association for Computing Machinery
   Google Scholar
• McKay M. D. Evaluating prediction uncertainty Los Alamos National Laboratory 1995 NUREG/CR-6311 (LA-12915-MS)
   Google Scholar
• Moors , J.J.A. , Schuld , M.H. and Mathijssen , A.C.A. 1995 . “ A new method for assessing judgmental distributions ” . Tilburg, , Netherlands : Tilburg University . Research Memorandum FEW 708
   Google Scholar
• Morris , M.D. 1987 . Two-stage factor screening procedures using multiple grouping assignments . Communications in Statistics: Theory and Methods , 16 : 3051 – 3067 .
   Web of Science ®Google Scholar
• Morris , M.D. 1991 . Factorial plans for preliminary computational experiments . Technometrics , 33 ( 2 ) : 161 – 174 .
   Web of Science ®Google Scholar
• Olivi , L. 1980 . Response Surface Methodology in Risk Analysis; Synthesis and Analysis Methods for Safety and Reliability Studies , Edited by: Apostolakis , G. , Garibra , S. and Volta , G. New York : Plenum Publishing Corporation .
   Google Scholar
• Oren , T.I. Three simulation experimentation environments: SIMAD, SIMGEST, and E/SLAM . Proceedings of the 1993 European Simulation Symposium . La Jolla : Society for Computer Simulation .
   Google Scholar
• Pacheco , N.S. Session III: simulation certification, verification and validation . SDI Testing: the Road to Success; 1988 Symposium Proceedings International Test & Evaluation Association . Fairfax, Virginia : ITEA . 22033
   Google Scholar
• Patel , M.S. 1962 . Group screening with more than two stages . Technometrics , 4 ( 2 ) : 209 – 217 .
   Web of Science ®Google Scholar
• Rahni N. Ramdani N. Candau Y. Dalicieux P. Sensitivity analysis of dynamic buildings energy simulation models using group screening and sampling methods 1995 This issue
   Google Scholar
• Rao G. P. Sarkar P. K. Sensitivity studies of air scattered neutron dose from particle accelerators 1995 This issue
   Google Scholar
• Reilly , J.M. , Edmonds , J.A. , Gardner , R.H. and Brenkert , A.L. 1987 . Uncertainty analysis of the lEA/ORAU CO2 emissions model . The Energy Journal , 8 ( 3 ) : 1 – 29 .
   Google Scholar
• Reilly T. The effect of correlated variables on a one-way sensitivity analysis 1996 This issue
   Google Scholar
• Rotmans , J. 1990 . IMAGE: An Integrated Model to Assess the Greenhouse Effect , Dordrecht, , Netherlands : Kluwer .
   Google Scholar
• Rubinstein , R.Y. and Shapiro , A. 1993 . Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization via the Score Function Method , New York : Wiley .
   Google Scholar
• Sacks , J. , Welch , W.J. , Mitchell , T.J. and Wynn , H.R. 1989 . Design and analysis of computer experiments (includes comments and rejoinder) . Statistical Science , 4 ( 4 ) : 409 – 431 .
   Google Scholar
• Saltelli A. On the use of rank transformation in sensitivity analysis 1996 This issue
   Google Scholar
• Saltelli , A. , Andres , T.H. and Homma , T. 1993 . Sensitivity analysis of model output: an investigation of new techniques . Computational Statistics and Data Analysis , 15 ( 4 ) : 211 – 238 .
   Web of Science ®Google Scholar
• Saltelli , A. and Homma , T. 1992 . Sensitivity analysis for model output: performance of black box techniques on three international benchmark exercises . Computational Statistics and Data Analysis , 13 ( 4 ) : 73 – 94 .
   Web of Science ®Google Scholar
• Sarkar P. K. Rief H. Differential operator sampling for self-optimizing Monte Carlo simulations 1995 This issue
   Google Scholar
• Sobol I. M. Sensitivity analysis of non-linear models using sensitivity indices 1995 This issue
   Google Scholar
• Van Asselt , M. and Rotmans , J. 1995 . “ Uncertainty in integrated assessment modelling:a cultural perspective based approach ” . Bilthoven, , Netherlands : RIVM .
   Google Scholar
• Van Groenendaal , W. 1994 . Investment Analysis and DSS for Gas Transmission on Java , Tilburg, , Netherlands : Tilburg University .
   Google Scholar
• Van Groenendaal W. Kleijnen J. P. C. Economic risk versus technological risk in large investment projects Journal ofReliability and Systems Safety 1996 accepted
   Google Scholar
• Van Meel , J. 1994 . The Dynamics of Business Engineering , Delft, , Netherlands : Delft University .
   Google Scholar
• Vollebregt , T. 1996 . Experimental Design for Simulation , Canterbury, , New Zealand : University of Canterbury .
   Google Scholar
• Watson , G.S. 1961 . A study of the group screening method . Technometrics , 3 ( 3 ) : 371 – 388 .
   Web of Science ®Google Scholar
• Winkler , R.L. 1996 . “ Uncertainty in probabilistic risk assessment ” . In Reliability Engineering and System Safety Edited by: Helton , J. and Burmaster , D. Special Issue
   Google Scholar
• Zeigler , B. 1976 . Theory of Modelling and Simulation , New York : Wiley Interscience .
   Google Scholar