Uncertainty Quantification for Computer Models With Spatial Output Using Calibration-Optimal Bases

References

• Aarts, E. H., and Van Laarhoven, P. J. (1985), “Statistical Cooling: A General Approach to Combinatorial Optimization Problems,” Philips Journal of Research, 40, 193–226.
   Web of Science ®Google Scholar
• Bayarri, M., Berger, J., Cafeo, J., Garcia-Donato, G., Liu, F., Palomo, J., Parthasarathy, R., Paulo, R., Sacks, J., and Walsh, D. (2007), “Computer Model Validation With Functional Output,” The Annals of Statistics, 35, 1874–1906. DOI: https://doi.org/10.1214/009053607000000163.
   Web of Science ®Google Scholar
• Brynjarsdóttir, J., and O’Hagan, A. (2014), “Learning About Physical Parameters: The Importance of Model Discrepancy,” Inverse Problems, 30, 114007. DOI: https://doi.org/10.1088/0266-5611/30/11/114007.
   Web of Science ®Google Scholar
• Chang, W., Applegate, P. J., Haran, M., and Keller, K. (2014), “Probabilistic Calibration of a Greenland Ice Sheet Model Using Spatially-Resolved Synthetic Observations: Toward Projections of Ice Mass Loss With Uncertainties,” Geoscientific Model Development Discussions, 7, 1905–1931. DOI: https://doi.org/10.5194/gmdd-7-1905-2014.
   Google Scholar
• Chang, W., Haran, M., Applegate, P., and Pollard, D. (2016), “Calibrating an Ice Sheet Model Using High-Dimensional Binary Spatial Data,” Journal of the American Statistical Association, 111, 57–72. DOI: https://doi.org/10.1080/01621459.2015.1108199.
   Web of Science ®Google Scholar
• Chen, H., Loeppky, J. L., Sacks, J., and Welch, W. J. (2016), “Analysis Methods for Computer Experiments: How to Assess and What Counts?,” Statistical Science, 31, 40–60. DOI: https://doi.org/10.1214/15-STS531.
   Web of Science ®Google Scholar
• Collins, M., An, S.-I., Cai, W., Ganachaud, A., Guilyardi, E., Jin, F.-F., Jochum, M., Lengaigne, M., Power, S., Timmermann, A., and Vecchi, G. (2010), “The Impact of Global Warming on the Tropical Pacific Ocean and El Niño,” Nature Geoscience, 3, 391–397. DOI: https://doi.org/10.1038/ngeo868.
   Web of Science ®Google Scholar
• Conti, S., and O’Hagan, A. (2010), “Bayesian Emulation of Complex Multi-output and Dynamic Computer Models,” Journal of Statistical Planning and Inference, 140, 640–651. DOI: https://doi.org/10.1016/j.jspi.2009.08.006.
   Web of Science ®Google Scholar
• Craig, P. S., Goldstein, M., Seheult, A., and Smith, J. (1996), “Bayes Linear Strategies for Matching Hydrocarbon Reservoir History,” Bayesian Statistics, 5, 69–95.
   Google Scholar
• Goldstein, M., and Rougier, J. (2009), “Reified Bayesian Modelling and Inference for Physical Systems,” Journal of Statistical Planning and Inference, 139, 1221–1239. DOI: https://doi.org/10.1016/j.jspi.2008.07.019.
   Web of Science ®Google Scholar
• Gu, M., and Berger, J. O. (2016), “Parallel Partial Gaussian Process Emulation for Computer Models With Massive Output,” The Annals of Applied Statistics, 10, 1317–1347. DOI: https://doi.org/10.1214/16-AOAS934.
   Web of Science ®Google Scholar
• Harris, G., Sexton, D., Booth, B., Collins, M., Murphy, J., and Webb, M. (2006), “Frequency Distributions of Transient Regional Climate Change From Perturbed Physics Ensembles of General Circulation Model Simulations,” Climate Dynamics, 27, 357–375. DOI: https://doi.org/10.1007/s00382-006-0142-8.
   Web of Science ®Google Scholar
• Haylock, R., and O’Hagan, A. (1996), “On Inference for Outputs of Computationally Expensive Algorithms With Uncertainty on the Inputs,” Bayesian Statistics, 5, 629–637.
   Google Scholar
• Higdon, D. (1998), “A Process-Convolution Approach to Modelling Temperatures in the North Atlantic Ocean,” Environmental and Ecological Statistics, 5, 173–190.
   Web of Science ®Google Scholar
• Higdon, D., Gattiker, J., Williams, B., and Rightley, M. (2008), “Computer Model Calibration Using High-Dimensional Output,” Journal of the American Statistical Association, 103, 570–583. DOI: https://doi.org/10.1198/016214507000000888.
   Web of Science ®Google Scholar
• Hourdin, F., Mauritsen, T., Gettelman, A., Golaz, J.-C., Balaji, V., Duan, Q., Folini, D., Ji, D., Klocke, D., Qian, Y., Rauser, F, (2017), “The Art and Science of Climate Model Tuning,” Bulletin of the American Meteorological Society, 98, 589–602. DOI: https://doi.org/10.1175/BAMS-D-15-00135.1.
   Web of Science ®Google Scholar
• Jolliffe, I. (2002), Principal Component Analysis, New York: Springer.
   Google Scholar
• Kaufman, C. G., Bingham, D., Habib, S., Heitmann, K., and Frieman, J. A. (2011), “Efficient Emulators of Computer Experiments Using Compactly Supported Correlation Functions, With an Application to Cosmology,” The Annals of Applied Statistics, 5, 2470–2492. DOI: https://doi.org/10.1214/11-AOAS489.
   Web of Science ®Google Scholar
• Kennedy, M. C., and O’Hagan, A. (2001), “Bayesian Calibration of Computer Models,” Journal of the Royal Statistical Society: Series B, 63, 425–464. DOI: https://doi.org/10.1111/1467-9868.00294.
   Web of Science ®Google Scholar
• Mauritsen, T., Stevens, B., Roeckner, E., Crueger, T., Esch, M., Giorgetta, M., Haak, H., Jungclaus, J., Klocke, D., Matei, D., and Mikolajewicz, U. (2012), “Tuning the Climate of a Global Model,” Journal of Advances in Modeling Earth Systems, 4, M00A01.
   Web of Science ®Google Scholar
• Meehl, G. A., Boer, G. J., Covey, C., Latif, M., and Stouffer, R. J. (2000), “The Coupled Model Intercomparison Project (CMIP),” Bulletin of the American Meteorological Society, 81, 313–318. DOI: https://doi.org/10.1175/1520-0477(2000)081<0313:TCMIPC>2.3.CO;2.
   Google Scholar
• Murnaghan, F. D. (1962), The Unitary and Rotation Groups (Vol. 3), Washington, D. C.: Spartan Books.
   Google Scholar
• Pollard, D., Chang, W., Haran, M., Applegate, P., and DeConto, R. (2016), “Large Ensemble Modeling of the Last Deglacial Retreat of the West Antarctic Ice Sheet: Comparison of Simple and Advanced Statistical Techniques,” Geoscientific Model Development, 9, 1697–1723. DOI: https://doi.org/10.5194/gmd-9-1697-2016.
   Web of Science ®Google Scholar
• Pukelsheim, F. (1994), “The Three Sigma Rule,” The American Statistician, 48, 88–91. DOI: https://doi.org/10.2307/2684253.
   Web of Science ®Google Scholar
• Sacks, J., Welch, W. J., Mitchell, T. J., and Wynn, H. P. (1989), “Design and Analysis of Computer Experiments,” Statistical Science, 4, 409–423. DOI: https://doi.org/10.1214/ss/1177012413.
   Google Scholar
• Salter, J. M. (2017), “Uncertainty Quantification for Spatial Field Data Using Expensive Computer Models: Refocussed Bayesian Calibration With Optimal Projection,” Ph.D. thesis, University of Exeter.
   Google Scholar
• Salter, J. M., and Williamson, D. (2016), “A Comparison of Statistical Emulation Methodologies for Multi-wave Calibration of Environmental Models,” Environmetrics, 27, 507–523. DOI: https://doi.org/10.1002/env.2405.
   PubMed Web of Science ®Google Scholar
• Scaife, A. A., Spangehl, T., Fereday, D. R., Cubasch, U., Langematz, U., Akiyoshi, H., Bekki, S., Braesicke, P., Butchart, N., Chipperfield, M. P., and Gettelman, A. (2012), “Climate Change Projections and Stratosphere–Troposphere Interaction,” Climate Dynamics, 38, 2089–2097. DOI: https://doi.org/10.1007/s00382-011-1080-7.
   Web of Science ®Google Scholar
• Screen, J. A., and Williamson, D. (2017), “Ice-Free Arctic at 1.5 °C?,” Nature Climate Change, 7, 230–231. DOI: https://doi.org/10.1038/nclimate3248.
   Web of Science ®Google Scholar
• Sexton, D. M., Murphy, J. M., Collins, M., and Webb, M. J. (2011), “Multivariate Probabilistic Projections Using Imperfect Climate Models Part I: Outline of Methodology,” Climate Dynamics, 38, 2513–2542. DOI: https://doi.org/10.1007/s00382-011-1208-9.
   Web of Science ®Google Scholar
• Stocker, T. F., Qin, D., Plattner, G.-K., Tignor, M., Allen, S. K., Boschung, J., Nauels, A., Xia, Y., Bex, B., and Midgley, B. (2013), “IPCC, 2013: Climate Change 2013: The Physical Science Basis,” Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change.
   Google Scholar
• Vernon, I., Goldstein, M., and Bower, R. G. (2010), “Galaxy Formation: A Bayesian Uncertainty Analysis,” Bayesian Analysis, 5, 619–669. DOI: https://doi.org/10.1214/10-BA524.
   Web of Science ®Google Scholar
• von Salzen, K., Scinocca, J. F., McFarlane, N. A., Li, J., Cole, J. N., Plummer, D., Verseghy, D., Reader, M. C., Ma, X., Lazare, M., and Solheim, L. (2013), “The Canadian Fourth Generation Atmospheric Global Climate Model (CanAM4). Part I: Representation of Physical Processes,” Atmosphere-Ocean, 51, 104–125. DOI: https://doi.org/10.1080/07055900.2012.755610.
   Web of Science ®Google Scholar
• Wilkinson, R. D. (2010), “Bayesian Calibration of Expensive Multivariate Computer Experiments,” in Large-Scale Inverse Problems and Quantification of Uncertainty, Ser. Comput. Stat., eds. L. T. Biegler et al., New York: Wiley, pp. 195–216.
   Google Scholar
• Williamson, D. (2015), “Exploratory Ensemble Designs for Environmental Models Using k-Extended Latin Hypercubes,” Environmetrics, 26, 268–283. DOI: https://doi.org/10.1002/env.2335.
   PubMed Web of Science ®Google Scholar
• Williamson, D., Blaker, A. T., Hampton, C., and Salter, J. (2015), “Identifying and Removing Structural Biases in Climate Models With History Matching,” Climate Dynamics, 45, 1299–1324. DOI: https://doi.org/10.1007/s00382-014-2378-z.
   Web of Science ®Google Scholar
• Williamson, D. B., Blaker, A. T., and Sinha, B. (2017), “Tuning Without Over-Tuning: Parametric Uncertainty Quantification for the NEMO Ocean Model,” Geoscientific Model Development, 10, 1789–1816. DOI: https://doi.org/10.5194/gmd-10-1789-2017.
   Web of Science ®Google Scholar
• Williamson, D., Goldstein, M., Allison, L., Blaker, A., Challenor, P., Jackson, L., and Yamazaki, K. (2013), “History Matching for Exploring and Reducing Climate Model Parameter Space Using Observations and a Large Perturbed Physics Ensemble,” Climate Dynamics, 41, 1703–1729. DOI: https://doi.org/10.1007/s00382-013-1896-4.
   Web of Science ®Google Scholar
• Williamson, D., Goldstein, M., and Blaker, A. (2012), “Fast Linked Analyses for Scenario-Based Hierarchies,” Journal of the Royal Statistical Society: Series C, 61, 665–691. DOI: https://doi.org/10.1111/j.1467-9876.2012.01042.x.
   Web of Science ®Google Scholar
• Xiang, Y., Gubian, S., Suomela, B., and Hoeng, J. (2013), “Generalized Simulated Annealing for Efficient Global Optimization: The GenSA Package for R,” The R Journal, 5, 13–28.
   Google Scholar