An open source analysis framework for large-scale building energy modeling

References

• Adams, B. M., L. E. Bauman, W. J. Bohnhoff, K. R. Dalbey, M. S. Ebeida, J. P. Eddy, M. S. Eldred, et al. 2009. DAKOTA, A Multilevel Parallel Object-Oriented Framework for Design Optimization, Parameter Estimation, Uncertainty Quantification, and Sensitivity Analysis: Version 5.4 User's Manual. Technical Report. Sandia National Laboratories: Albuquerque, NM. SAND2010-2183.
   Google Scholar
• Andersson, C., J. Åkesson, and C. Führer. 2016. PyFMI: A Python Package for Simulation of Coupled Dynamic Models with the Functional Mock-up Interface. Technical Report, Centre for Mathematical Sciences, Lund University, Lund, Sweden, Volume 2016, No. 2.
   Google Scholar
• Attia, S., M. Hamdy, W. O’Brien, and S. Carlucci. 2013. “Assessing Gaps and Needs for Integrating Building Performance Optimization Tools in Net Zero Energy Buildings Design.” Energy and Buildings 60 (5): 110–124.
   Google Scholar
• Balbach, C., and G. Thomas. 2019. “Data Standards, Energy Efficiency and the Digital Data Economy.” Building Performance Association. Accessed February 16, 2020. https://www.hpxmlonline.com/2019/03/12/data-standards-energy-efficiency-and-the-digital-data-economy/.
   Google Scholar
• Boxer, E., G. P. Henze, and A. I. Hirsch. 2017. “A Model-Based Decision Support Tool for Building Portfolios Under Uncertainty.” Automation in Construction 78 (2017): 34–50.
   Google Scholar
• Brackney, L., A. Parker, D. Macumber, and K. Benne. 2018. Building Energy Modeling with OpenStudio. Springer. ISBN 978-3-319-77809-9. doi:10.1007/978-3-319-77809-9.
   Google Scholar
• Byrd, R. H., P. Lu, J. Nocedal, and C. Zhu. 1995. “A Limited Memory Algorithm for Bound Constrained Optimization.” SIAM Journal on Scientific Computing 16 (5): 1190–1208.
   Web of Science ®Google Scholar
• Campolongo, F., J. Cariboni, and A. Saltelli. 2007. “An Effective Screening Design for Sensitivity Analysis of Large Models.” Environmental Modelling & Software 22 (10): 1509–1518.
   Web of Science ®Google Scholar
• Case 18-M-0084. 2020. “In the Matter of a Comprehensive Energy Efficiency Initiative; Order Authorizing Utility Energy Efficiency and Building Electrification Portfolios Through 2025.” State of New York Public Service Commission. Issued January 16. http://documents.dps.ny.gov/public/Common/ViewDoc.aspx?DocRefId={06B0FDEC-62EC-4A97-A7D7-7082F71B68B8}.
   Google Scholar
• Chong, A., and K. Menberg. 2018. “Guidelines for the Bayesian Calibration of Building Energy Models.” Energy and Buildings 174 (2018): 527–547.
   Google Scholar
• Christensen, C., R. Anderson, S. Horowitz, A. Courtney, and J. Spencer. 2006. BEopt™ Software for Building Energy Optimization: Features and Capabilities. Technical Report. National Renewable Energy Laboratory. Golden, CO: NREL. /TP-550-39929.
   Google Scholar
• Clerc, M. 2012. “Beyond Standard Particle Swarm Optimisation.” Innovations and Developments of Swarm Intelligence Applications. IGI Global.
   Google Scholar
• Crawley, D., J. W. Hand, M. Kummert, and B. T. Griffith. 2008. “Contrasting the Capabilities of Building Energy Performance Simulation Programs.” Building and Environment 43 (4): 661–673.
   Web of Science ®Google Scholar
• Crawley, D., L. K. Lawrie, F. C. Winkelmann, W. F. Buhl, Y. J. Huang, C. O. Pedersen, R. K. Strand, et al. 2001. “EnergyPlus: Creating a New-Generation Building Energy Simulation Program.” Energy and Buildings 33 (4): 319–331.
   Web of Science ®Google Scholar
• Deb, K., A. Pratap, S. Agarwal, and T. Meyarivan. 2002. “A Fast and Elitist Multiobjective Genetic Algorithm: NSGA-II.” IEEE Transactions on Evolutionary Computation 6 (2): 182–197.
   Web of Science ®Google Scholar
• Eisenhower, B., Z. O'Neill, V. A. Fonoberov, and I. Mezić. 2012. “Uncertainty and Sensitivity Decomposition of Building Energy Models.” Journal of Building Performance Simulation 5 (3): 171–184.
   Web of Science ®Google Scholar
• Ellis, P., P. Torcellini, and D. Crawley. 2008. “Energy Design Plugin: An EnergyPlus Plugin for SketchUp.” IBPSA-USA SimBuild, Berkeley, CA, July 30–August 1. National Renewable Energy Laboratory: NREL/CP-550-43569. https://www.nrel.gov/docs/fy08osti/43569.pdf.
   Google Scholar
• EnergyPlus Example File Generator. 2013. U.S. Department of Energy, Office of Energy Efficiency and Renewable Energy. Accessed December 14, 2017. https://energy.gov/eere/buildings/downloads/energyplus-file-generator.
   Google Scholar
• Gestwick, M. J., and J. A. Love. 2014. “Trial Application of ASHRAE 1051-RP: Calibration Method for Building Energy Simulation.” Journal of Building Performance Simulation 7 (5): 346–359.
   Web of Science ®Google Scholar
• Giarratano, J. C. 2002. “CLIPS: User’s Guide (version 6.24).” Accessed February 16, 2020. http://clipsrules.sourceforge.net/documentation/v624/ug.htm.
   Google Scholar
• Goel, S., H. Horsey, N. Wang, J. Gonzalez, N. Long, and K. Fleming. 2018. “Streamlining Building Energy Efficiency Assessment Through Integration of Uncertainty Analysis and Full Scale Energy Simulations.” Energy and Buildings 176: 45–57.
   Web of Science ®Google Scholar
• Goldwasser, D., B. L. Ball, A. Farthing, S. Frank, and P. Im. 2018. “Advances in Calibration of Building Energy Models to Time Series Data.” Building Performance Analysis Conference and SimBuild, Chicago, IL, September 26-28.
   Google Scholar
• Griffith, B., N. Long, P. Torcellini, R. Judkoff, D. Crawley, and J. Ryan. 2008. Methodology for Modeling Building Energy Performance Across the Commercial Sector. National Renewable Energy Laboratory: Golden, CO. NREL/TP-550-41956. https://www.nrel.gov/docs/fy08osti/41956.pdf.
   Google Scholar
• Griffith, B., P. Torcellini, N. Long, D. Crawley, and J. Ryan. 2006. Assessment of the Technical Potential for Achieving Zero-Energy Commercial Buildings. National Renewable Energy Laboratory: Golden, CO. NREL/TP-550-41957. https://www.nrel.gov/docs/fy08osti/41957.pdf.
   Google Scholar
• Guglielmetti, R., D. Macumber, and N. Long. 2011. “OpenStudio: An Open Source Integrated Analysis Platform.” Building Simulation, Sydney, Australia, November 14-16. https://www.nrel.gov/docs/fy12osti/51836.pdf.
   Google Scholar
• Hale, E., D. Macumber, E. Weaver, and D. Shekhar. 2012. “A Flexible Framework for Building Energy Analysis.” ACEEE Summer Study on Energy Efficiency in Buildings, Pacific Grove, CA, August 12-17.
   Google Scholar
• Heat Pump Ready Pilot Manual. 2019. New York State Energy Research and Development Authority. Accessed February 12, 2020. http://hpwescontractorsupport.com/wp-content/uploads/2019/09/Pilot_Manual_HPR.pdf.
   Google Scholar
• Herlihy, M., and N. Shavit. 2012. The Art of Multiprocessor Programming, Revised Reprint, 14. San Francisco, CA: Elsevier.
   Google Scholar
• Hong, T., F. Buhl, and P. Haves. 2008. EnergyPlus Run Time Analysis. Technical Report. Lawrence Berkeley National Laboratory: Berkeley, CA. LBNL-1311E. https://www.osti.gov/biblio/951766.
   Google Scholar
• Hong, T., J. Kim, J. Jeong, M. Lee, and C. Ji. 2017. “Automatic Calibration Model of a Building Energy Simulation Using Optimization Algorithm.” Energy Procedia 105 (2017): 3698–3704.
   Google Scholar
• Hong, T., J. Langevin, and K. Sun. 2018. “Building Simulation: Ten Challenges.” Building Simulation 11 (5): 871–898.
   Web of Science ®Google Scholar
• IBPSA. 2019. “Software Listing.” Accessed December 14, 2017. https://www.buildingenergysoftwaretools.com/software-listing.
   Google Scholar
• Jabi, W. 2016. “Linking Design and Simulation Using Non-Manifold Topology.” Architectural Science Review 59 (4): 323–334.
   Web of Science ®Google Scholar
• jEPlus+EA. 2011. “jEPlus+EA Users Guide (v1.4).” Accessed December 9, 2017. http://www.jeplus.org/wiki/doku.php?id=docs:jeplus_ea:start.
   Google Scholar
• Kluyver, T., B. Ragan-Kelley, F. Pérez, B. Granger, M. Bussonnier, J. Frederic, K. Kelley, et al. 2016. “Jupyter Notebooks—A Publishing Format for Reproducible Computational Workflows.” Positioning and Power in Academic Publishing: Players, Agents and Agendas. IOS Press. https://eprints.soton.ac.uk/403913/.
   Google Scholar
• L3 Harris Geospatial. 2020. “Interactive Data Language (IDL).” Accessed February 12, 2020. https://www.harrisgeospatial.com/Software-Technology/IDL.
   Google Scholar
• Lara, R. A., E. Naboni, G. Pernigotto, F. Cappelletti, Y. Zhang, F. Barzon, A. Gasparella, et al. 2017. “Optimization Tools for Building Energy Model Calibration.” Energy Procedia 111 (2017): 1060–1069.
   Google Scholar
• Long, N., and B. L. Ball. 2016. OpenStudio Analysis Spreadsheet (version 0.4.3). https://github.com/NREL/OpenStudio-analysis-spreadsheet.
   Google Scholar
• Long, N., B. L. Ball, and K. Fleming. 2013. OpenStudio Server (version 1.0). https://github.com/NREL/OpenStudio-server.
   Google Scholar
• Long, N., B. L. Ball, K. Fleming, and D. Macumber. 2014. “Scaling Building Energy Modeling Horizontally in the Cloud with OpenStudio.” ASHRAE/IBPSA-USA Building Simulation Conference, Atlanta, GA, September 10-12. National Renewable Energy Laboratory: NREL/CP-5500-62199. https://www.osti.gov/biblio/1226251.
   Google Scholar
• Long, N., S. Goel, and H. Horsey. 2015. “U.S. Department of Energy’s Building Energy Asset Score Sensitivity and Scale Implementation.” Proceedings of the 14th Conference of International Building Performance Simulation Association, India, December 7-9. http://www.ibpsa.org/proceedings/BS2015/p2712.pdf.
   Google Scholar
• Long, N., A. Hirsch, C. Lobato, and D. Macumber. 2010. “Commercial Building Design Pathways Using Optimization Analysis.” ACEEE Summer Study on Energy Efficiency in Buildings, Pacific Grove, CA, August 15-20. NREL/CP-550-48264. https://www.nrel.gov/docs/fy10osti/48264.pdf.
   Google Scholar
• Mebane Jr, W. R., and J. S. Sekhon. 2011. “Genetic Optimization Using Derivatives: The Rgenoud Package for R.” Journal of Statistical Software 42 (11): 1–26.
   Web of Science ®Google Scholar
• Merkel, D. 2014. “Docker: Lightweight Linux Containers for Consistent Development and Deployment.” Linux Journal 239 (2). https://dl.acm.org/doi/10.5555/2600239.2600241.
   Google Scholar
• Nguyen, A., and S. Reiter. 2015. “A Performance Comparison of Sensitivity Analysis Methods for Building Energy Models.” Building Simulation 8 (6): 651–664.
   Web of Science ®Google Scholar
• Nguyen, A., S. Reiter, and P. Rigo. 2014. “A Review on Simulation-Based Optimization Methods Applied to Building Performance Analysis.” Applied Energy 113 (2014): 1043–1058.
   Web of Science ®Google Scholar
• OpenStudio Development Team. 2014. OpenStudio Workflow Gem. https://github.com/NREL/OpenStudio-workflow-gem.
   Google Scholar
• OpenStudio Development Team. 2016. Parametric Analysis Tool (version 2.0). Accessed February 12, 2020. http://nrel.github.io/OpenStudio-user-documentation/reference/parametric_analysis_tool_2/.
   Google Scholar
• OpenStudio Development Team. 2017. OpenStudio (version 2.8.0). https://www.openstudio.net/.
   Google Scholar
• OpenStudio Development Team. 2019. OpenStudio SDK. https://github.com/NREL/OpenStudio.
   Google Scholar
• OpenStudio Development Team. 2020. OpenStudio Docker Containers. https://hub.docker.com/u/nrel.
   Google Scholar
• Pujol, G. 2009. “Simplex-Based Screening Designs for Estimating Metamodels.” Reliability Engineering & System Safety 94 (7): 1156–1160.
   Web of Science ®Google Scholar
• R Core Team. 2017. “The R Project for Statistical Computing.” The R Foundation. Vienna, Austria. https://www.r-project.org/.
   Google Scholar
• Reddy, A. T., I. Maor, and C. Panjapornpon. 2007. “Calibrating Detailed Building Energy Simulation Programs with Measured Data—Part I: General Methodology (RP-1051).” HVAC&R Research 13 (2): 221–241.
   Web of Science ®Google Scholar
• Roth, A. 2016. “New OpenStudio-Standards Gem Delivers One Two Punch.” U.S. Department of Energy. Accessed December 14, 2017. https://www.energy.gov/eere/buildings/articles/new-openstudio-standards-gem-delivers-one-two-punch.
   Google Scholar
• Roth, A. 2017. “OpenStudio Comes Full Polygon.” U.S. Department of Energy. Accessed December 14, 2017. https://www.energy.gov/eere/buildings/articles/openstudio-comes-full-polygon.
   Google Scholar
• Roth, A., J. Bull, S. Criswell, P. Ellis, J. Glazer, D. Goldwasser, and D. Reddy. 2018. “Scripting Frameworks for Enhancing EnergyPlus Modeling Productivity.” Building Performance Analysis Conference and SimBuild, Chicago IL, September 26-28.
   Google Scholar
• Roth, A., D. Goldwasser, and A. Parker. 2016. “There’s a Measure for That!” Energy and Buildings 117 (2016): 321–331.
   Google Scholar
• Saltelli, A. 2002. “Making Best Use of Model Evaluations to Compute Sensitivity Indices.” Computer Physics Communications 145 (2): 280–297.
   Web of Science ®Google Scholar
• Saltelli, A., S. Tarantola, and K. P.-S. Chan. 1999. “A Quantitative Model-Independent Method for Global Sensitivity Analysis of Model Output.” Technometrics: A Journal of Statistics for the Physical, Chemical, and Engineering Sciences 41 (1): 39–56.
   Web of Science ®Google Scholar
• Scrucca, L. 2013. “GA: A Package for Genetic Algorithms in R.” Journal of Statistical Software 53 (4): 1–37. https://www.jstatsoft.org/article/view/v053i04/v53i04.pdf.
   Web of Science ®Google Scholar
• Scrucca, L. 2017. “On Some Extensions to GA Package: Hybrid Optimisation, Parallelisation and Islands Evolution.” The R Journal 9 (1): 187–206.
   Google Scholar
• SQLite (version 3.7.10). 2012. https://www.sqlite.org/index.html.
   Google Scholar
• Stein, M. 1987. “Large Sample Properties of Simulations Using Latin Hypercube Sampling.” Technometrics: A Journal of Statistics for the Physical, Chemical, and Engineering Sciences 29 (2): 143–151.
   Web of Science ®Google Scholar
• Studer, D., J. Barkyoumb, E. Lee, B. L. Ball, S. Frank, E. Holland, J. Green, W. Robinson, J. Brown, and J. Golda. 2018. “Leveraging Shore-Side, Building Energy Simulation Tools for Use in the Shipboard Environment.” Naval Engineers Journal 130 (2): 129–140.
   Web of Science ®Google Scholar
• Tian, W. 2013. “A Review of Sensitivity Analysis Methods in Building Energy Analysis.” Renewable and Sustainable Energy Reviews 20: 411–419.
   Web of Science ®Google Scholar
• Tian, W., and P. de Wilde. 2011. “Uncertainty and Sensitivity Analysis of Building Performance Using Probabilistic Climate Projections: A UK Case Study.” Automation in Construction 20 (8): 1096–1109.
   Web of Science ®Google Scholar
• Tierney, L., A. J. Rossini, and N. Li. 2009. “Snow: A Parallel Computing Framework for the R System.” International Journal of Parallel Programming 37 (1): 78–90.
   Web of Science ®Google Scholar
• Wang, N., S. Goel, A. Makhmalbaf, and N. Long. 2018. “Development of Building Energy Asset Rating Using Stock Modelling in the USA.” Journal of Building Performance Simulation 11 (1): 4–18.
   Web of Science ®Google Scholar
• Welle, B. 2018. Perkins+Will. Accessed May 2019. https://speedwiki.io/project/.
   Google Scholar
• Wetter, M. 2001. “GenOpt – A Generic Optimization Program.” Seventh International IBPSA Conference, Rio de Janeiro, Brazil, August 13-15. https://simulationresearch.lbl.gov/wetter/download/IBPSA-2001.pdf.
   Google Scholar
• Wilson, E., and N. Merket. 2018. “An Interactive Visualization Tool for large-Scale Building Stock Modelling.” Building Performance Analysis Conference and SimBuild, Chicago IL, September 26-28.
   Google Scholar
• Winkelmann, F., B. Birdsall, W. Buhl, K. Ellington, and A. Erdem. 1993. “DOE-2 Supplement: Version 2.1E.” LBL-34947. Lawrence Berkeley Laboratory, Berkeley, CA. https://doi.org/10.2172/10147851.
   Google Scholar
• Zitzler, E., M. Laumanns, and L. Thiele. 2001. SPEA2: Improving the Performance of the Strength Pareto Evolutionary Algorithm. Technical Report 103. Computer Engineering and Communication Networks Lab (TIK), Swiss Federal Institute of Technology (ETH) Zurich, Switzerland.
   Google Scholar