Complex system policy modelling approaches for policy advice – comparing systems thinking, system dynamics and agent-based modelling

References

• Acs, S., N. Ostlaender, G. Listorti, J. Hradec, M. Hardy, P. Smits, and L. Hordijk. 2019. Modelling for EU Policy Support: Impact Assessments, EUR 29832 EN. Luxembourg: Publications Office of the European Union. https://doi.org/10.2760/748720
   Google Scholar
• Adelle, C., and S. Weiland. 2012. “Policy Assessment: The State of the Art.” Impact Assessment and Project Appraisal 30 (1): 25–33. https://doi.org/10.1080/14615517.2012.663256.
   Web of Science ®Google Scholar
• An, L. 2012. “Modeling Human Decisions in Coupled Human and Natural Systems: Review of Agent-Based Models.” Ecological Modelling 229: 25–36. https://doi.org/10.1016/j.ecolmodel.2011.07.010.
   Web of Science ®Google Scholar
• Badham, J. 2010. A Compendium of Modelling Techniques. (Integration Insights; No. 12), (Integration Insights). Canberra: The Australian National University, College of Medicine, Biology & Environment.
   Google Scholar
• Badham, J. 2014. “Bridging Complexity Science and the Social Determinants of Health.” Journal on Policy and Complex Systems 1: 60–87. https://doi.org/10.18278/jpcs.1.2.5.
   Google Scholar
• Balint, T., F. Lamperti, A. Mandel, M. Napoletano, A. Roventini, and A. Sapio. 2017. “Complexity and the Economics of Climate Change: A Survey and a Look Forward.” Ecological Economics 138: 252–265. https://doi.org/10.1016/j.ecolecon.2017.03.032.
   Web of Science ®Google Scholar
• Bankes, S. 1993. “Exploratory Modeling for Policy Analysis.” Operations Research 41 (3): 435–449.
   Web of Science ®Google Scholar
• Bär, C., L. Johnsen, and S. Gölz. 2023. Potenzial von Serious Games als Instrument zur Beförderung von Nachhaltigkeit. Eine Betrachtung aus Sicht des Umweltbundesamtes (Zwischenbericht No. 80/2023), Texte. Umweltbundesamt, Dessau-Roßlau.
   Google Scholar
• Barnes, J. 2019. “The Local Embedding of Low Carbon Technologies and the Agency of User-Side Intermediaries.” Journal of Cleaner Production 209: 769–781. https://doi.org/10.1016/j.jclepro.2018.10.258.
   Web of Science ®Google Scholar
• Bertoni, E., M. Fontana, L. Gabrielli, S. Signorelli, and M. Vespe. 2022. Mapping the Demand Side of Computational Social Science for Policy. EUR 31017 EN. Luxembourg: Publications Office of the European Union.
   Google Scholar
• Brailsford, S. C., T. Eldabi, M. Kunc, N. Mustafee, and A. F. Osorio. 2019. “Hybrid Simulation Modelling in Operational Research: A State-of-the-Art Review.” European Journal of Operational Research 278 (3): 721–737. https://doi.org/10.1016/j.ejor.2018.10.025.
   Web of Science ®Google Scholar
• Browne, J., B. Coffey, K. Cook, S. Meiklejohn, and C. Palermo. 2019. “A Guide to Policy Analysis as a Research Method.” Health Promotion International 34 (5): 1032–1044. https://doi.org/10.1093/heapro/day052.
   PubMed Web of Science ®Google Scholar
• Checa, D., and A. Bustillo. 2020. “A Review of Immersive Virtual Reality Serious Games to Enhance Learning and Training.” Multimedia Tools and Applications 79 (9-10): 5501–5527. https://doi.org/10.1007/s11042-019-08348-9.
   Web of Science ®Google Scholar
• Cherp, A., V. Vinichenko, J. Jewell, E. Brutschin, and B. Sovacool. 2018. “Integrating Techno-Economic, Socio-Technical and Political Perspectives on National Energy Transitions: A Meta-Theoretical Framework.” Energy Research & Social Science 37: 175–190. https://doi.org/10.1016/j.erss.2017.09.015.
   Web of Science ®Google Scholar
• Coyle, G. 2000. “Qualitative and Quantitative Modelling in System Dynamics: Some Research Questions.” System Dynamics Review 16 (3): 225–244. https://doi.org/10.1002/1099-1727(200023)16:3<225::AID-SDR195>3.0.CO;2-D.
   Web of Science ®Google Scholar
• Darnton, A. 2008. Reference Report: An Overview of Behaviour Change Models and Their Uses, GSR Behaviour Change Knowledge Review. Centre for Sustainable Development. London, UK: University of Westminster.
   Google Scholar
• De Ruig, L. T., T. Haer, H. De Moel, P. Orton, W. J. W. Botzen, and J. C. J. H. Aerts. 2023. “An Agent-Based Model for Evaluating Reforms of the National Flood Insurance Program: A Benchmarked Model Applied to Jamaica Bay, NYC.” Risk Analysis 43: 405–422. https://doi.org/10.1111/risa.13905.
   PubMed Web of Science ®Google Scholar
• Dreyer, I., and G. Stang. 2013. “Foresight in Governments–Practices and Trends Around the World.” Yearbook of European Security 1368: 7–32.
   Google Scholar
• Edmonds, B., and R. Meyer2017. Simulating Social Complexity: A Handbook, Understanding Complex Systems. Cham: Springer. https://doi.org/10.1007/978-3-319-66948-9
   Google Scholar
• Elsawah, S., E. Bakhanova, R. P. Hämäläinen, and A. Voinov. 2023. “A Competency Framework for Participatory Modeling.” Group Decision and Negotiation 32 (3): 569–601. https://doi.org/10.1007/s10726-023-09818-0.
   Web of Science ®Google Scholar
• Filatova, T., J. G. Polhill, and S. van Ewijk. 2016. “Regime Shifts in Coupled Socio-Environmental Systems: Review of Modelling Challenges and Approaches.” Environmental Modelling & Software 75: 333–347. https://doi.org/10.1016/j.envsoft.2015.04.003.
   Web of Science ®Google Scholar
• Filatova, T., P. H. Verburg, D. C. Parker, and C. A. Stannard. 2013. “Spatial Agent-Based Models for Socio-Ecological Systems: Challenges and Prospects.” Environmental Modelling & Software 45: 1–7. https://doi.org/10.1016/j.envsoft.2013.03.017.
   Web of Science ®Google Scholar
• Fuentes, M. A., C. J. Tessone, and B. A. Furtado. 2019. “Public Policy Modeling and Applications.” Complexity, 1–4. https://doi.org/10.1155/2019/4128703.
   Web of Science ®Google Scholar
• Furtado, B. A., M. A. Fuentes, and C. J. Tessone. 2019. “Policy Modeling and Applications: State-of-the-Art and Perspectives.” Complexity, 1–11. https://doi.org/10.1155/2019/5041681.
   Web of Science ®Google Scholar
• Ghaffarzadegan, N., J. Lyneis, and G. P. Richardson. 2011. “How Small System Dynamics Models Can Help the Public Policy Process.” System Dynamics Review 27 (1): 22–44. https://doi.org/10.1002/sdr.442.
   Web of Science ®Google Scholar
• Gilbert, N., P. Ahrweiler, P. Barbrook-Johnson, K. P. Narasimhan, and H. Wilkinson. 2018. “Computational Modelling of Public Policy: Reflections on Practice.” Journal of Artificial Societies and Social Simulation 21: 14. https://doi.org/10.18564/jasss.3669.
   Web of Science ®Google Scholar
• Greco, S., M. Ehrgott, and J. R. Figueira. 2016. Multiple Criteria Decision Analysis: State of the Art Surveys, International Series in Operations Research & Management Science. New York, NY: Springer New York. https://doi.org/10.1007/978-1-4939-3094-4
   Google Scholar
• Haynes, P., and D. Alemna. 2022. “A Systematic Literature Review of the Impact of Complexity Theory on Applied Economics.” Economies 10: 192–342. https://doi.org/10.3390/economies10080192.
   Web of Science ®Google Scholar
• Heath, B., R. Hill, and F. Ciarallo. 2009. “A Survey of Agent-Based Modeling Practices (January 1998 to July 2008).” Journal of Artificial Societies and Social Simulation 12.
   Web of Science ®Google Scholar
• Hovmand, P. S. 2014. “Group Model Building and Community-Based System Dynamics Process.” In Community Based System Dynamics, edited by P. S. Hovmand, 17–30. New York, NY: Springer New York. https://doi.org/10.1007/978-1-4614-8763-0_2
   Google Scholar
• Huang, I., and J. Keisler. 2011. “Multi-Criteria Decision Analysis in Environmental Sciences: Ten Years of Applications and Trends.” Science of The Total Environment 409 (19): 3578–3594. https://doi.org/10.1016/j.scitotenv.2011.06.022.
   PubMed Web of Science ®Google Scholar
• Johanning, S., F. Scheller, D. Abitz, C. Wehner, and T. Bruckner. 2020. “A Modular Multi-Agent Framework for Innovation Diffusion in Changing Business Environments: Conceptualization, Formalization and Implementation.” Complex Adapt Syst Model 8.
   Google Scholar
• Kelly, R. A., A. J. Jakeman, O. Barreteau, M. E. Borsuk, S. ElSawah, S. H. Hamilton, H. J. Henriksen, et al. 2013. “Selecting Among Five Common Modelling Approaches for Integrated Environmental Assessment and Management.” Environmental Modelling & Software 47: 159–181. https://doi.org/10.1016/j.envsoft.2013.05.005.
   Web of Science ®Google Scholar
• Khan, A. A., and J. Abonyi. 2022. “Simulation of Sustainable Manufacturing Solutions: Tools for Enabling Circular Economy.” Sustainability (Switzerland), 14. https://doi.org/10.3390/su14159796.
   Google Scholar
• Kiesling, E. 2011. Planning the Market Introduction of new Products (Dissertation). Universität Wien. Fakultät für Wirtschaftswissenschaften.
   Google Scholar
• Köhler, J., F. Haan, G. Holtz, K. Kubeczko, E. A. Moallemi, G. Papachristos, and E. Chappin. 2018. “Modelling Sustainability Transitions: An Assessment of Approaches and Challenges.” Journal of Artificial Societies and Social Simulation 21: 8. https://doi.org/10.18564/jasss.3629.
   Web of Science ®Google Scholar
• Kunc, M. 2017. “System Dynamics: A Soft and Hard Approach to Modelling.” Presented at the 2017 Winter Simulation Conference (WSC), IEEE, Las Vegas, NV, 597–606. https://doi.org/10.1109/WSC.2017.8247818.
   Google Scholar
• Kwakkel, J. H., and E. Pruyt. 2013. “Exploratory Modeling and Analysis, an Approach for Model-Based Foresight Under Deep Uncertainty.” Technological Forecasting and Social Change 80 (3): 419–431. https://doi.org/10.1016/j.techfore.2012.10.005.
   Web of Science ®Google Scholar
• Lamperti, F., G. Dosi, M. Napoletano, A. Roventini, and A. Sapio. 2020. “Climate Change and Green Transitions in an Agent-Based Integrated Assessment Model.” Technological Forecasting and Social Change 153: 119806. https://doi.org/10.1016/j.techfore.2019.119806.
   Web of Science ®Google Scholar
• Lamperti, F., A. Mandel, M. Napoletano, A. Sapio, A. Roventini, T. Balint, and I. Khorenzhenko. 2019. “Towards Agent-Based Integrated Assessment Models: Examples, Challenges, and Future Developments.” Regional Environmental Change 19 (3): 747–762. https://doi.org/10.1007/s10113-018-1287-9.
   Web of Science ®Google Scholar
• Lipman, B. L. 1995. “Information Processing and Bounded Rationality: A Survey.” The Canadian Journal of Economics 28 (1): 42. https://doi.org/10.2307/136022.
   Web of Science ®Google Scholar
• Lippe, M., M. Bithell, N. Gotts, D. Natalini, P. Barbrook-Johnson, C. Giupponi, M. Hallier, et al. 2019. “Using Agent-Based Modelling to Simulate Social-Ecological Systems Across Scales.” Geoinformatica 23 (2): 269–298. https://doi.org/10.1007/s10707-018-00337-8.
   Web of Science ®Google Scholar
• Lofdahl, C., and M. Voshell. 2018. “Challenges in Making Policy Decision-Support Systems Operational.” In Advances in Cross-Cultural Decision Making, Advances in Intelligent Systems and Computing, edited by M. Hoffman, 99–107. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-60747-4_10
   Google Scholar
• Martin, R., and M. Schlüter. 2015. “Combining System Dynamics and Agent-Based Modeling to Analyze Social-Ecological Interactions—An Example from Modeling Restoration of a Shallow Lake.” Frontiers in Environmental Science 3. https://doi.org/10.3389/fenvs.2015.00066.
   Google Scholar
• Mischen, P. A., and S. K. Jackson. 2008. “Connecting the Dots: Applying Complexity Theoriy, Knowledge Management and Social Network Analysis to Policy Implementation.” Public Administration Quarterly 32: 314–338.
   Google Scholar
• Murray-Rust, D., V. Rieser, D. T. Robinson, V. Miličič, and M. Rounsevell. 2013. “Agent-Based Modelling of Land Use Dynamics and Residential Quality of Life for Future Scenarios.” Environmental Modelling & Software 46: 75–89. https://doi.org/10.1016/j.envsoft.2013.02.011.
   Web of Science ®Google Scholar
• Naugle, A., S. Langarudi, and T. Clancy. 2024. “What is (Quantitative) System Dynamics Modeling? Defining Characteristics and the Opportunities They Create.” System Dynamics Review, sdr.1762. https://doi.org/10.1002/sdr.1762.
   Web of Science ®Google Scholar
• Niamir, L., O. Ivanova, and T. Filatova. 2020. “Economy-Wide Impacts of Behavioral Climate Change Mitigation: Linking Agent-Based and Computable General Equilibrium Models.” Environmental Modelling & Software 134: 1–24. https://doi.org/10.1016/j.envsoft.2020.104839.
   Web of Science ®Google Scholar
• Nilsson, M., A. Jordan, J. Turnpenny, J. Hertin, B. Nykvist, and D. Russel. 2008. “The Use and Non-Use of Policy Appraisal Tools in Public Policy Making: An Analysis of Three European Countries and the European Union.” Policy Sciences 41 (4): 335–355.
   Web of Science ®Google Scholar
• Novak, J., and A. Cañas. 2006. The Theory Underlying Concept Maps and How to Construct Them (No. Technical Report IHMC CmapTools 2006-01 Rev 01-2008). Pensacola, FL: Florida Institute for Human and Machine Cognition (IHMC).
   Google Scholar
• Palm, A., and B. Lantz. 2020. “Information Dissemination and Residential Solar PV Adoption Rates: The Effect of an Information Campaign in Sweden.” Energy Policy 142: 111540. https://doi.org/10.1016/j.enpol.2020.111540.
   Web of Science ®Google Scholar
• Parry, H. R., C. J. Topping, M. C. Kennedy, N. D. Boatman, and A. W. A. Murray. 2013. “A Bayesian Sensitivity Analysis Applied to an Agent-Based Model of Bird Population Response to Landscape Change.” Environmental Modelling & Software 45: 104–115. https://doi.org/10.1016/j.envsoft.2012.08.006.
   Web of Science ®Google Scholar
• Pejic Bach, M., E. Tustanovski, A. W. H. Ip, K.-L. Yung, and V. Roblek. 2019. “System Dynamics Models for the Simulation of Sustainable Urban Development.” Kybernetes 49: 460–504. https://doi.org/10.1108/K-04-2018-0210.
   Web of Science ®Google Scholar
• Podhora, A., K. Helming, L. Adenäuer, T. Heckelei, P. Kautto, P. Reidsma, K. Rennings, J. Turnpenny, and J. Jansen. 2013. “The Policy-Relevancy of Impact Assessment Tools: Evaluating Nine Years of European Research Funding.” Environmental Science & Policy 31: 85–95. https://doi.org/10.1016/j.envsci.2013.03.002.
   Web of Science ®Google Scholar
• Rendall, R., L. H. Chiang, and M. S. Reis. 2019. “Data-Driven Methods for Batch Data Analysis – A Critical Overview and Mapping on the Complexity Scale.” Computers & Chemical Engineering 124: 1–13. https://doi.org/10.1016/j.compchemeng.2019.01.014.
   Web of Science ®Google Scholar
• Ritchey, T. 2012. “Outline for a Morphology of Modelling Methods: Contribution to a General Theory of Modelling.” Acta Morphologica Generalis 1.
   Google Scholar
• Ruiz Estrada, M., and S.-F. Yap. 2013. “The Origins and Evolution of Policy Modeling.” Journal of Policy Modeling 35), https://doi.org/10.1016/j.jpolmod.2011.12.003.
   Web of Science ®Google Scholar
• Sauer, A., and R. Ortlepp. 2021. “Parameter Uncertainties in Flood Hazard Analysis of Heavy Rain Events.” ASCE-ASME Journal of Risk and Uncertainty in Engineering Systems, Part A: Civil Engineering 7 (2): 04021016. https://doi.org/10.1061/AJRUA6.0001125.
   Google Scholar
• Scheller, F., and T. Bruckner. 2019. “Entity-Oriented Multi-Level Energy System Optimization Modeling.” In Operations Research Proceedings 2018, Operations Research Proceedings, edited by B. Fortz, and M. Labbé, 191–197. [Place of publication not identified]: Springer Nature. https://doi.org/10.1007/978-3-030-18500-8‗25
   Google Scholar
• Scheller, F., S. Johanning, and T. Bruckner. 2019. “Review of Designing Empirically Grounded Agent-Based Models of Innovation Diffusion.” Beiträge des Instituts für Infrastruktur und Ressourcenmanagement.
   Google Scholar
• Schlüter, M., A. Baeza, G. Dressler, K. Frank, J. Groeneveld, W. Jager, M. A. Janssen, et al. 2017. “A Framework for Mapping and Comparing Behavioural Theories in Models of Social-Ecological Systems.” Ecological Economics 131: 21–35. https://doi.org/10.1016/j.ecolecon.2016.08.008.
   Web of Science ®Google Scholar
• Schrieks, T., W. J. W. Botzen, M. Wens, T. Haer, and J. C. J. H. Aerts. 2021. “Integrating Behavioral Theories in Agent-Based Models for Agricultural Drought Risk Assessments.” Frontiers in Water 3: Art. 686329, 1–19. https://doi.org/10.3389/frwa.2021.686329.
   Google Scholar
• Schrotter, G., and C. Hürzeler. 2020. “The Digital Twin of the City of Zurich for Urban Planning.” PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science 88 (1): 99–112. https://doi.org/10.1007/s41064-020-00092-2.
   Web of Science ®Google Scholar
• Schünemann, C., H. Herold, and A. Sidorova. 2023a. Qualitative und quantitative Modellierungen der Wirksamkeit von Politikinstrumenten. Möglichkeiten und Grenzen der Übertragbarkeit auf das Feld der Anpassung an den Klimawandel. (Teilbericht No. 41/2023), Climate Change. Umweltbundesamt, Dessau-Roßlau.
   Google Scholar
• Schünemann, C., A. Sidorova, and H. Herold. 2023b. Qualitative and Quantitative Modelling of the Efficacy of Policy Instruments (No. 42/2023), Climate Change. Umweltbundesamt, Dessau-Roßlau.
   Google Scholar
• Schwarz, N., G. Dressler, K. Frank, W. Jager, M. Janssen, B. Müller, M. Schlüter, N. Wijermans, and J. Groeneveld. 2019. “Formalising Theories of Human Decision-Making for Agent-Based Modelling of Social-Ecological Systems: Practical Lessons Learned and Ways Forward.” Socio-Environmental Systems Modelling 2: 16340. https://doi.org/10.18174/sesmo.2020a16340.
   Google Scholar
• Scott, R. 2018. Group Model Building. Using Systems Dynamics to Achieve Enduring Agreement, SpringerBriefs in Operations Research. Singapore: Springer.
   Google Scholar
• Siebers, P. O., C. M. Macal, J. Garnett, D. Buxton, and M. Pidd. 2010. “Discrete-event Simulation is Dead, Long Live Agent-Based Simulation!.” Journal of Simulation 4 (3): 204–210. https://doi.org/10.1057/jos.2010.14.
   Web of Science ®Google Scholar
• Siegenfeld, A. F., and Y. Bar-Yam. 2020. “An Introduction to Complex Systems Science and Its Applications.” Complexity, 1. https://doi.org/10.1155/2020/6105872.
   Google Scholar
• Sterman, J. 2002. “System Dynamics: Systems Thinking and Modeling for a Complex World.” Massachussetts Institute of Technology. Engineering Systems Division (ESD) Working Paper Series ESD-WP-2003-01.13-ESD Internal Symposium.
   Google Scholar
• Sun, Z., I. Lorscheid, J. D. Millington, S. Lauf, N. R. Magliocca, J. Groeneveld, S. Balbi, et al. 2016. “Simple or Complicated Agent-Based Models? A Complicated Issue.” Environmental Modelling & Software 86: 56–67. https://doi.org/10.1016/j.envsoft.2016.09.006.
   Web of Science ®Google Scholar
• Süsser, D., A. Ceglarz, H. Gaschnig, V. Stavrakas, A. Flamos, G. Giannakidis, and J. Lilliestam. 2021. “Model-Based Policymaking or Policy-Based Modelling? How Energy Models and Energy Policy Interact.” Energy Research & Social Science 75: 101984. https://doi.org/10.1016/j.erss.2021.101984.
   Web of Science ®Google Scholar
• Turnpenny, J., M. Nilsson, D. Russel, A. Jordan, J. Hertin, and B. Nykvist. 2008. “Why is Integrating Policy Assessment so Hard? A Comparative Analysis of the Institutional Capacities and Constraints.” Journal of Environmental Planning and Management 51 (6): 759–775. https://doi.org/10.1080/09640560802423541.
   Web of Science ®Google Scholar
• Uriona, M., and S. S. Grobbelaar. 2019. “Innovation System Policy Analysis Through System Dynamics Modelling: A Systematic Review.” Science and Public Policy 46 (1): 28–44. https://doi.org/10.1093/scipol/scy034.
   Web of Science ®Google Scholar
• Valente, T. W., and E. M. Rogers. 1995. “The Origins and Development of the Diffusion of Innovations Paradigm as an Example of Scientific Growth.” Science Communication 16 (3): 242–273. https://doi.org/10.1177/1075547095016003002.
   PubMed Web of Science ®Google Scholar
• Voinov, A., K. Jenni, S. Gray, N. Kolagani, P. D. Glynn, P. Bommel, C. Prell, et al. 2018. “Tools and Methods in Participatory Modeling: Selecting the Right Tool for the Job.” Environmental Modelling & Software 109: 232–255. https://doi.org/10.1016/j.envsoft.2018.08.028.
   Web of Science ®Google Scholar
• Zhang, H., and Y. Vorobeychik. 2019. “Empirically Grounded Agent-Based Models of Innovation Diffusion: A Critical Review.” Artificial Intelligence Review 52 (1): 707–741. https://doi.org/10.1007/s10462-017-9577-z.
   Web of Science ®Google Scholar