Measuring climate mitigation policy content in text-as-data: navigating the conceptual challenges

References

• Adcock, R., and D. Collier. 2001. “Measurement Validity: A Shared Standard for Qualitative and Quantitative Research.” American Political Science Review 95 (3): 529–546.
   Web of Science ®Google Scholar
• Anderson, S. E., D. M. Butler, L. Harbridge-Yong, and G. A. Markarian. 2023. “Driving Legislators’ Policy Preferences: Constituent Commutes and Gas Taxes.” Legislative Studies Quarterly 48 (1): 203–218.
   Web of Science ®Google Scholar
• Averchenkova, A., S. Fankhauser, and M. Nachmany, eds. 2017. Trends in Climate Change Legislation. Cheltenham, UK: Edward Elgar Publishing.
   Google Scholar
• Barrie, C., T. G. Fleming, and S. S. Rowan. 2023. “Does Protest Influence Political Speech? Evidence from UK Climate Protest, 2017–2019.” British Journal of Political Science 54 (2): 1–18.
   Google Scholar
• Benoit, K. 2020. “Text as Data: An Overview.” In The SAGE Handbook of Research Methods in Political Science and International Relations, edited by Luigi Curini and Robert Franzese, 461–497. London: SAGE Publications. Accessed July 28, 2022. https://sk.sagepub.com/reference/the-sage-handbook-of-research-methods-in-political-science-and-ir/i4365.xml.
   Google Scholar
• Benoit, K., K. Watanabe, H. Wang, P. Nulty, A. Obeng, S. Müller, and A. Matsuo. 2018. “quanteda: An R Package for the Quantitative Analysis of Textual Data.” Journal of Open Source Software 3 (30): 774.
   Google Scholar
• Boasson, E. L., and M. Tatham. 2023. “Climate Policy: From Complexity to Consensus?” Journal of European Public Policy 30 (3): 401–424.
   Web of Science ®Google Scholar
• Bromley-Trujillo, R., M. Holman, and A. Sandoval. 2019. “Hot Districts, Cool Legislation: Evaluating Agenda Setting in Climate Change Bill Sponsorship in U.S. States.” State Politics & Policy Quarterly 19 (3): 375–395.
   Web of Science ®Google Scholar
• Carey, J. M. 2009. “Legislative Voting and Accountability.” In Cambridge Studies in Comparative Politics. Cambridge: Cambridge University Press.
   Google Scholar
• Carter, N., and B. Clements. 2015. “From ‘Greenest Government Ever’ to ‘Get Rid of all the Green Crap’: David Cameron, the Conservatives and the Environment.” British Politics 10 (2): 204–225.
   Web of Science ®Google Scholar
• Carter, N., R. Ladrech, C. Little, and V. Tsagkroni. 2018. “Political Parties and Climate Policy.” Party Politics 24 (6): 731–742.
   PubMedGoogle Scholar
• Compston, H., and I. Bailey. 2016. “Climate Policy Strength Compared: China, the US, the EU, India, Russia, and Japan.” Climate Policy 16 (2): 145–164.
   Web of Science ®Google Scholar
• Cox G. W. 2009. The Organization of Democratic Legislatures. Edited by D. A. Wittman and B. R. Weingast. Oxford: Oxford University Press. Accessed October 31, 2021. http://oxfordhandbooks.com/view/10.1093oxfordhb/9780199548477.001.0001/oxfordhb-9780199548477-e-008.
   Google Scholar
• Debus, M., and N. Himmelrath. 2022. “Advocates of Climate Action? The Age of Members of Parliament and Their Activity in Legislative Debates on Climate Change.” Climate Action 1 (1): 16.
   Google Scholar
• Devlin, J., M.-W. Chang, K. Lee, and K. Toutanova. 2018. “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.” [object Object]. Epub ahead of print 2018. https://doi.org/10.48550/ARXIV.1810.04805.
   Google Scholar
• Dubash, N. K. 2021. “Varieties of Climate Governance: The Emergence and Functioning of Climate Institutions.” Environmental Politics 30 (Supp. 1): 1–25.
   Google Scholar
• Dubash, N. K., M. Hagemann, N. Höhne, and P. Upadhyaya. 2013. “Developments in National Climate Change Mitigation Legislation and Strategy.” Climate Policy 13 (6): 649–664.
   Web of Science ®Google Scholar
• Euronews Green. 2023. “From Solo Protest to Global Movement: Five Years of Fridays for Future in Pictures.” Euronews, Accessed March 6, 2024. https://www.euronews.com/green/2023/08/21/from-solo-protest-to-global-movement-five-years-of-fridays-for-future-in-pictures#:~:text=How%20Fridays%20for%20Future%20staged,1%2C600%20protests%20across%20150%20countries.
   Google Scholar
• Evans, S. 2015. “Budget 2015: Key Climate and Energy Announcements.” CarbonBrief. https://www.carbonbrief.org/budget-2015-key-climate-and-energy-announcements/.
   Google Scholar
• Farstad, F. M. 2018. “What Explains Variation in Parties’ Climate Change Salience?” Party Politics 24 (6): 698–707.
   Google Scholar
• Finseraas, H., B. Høyland, and M. G. Søyland. 2021. “Climate Politics in Hard Times: How Local Economic Shocks Influence MPs Attention to Climate Change.” European Journal of Political Research 60 (3): 738–747.
   Web of Science ®Google Scholar
• Flachsland, C., and S. Levi. 2021. “Germany’s Federal Climate Change Act.” Environmental Politics 30 (S1): 118–140.
   Google Scholar
• Geese, L., and C. Schwemmer. 2019. “MPs’ Principals and the Substantive Representation of Disadvantaged Immigrant Groups.” West European Politics 42 (4): 681–704.
   Web of Science ®Google Scholar
• Gransaull, G., E. Rhodes, and M. Fairbrother. 2023. “Institutions for Effective Climate Policymaking: Lessons from the Case of the United Kingdom.” Energy Policy 175: 113484.
   Web of Science ®Google Scholar
• Green, J. F., and R. S. Reyes. 2023. “The History of Net Zero: Can We Move from Concepts to Practice?” Climate Policy 23 (7): 901–915.
   Google Scholar
• Grimmer, J., and B. M. Stewart. 2013. “Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts.” Political Analysis 21 (3): 267–297.
   Web of Science ®Google Scholar
• Grootendorst M (2022) BERTopic: Neural Topic Modeling with a Class-Based TF-IDF Procedure. [object Object]. Epub ahead of print 2022. https://doi.org/10.48550/ARXIV.2203.05794.
   Google Scholar
• Guber, D. L., J. Bohr, and R. E. Dunlap. 2021. “‘Time to Wake Up’: Climate Change Advocacy in a Polarized Congress, 1996-2015.” Environmental Politics 30 (4): 538–558.
   Web of Science ®Google Scholar
• Häussler, T., H. Schmid-Petri, S. Adam, U. Reber, and D. Arlt. 2016. “The Climate of Debate: How Institutional Factors Shape Legislative Discourses on Climate Change. A Comparative Framing Perspective.” Studies in Communication Sciences 16 (1): 94–102.
   Google Scholar
• Hillard, D., S. Purpura, and J. Wilkerson. 2008. “Computer-Assisted Topic Classification for Mixed-Methods Social Science Research.” Journal of Information Technology & Politics 4 (4): 31–46.
   Google Scholar
• Höhmann, D., and U. Sieberer. 2020. “Parliamentary Questions as a Control Mechanism in Coalition Governments.” West European Politics 43 (1): 225–249.
   Web of Science ®Google Scholar
• Hopper, J. S., and C. S. Swift. 2022. “Considering Subnational Support of Climate Change Policy in the United States and the Implications of Symbolic Policy Acts.” Environmental Politics 31 (6): 969–990.
   Google Scholar
• Huber, R. A., T. Maltby, K. Szulecki, and S. Ćetković. 2021. “Is Populism a Challenge to European Energy and Climate Policy? Empirical Evidence across Varieties of Populism.” Journal of European Public Policy 28 (7): 998–1017.
   Web of Science ®Google Scholar
• Iacobuta, G., N. K. Dubash, P. Upadhyaya, M. Deribe, and N. Höhne. 2018. “National Climate Change Mitigation Legislation, Strategy and Targets: A Global Update.” Climate Policy 18 (9): 1114–1132.
   Web of Science ®Google Scholar
• Javeline, D. 2014. “The Most Important Topic Political Scientists Are Not Studying: Adapting to Climate Change.” Perspectives on Politics 12 (2): 420–434.
   Web of Science ®Google Scholar
• Jordan, A. J., D. Huitema, M. Hildén, H. van Asselt, T. J. Rayner, J. J. Schoenefeld, J. Tosun, J. Forster, and E. L. Boasson. 2015. “Emergence of Polycentric Climate Governance and Its Future Prospects.” Nature Climate Change 5 (11): 977–982.
   Web of Science ®Google Scholar
• Jordan, A., I. Lorenzoni, J. Tosun, J. E. i Saus, L. Geese, J. Kenny, E. L. Saad, B. Moore, and S. G. Schaub. 2022. “The Political Challenges of Deep Decarbonisation: Towards a More Integrated Agenda.” Climate Action 1 (1): 6.
   Google Scholar
• Keh, J. F. 2015. “The Centralisation of Parliamentary Policy Statements in Western European Parliaments.” West European Politics 38 (5): 1086–1105.
   Web of Science ®Google Scholar
• Keohane, R. O. 2015. “The Global Politics of Climate Change: Challenge for Political Science.” PS: Political Science & Politics 48 (01): 19–26.
   Google Scholar
• King, G., P. Lam, and M. E. Roberts. 2017. “Computer-Assisted Keyword and Document Set Discovery from Unstructured Text.” American Journal of Political Science 61 (4): 971–988.
   Web of Science ®Google Scholar
• Kinski, L., and A. Ripoll Servent. 2022. “Framing Climate Policy Ambition in the European Parliament.” Politics and Governance 10 (3): 251–263.
   Google Scholar
• Laurer, M., W. Van Atteveldt, A. Casas, and K. Welbers. 2024. “Less Annotating, More Classifying: Addressing the Data Scarcity Issue of Supervised Machine Learning with Deep Transfer Learning and BERT-NLI.” Political Analysis 32 (1): 84–100.
   Google Scholar
• Laver, M., and K. A. Shepsle, eds. 1996. Making and Breaking Governments: Cabinets and Legislatures in Parliamentary Democracies. 1st ed. Cambridge: Cambridge University Press. Accessed September 25, 2023. https://www.cambridge.org/core/product/identifier/9780511625671/type/book.
   Google Scholar
• Lazarus, R. J. 2009. “Super Wicked Problems and Climate Change: Restraining the Present to Liberate the Future.” Cornell Law Review 94 (5): 1153–1233.
   Web of Science ®Google Scholar
• Le Quéré, C., R. B. Jackson, M. W. Jones, A. J. P. Smith, S. Abernethy, R. M. Andrew, A. J. De-Gol, et al. 2020. “Temporary Reduction in Daily Global CO2 Emissions during the COVID-19 Forced Confinement.” Nature Climate Change 10 (7): 647–653.
   Web of Science ®Google Scholar
• Martin, S. 2011. “Parliamentary Questions, the Behaviour of Legislators, and the Function of Legislatures: An Introduction.” The Journal of Legislative Studies 17 (3): 259–270.
   Google Scholar
• Moore, B., L. Geese, J. Kenny, H. Dudley, A. Jordan, A. Prados Pascual, I. Lorenzoni, S. Schaub, J. Enguer, and J. Tosun. 2024. “Politicians and Climate Change: A Systematic Review of the Literature.” WIRES Climate Change, e908.
   Google Scholar
• Morton, R. B. 1999. Methods and Models: A Guide to the Empirical Analysis of Formal Models in Political Science. 1st ed. Cambridge: Cambridge University Press. Accessed September 25, 2023. https://www.cambridge.org/core/product/identifier/9780511612473/type/book.
   Google Scholar
• Otjes, S., and T. Louwerse. 2018. “Parliamentary Questions as Strategic Party Tools.” West European Politics 41 (2): 496–516.
   Web of Science ®Google Scholar
• Proksch, S.-O., and J. B. Slapin. 2015. The Politics of Parliamentary Debate: Parties, Rebels and Representation. Cambridge: Cambridge University Press.
   Google Scholar
• Przeworski, A., and H. Teune. 1970. The Logic of Comparative Social Inquiry. New York: Wiley-Interscience.
   Google Scholar
• Reber, U. 2019. “Overcoming Language Barriers: Assessing the Potential of Machine Translation and Topic Modeling for the Comparative Analysis of Multilingual Text Corpora.” Communication Methods and Measures 13 (2): 102–125.
   Web of Science ®Google Scholar
• Reveilhac, M., and D. Morselli. 2022. “Dictionary-Based and Machine Learning Classification Approaches: A Comparison for Tonality and Frame Detection on Twitter Data.” Political Research Exchange 4 (1): 2029217.
   Google Scholar
• Roberts, M. E., B. M. Stewart, D. Tingley, C. Lucas, J. Leder-Luis, S. K. Gadarian, B. Albertson, and D. G. Rand. 2014. “Structural Topic Models for Open-Ended Survey Responses.” American Journal of Political Science 58 (4): 1064–1082.
   Web of Science ®Google Scholar
• Rodriguez, P. L., and A. Spirling. 2022. “Word Embeddings: What Works, What Doesn’t, and How to Tell the Difference for Applied Research.” The Journal of Politics 84 (1): 101–115.
   Google Scholar
• Russo, F., and M. Wiberg. 2010. “Parliamentary Questioning in 17 European Parliaments: Some Steps towards Comparison.” The Journal of Legislative Studies 16 (2): 215–232.
   Google Scholar
• Sartori, G. 1970. “Concept Misformation in Comparative Politics.” American Political Science Review 64 (4): 1033–1053.
   Web of Science ®Google Scholar
• Schaefer, R., C. Abels, S. Lewandowsky, and M. Stede. 2023. “Communicating Climate Change: A Comparison Between Tweets and Speeches by German Members of Parliament.” In Proceedings of the 13th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis, Toronto, Canada, 2023, edited by Jeremy Barnes, Orphée De Clercq, and Roman Klinger, 479–496. Toronto: Association for Computational Linguistics. Accessed March 3, 2024. https://aclanthology.org/2023.wassa-1.42.
   Google Scholar
• Schaffer, L. M., B. Oehl, and T. Bernauer. 2022. “Are Policymakers Responsive to Public Demand in Climate Politics?” Journal of Public Policy 42 (1): 136–164.
   Web of Science ®Google Scholar
• Schumacher, G., and C. Elmelund-Præstekær. 2018. “Party Performance Explains Disagreement Between Politicians and Their Parties.” West European Politics 41 (2): 329–349.
   Web of Science ®Google Scholar
• Schürmann, L. 2023. “The Impact of Local Protests on Political Elite Communication: Evidence from Fridays for Future in Germany.” Journal of Public Opinion and Parties 34 (3): 1–21.
   Web of Science ®Google Scholar
• Schwalbach, J., and C. Rauh. 2021. “Collecting Large-Scale Comparative Text Data on Legislative Debates.” In The Politics of Legislative Debates, edited by Bäck Hanna, Marc Debus, and Jorge Fernandes, 91–109. Oxford: Oxford University Press. Accessed September 27, 2023. https://academic.oup.com/book/39141/chapter/338573922.
   Google Scholar
• Schwörer, J. 2024. “Mainstream Parties and Global Warming: What Determines Parties’ Engagement in Climate Protection?” European Journal of Political Research 63 (1): 303–325.
   Web of Science ®Google Scholar
• Scotford, E., and S. Minas. 2019. “Probing the Hidden Depths of Climate Law: Analysing National Climate Change Legislation.” Review of European, Comparative & International Environmental Law 28 (1): 67–81.
   Web of Science ®Google Scholar
• Scott, M. 2000. “Focusing on the Text and Its Key Words.” In Rethinking Language Pedagogy from a Corpus Perspective. Papers from the Third International Conference on Teaching and Language Corpora, edited by L. Burnard and T. McEnry, 103–121. Frankfurt: Peter Lang.
   Google Scholar
• Seawright, J., and J. Gerring. 2008. “Case Selection Techniques in Case Study Research.” Political Research Quarterly 61 (2): 294–308.
   Web of Science ®Google Scholar
• Seely, A., and E. Ares. 2016. Climate Change Levy: Renewable Energy & the Carbon Reduction Commitment. 07283. House of Commons Library. https://commonslibrary.parliament.uk/research-briefings/cbp-7283/.
   Google Scholar
• Terechshenko, Z., F. Linder, V. Padmakumar, F. Liu, J. Nagler, J. A. Tucker, and R. Bonneau. 2020. “A Comparison of Methods in Political Science Text Classification: Transfer Learning Language Models for Politics.” SSRN Electronic Journal. Epub ahead of print 2020. https://doi.org/10.2139/ssrn.3724644.
   Google Scholar
• Töller, A. E. 2023. “The Glass Is Half Full: Environmental and Climate Policy of the Last Merkel Government between Protest and Pandemic.” German Politics 33: 1–26.
   Web of Science ®Google Scholar
• Tosun, J., and B. G. Peters. 2021. “The Politics of Climate Change: Domestic and International Responses to a Global Challenge.” International Political Science Review 42 (1): 3–15.
   Web of Science ®Google Scholar
• UK Government. 2011. The Carbon Plan: Delivering our low Carbon Future. London: UK Government. https://assets.publishing.service.gov.uk/media/5a79744ced915d07d35b5a17/3702-the-carbon-plan-delivering-our-low-carbon-future.pdf.
   Google Scholar
• UNFCCC. 2009. Fact Sheet: The Need for Mitigation. Accessed July 5, 2022. https://unfccc.int/files/press/backgrounders/application/pdf/press_factsh_mitigation.pdf.
   Google Scholar
• Vandeweerdt, C., B. Kerremans, and A. Cohn. 2016. “Climate Voting in the US Congress: The Power of Public Concern.” Environmental Politics 25 (2): 268–288.
   Web of Science ®Google Scholar
• Victor, D. G., K. Akimoto, Y. Kaya, M. Yamaguchi, D. Cullenward, and C. Hepburn. 2017. “Prove Paris Was More Than Paper Promises.” Nature 548 (7665): 25–27.
   PubMed Web of Science ®Google Scholar
• Watanabe, K. 2018. “Newsmap.” Digital Journalism 6 (3): 294–309.
   Web of Science ®Google Scholar
• Wendler, F. 2022. “Framing Climate Change in the EU and US after the Paris Agreement.” In Palgrave Studies in European Union Politics. Cham: Palgrave Macmillan.
   Google Scholar
• Wiberg, M. 1995. “Parliamentary Questioning: Control by Communication?” In Parliaments and Majority Rule in Western Europe, edited by H. Döring, 179–222. Frankfurt am Main: Campus Verlag.
   Google Scholar
• Wilkerson, J., and A. Casas. 2017. “Large-Scale Computerized Text Analysis in Political Science: Opportunities and Challenges.” Annual Review of Political Science 20 (1): 529–544.
   Web of Science ®Google Scholar
• Willis, R. 2018. “Constructing a ‘Representative Claim’ for Action on Climate Change: Evidence from Interviews with Politicians.” Political Studies 66 (4): 940–958.
   Web of Science ®Google Scholar