Unravelling effectiveness in intelligence: a systematic review

Bibliography

• Acuff, J. M., and M. J. Nowlin. “Competitive Intelligence and National Intelligence Estimates.” Intelligence and National Security 34, no. 5 July 29, 2019. 654–672.
   Web of Science ®Google Scholar
• Aldrich, R. J. “Strategic Culture As a Constraint: Intelligence Analysis, Memory and Organizational Learning in the Social Sciences and History.” Intelligence and National Security 32, no. 5 July 29, 2017. 625–635.
   Web of Science ®Google Scholar
• Arcos, R., and J.-M. Palacios. “The Impact of Intelligence on Decision-Making: The Eu and the Arab Spring.” Intelligence and National Security 33, no. 5 July 29, 2018. 737–754.
   Web of Science ®Google Scholar
• Barnea, A., and A. Meshulach. “Forecasting for Intelligence Analysis: Scenarios to Abort Strategic Surprise.” International Journal of Intelligence & Counter Intelligence 34, no. 1 January 2, 2021. 106–133.
   Web of Science ®Google Scholar
• Beeres, R., and M. Bogers. “Ranking the Performance of European Armed Forces.” Defence and Peace Economics 23, no. 1 (2012): 1–16.
   Web of Science ®Google Scholar
• Ben-Gad, M., Y. Ben-Haim, and D. Peled. “Allocating Security Expenditures Under Knightian Uncertainty: An Info-Gap Approach.” Defence and Peace Economics 31, no. 7 October 2, 2020. 830–850.
   Web of Science ®Google Scholar
• Borer, D. A., S. Twing, and R. P. Burkett. “Problems in the Intelligence-Policy Nexus: Rethinking Korea, Tet, and Afghanistan.” Intelligence and National Security 29, no. 6 November 2, 2014. 811–836.
   Google Scholar
• Borg, L. C. “Improving Intelligence Analysis: Harnessing Intuition and Reducing Biases by Means of Structured Methodology.” The International Journal of Intelligence, Security, and Public Affairs 19, no. 1 January 2, 2017. 2–22.
   Google Scholar
• Breakspear, A. “A New Definition of Intelligence.” Intelligence and National Security 28, no. 5 October 1, 2013. 678–693.
   Google Scholar
• Bruijn, J. A. D. Managing Performance in the Public Sector. [in Engels] London: Routledge, 2002.
   Google Scholar
• Brunatti, A. D. “The Architecture of Community: Intelligence Community Management in Australia, Canada and New Zealand.” Public Policy and Administration 28, no. 2 (2013): 119–143.
   Google Scholar
• Caceres-Rodriguez, R., and M. Landon-Murray. “Charting a Research Agenda for Intelligence Studies Using Public Administration and Organization Theory Scholarship.” In Researching National Security Intelligence: Multidisciplinary Approaches, edited by S. Coulthart, M. Landon-Murray and D. Van Puyvelde, 141–162. 2019.
   Google Scholar
• Calista, D. J. “Enduring Inefficiencies in Counterintelligence by Reducing Type I and Type Ii Errors Through Parallel Systems: A Principal-Agent Typology.” International Journal of Intelligence & CounterIntelligence 27, no. 1 March 1, 2014. 109–131.
   Google Scholar
• Cayford, M., and W. Pieters. “Effectiveness Fettered by Bureaucracy: Why Surveillance Technology Is Not Evaluated.” Intelligence and National Security 35, no. 7 November 9, 2020. 1026–1041.
   Web of Science ®Google Scholar
• Cepik, M. “Bosses and Gatekeepers: A Network Analysis of South America’s Intelligence Systems.” International Journal of Intelligence & CounterIntelligence 30, no. 4 October 2, 2017. 701–722.
   Google Scholar
• Chang, W. “Getting it Right Assessing the Intelligence Community’s Analytic Performance.” American Intelligence Journal 30, no. 2 (2012): 99–108.
   Google Scholar
• Chang, W. “Fixing Intelligence Reforming the Defense Intelligence Enterprise for Better Analysis.” American Intelligence Journal 31, no. 1 (2013): 86–90.
   Google Scholar
• Connelly, M., R. Hicks, R. Jervis, and A. Spirling. “New Evidence and New Methods for Analyzing the Iranian Revolution As an Intelligence Failure.” Intelligence and National Security 36, no. 6 September 19, 2021. 781–806.
   Web of Science ®Google Scholar
• Coulthart, S. “Why Do Analysts Use Structured Analytic Techniques? An In-Depth Study of an American Intelligence Agency.” Intelligence and National Security 31, no. 7 November 9, 2016. 933–948.
   Web of Science ®Google Scholar
• Coulthart, S. J. “An Evidence-Based Evaluation of 12 Core Structured Analytic Techniques.” International Journal of Intelligence & CounterIntelligence 30, no. 2 April 3, 2017. 368–391.
   Google Scholar
• Coulthart, S., and S. Marrin. “Where to Submit: A Guide to Publishing Intelligence Studies Articles.” Intelligence and National Security 38, no. 4 (2023): 643–53.
   Web of Science ®Google Scholar
• Dahl, E. J. “Getting Beyond Analysis by Anecdote: Improving Intelligence Analysis Through the Use of Case Studies.” Intelligence and National Security 32, no. 5 July 29, 2017. 563–578.
   Web of Science ®Google Scholar
• Dahl, E. J. “Why Won’t They Listen? Comparing Receptivity Toward Intelligence at Pearl Harbor and Midway.” Intelligence and National Security 28, no. 1 February 1, 2013. 68–90.
   Google Scholar
• Daniel, I., and D. R. Mandel. “Improving Information Evaluation for Intelligence Production.” Intelligence and National Security 34, no. 4 June 7, 2019. 503–525.
   Web of Science ®Google Scholar
• de Valk, G., and O. Goldbach. “Towards a Robust Β Research Design: On Reasoning and Different Classes of Unknowns.” Journal of Intelligence History 20, no. 1 January 2, 2021. 72–87.
   Google Scholar
• Dhami, M. K. “Towards an Evidence-Based Approach to Communicating Uncertainty in Intelligence Analysis.” Intelligence and National Security 33, no. 2 February 23, 2018. 257–272.
   Web of Science ®Google Scholar
• Eiran, E. “Dangerous Liaison: The 1973 American Intelligence Failure and the Limits of Intelligence Cooperation.” Journal of Intelligence History 19, no. 2 July 2, 2020. 213–228.
   Google Scholar
• Eiran, E. “The Three Tensions of Investigating Intelligence Failures.” Intelligence and National Security 31, no. 4 June 6, 2016. 598–618.
   Web of Science ®Google Scholar
• Faini, M. “The Us Government and the Italian Coup Manqué of 1964: The Unintended Consequences of Intelligence Hierarchies.” Intelligence and National Security 31, no. 7 November 9, 2016. 1011–1024.
   Web of Science ®Google Scholar
• Friedman, J. A., and R. Zeckhauser “Why Assessing Estimative Accuracy Is Feasible and Desirable.” Intelligence and National Security 31, no. 2 February 23, 2016. 178–200.
   Web of Science ®Google Scholar
• Gainor, R., and F. Bouthillier. “Competitive Intelligence Insights for Intelligence Measurement.” International Journal of Intelligence & CounterIntelligence 27, no. 3 September 1, 2014. 590–603.
   Google Scholar
• Gentry, J. A. “Has the Odni Improved U.S. Intelligence Analysis?.” International Journal of Intelligence & CounterIntelligence 28, no. 4 02 date-in-citation. October 2015. 637–661.
   Google Scholar
• Gentry, J. A. “The Intelligence of Fear.” Intelligence and National Security 32, no. 1 January 2, 2017. 9–25.
   Web of Science ®Google Scholar
• Gentry, J. A., and J. S. Gordon. “U.S. Strategic Warning Intelligence: Situation and Prospects.” International Journal of Intelligence & CounterIntelligence 31, no. 1 January 2, 2018. 19–53.
   Google Scholar
• Gilad, A., E. Pecht, and A. Tishler. “Intelligence, Cyberspace, and National Security.” Defence and Peace Economics 32, no. 1 January 2, 2021. 18–45.
   Web of Science ®Google Scholar
• Gill, P. “Explaining Intelligence Failure: Rethinking the Recent Terrorist Attacks in Europe.” International Journal of Intelligence & CounterIntelligence 33, no. 1 January 2, 2020. 43–67.
   Web of Science ®Google Scholar
• Gill, P. “The Way Ahead in Explaining Intelligence Organization and Process.” Intelligence and National Security 33, no. 4 June 7, 2018. 574–586.
   Web of Science ®Google Scholar
• Gordon, D. K. “Developing Managers of Analysts: The Key to Retaining Analytic Expertise.” International Journal of Intelligence & CounterIntelligence 31, no. 4 October 2, 2018. 745–757.
   Google Scholar
• Hamm, G. “British Intelligence in the Middle East, 1898–1906.” Intelligence and National Security 29, no. 6 November 2, 2014. 880–900.
   Google Scholar
• Hetherington, J., and K. Dear. “Assessing Assessments How Useful Is Predictive Intelligence?.” American Intelligence Journal 34, no. 1 (2017): 116–122.
   Google Scholar
• Heuer, R. J. Psychology of Intelligence Analysis. Washington, D.C: Center for the Study of Intelligence, Central Intelligence Agency, 1999.
   Google Scholar
• Honig, O. A., and S. Zimskind. “The Spy Machine and the Ballot Box: Examining Democracy’s Intelligence Advantage.” International Journal of Intelligence & CounterIntelligence 30, no. 3 July 3, 2017. 431–463.
   Google Scholar
• Horlings, T. “Dealing with Data: Coming to Grips with the Information Age in Intelligence Studies Journals.” Intelligence and National Security 38, no. 3 April 16, 2023. 447–469.
   Web of Science ®Google Scholar
• Ingesson, T. “Beyond Blame: What Investigations of Intelligence Failures Can Learn from Aviation Safety.” International Journal of Intelligence & CounterIntelligence 35, no. 3 03 date-in-citation. July 2022. 527–542.
   Web of Science ®Google Scholar
• Jones, N. “Critical Epistemology for Analysis of Competing Hypotheses.” Intelligence and National Security 33, no. 2 February 23, 2018. 273–289.
   Web of Science ®Google Scholar
• Kacper, G., and W. R. Moy. “Covid-19 Response – Lessons from Secret Intelligence Failures.” The International Journal of Intelligence, Security, and Public Affairs 23, no. 3 September 2, 2021. 161–179.
   Google Scholar
• Kajdasz, J. E. “A Demonstration of the Benefits of Aggregation in an Analytic Task.” International Journal of Intelligence & CounterIntelligence 27, no. 4 December 1, 2014. 752–763.
   Google Scholar
• Karam, J. G. “Missing Revolution: The American Intelligence Failure in Iraq, 1958.” Intelligence and National Security 32, no. 6 19 date-in-citation. September 2017. 693–709.
   Web of Science ®Google Scholar
• Kruger, A., L. Thorburn, and T. van Gelder. “Using Argument Mapping to Improve Clarity and Rigour in Written Intelligence Products.” Intelligence and National Security 37, no. 5 July 29, 2022. 607–626.
   Web of Science ®Google Scholar
• Landon-Murray, M., and R. Caceres-Rodriguez. “Building Research Partnerships to Bridge Gaps Between the Study of Organizations and the Practice of Intelligence.” The International Journal of Intelligence, Security, and Public Affairs 23, no. 1 January 2, 2021. 13–33.
   Google Scholar
• Lefebvre, S. “‘The Belgians Just Aren’t Up to It’: Belgian Intelligence and Contemporary Terrorism.” International Journal of Intelligence & CounterIntelligence 30, no. 1 January 2, 2017. 1–29.
   Google Scholar
• Libel, T. “Looking for Meaning: Lessons from Mossad’s Failed Adaptation to the Post-Cold War Era, 1991–2013.” Journal of Intelligence History 14, no. 2 July 3, 2015. 83–95.
   Google Scholar
• Lillbacka, R. “The Finnish Intelligence Failure on the Karelian Isthmus in 1944.” The International Journal of Intelligence, Security, and Public Affairs 21, no. 1 January 2, 2019. 25–48.
   Google Scholar
• Lowenthal, M. M., and R. A. Marks. “Intelligence Analysis: Is it As Good As it Gets?.” International Journal of Intelligence & CounterIntelligence 28, no. 4 October 2, 2015. 662–665.
   Google Scholar
• Mandel, D. R., T. L. Hendriks, and D. Irwin. “Policy for Promoting Analytic Rigor in Intelligence: Professionals’ Views and Their Psychological Correlates.” Intelligence and National Security 37, no. 2 February 23, 2022. 177–196.
   Web of Science ®Google Scholar
• Mandel, D. R., and D. Irwin. “Uncertainty, Intelligence, and National Security Decisionmaking.” International Journal of Intelligence & CounterIntelligence 34, no. 3 July 3, 2021. 558–582.
   Web of Science ®Google Scholar
• Mandel, D. R., and P. E. Tetlock. “Correcting Judgment Correctives in National Security Intelligence.” Frontiers in Psychology 9 (2018): 2640.
   PubMed Web of Science ®Google Scholar
• Manjikian, M. “Positivism, Post-Positivism, and Intelligence Analysis.” International Journal of Intelligence & CounterIntelligence 26, no. 3 September 1, 2013. 563–582.
   Google Scholar
• Marchio, J. “Analytic Tradecraft and the Intelligence Community: Enduring Value, Intermittent Emphasis.” Intelligence and National Security 29, no. 2 March 4, 2014. 159–183.
   Google Scholar
• Marchio, J. “‘How Good Is Your Batting Average?’ Early Ic Efforts to Assess the Accuracy of Estimates.” Studies in Intelligence 60, no. 4 (2016): 3–13.
   Google Scholar
• Marrin, S. “Analytic Objectivity and Science: Evaluating the Us Intelligence Community’s Approach to Applied Epistemology.” Intelligence and National Security 35, no. 3 April 15, 2020. 350–366.
   Web of Science ®Google Scholar
• Marrin, S. “Evaluating Intelligence Theories: Current State of Play.” Intelligence and National Security 33, no. 4 June 7, 2018. 479–490.
   Web of Science ®Google Scholar
• Marrin, S. “Improving Intelligence Studies As an Academic Discipline.” Intelligence and National Security 31, no. 2 February 23, 2016. 266–279.
   Web of Science ®Google Scholar
• Marrin, S. “Is Intelligence Analysis an Art or a Science?.” International Journal of Intelligence & CounterIntelligence 25, no. 3 September 1, 2012. 529–545.
   Google Scholar
• McDermott, R., and U. Bar-Joseph. “Pearl Harbor and Midway: The Decisive Influence of Two Men on the Outcomes.” Intelligence and National Security 31, no. 7 November 9, 2016. 949–962.
   Web of Science ®Google Scholar
• Mettler, S. “Return of the Bear Learning from Intelligence Analysis of the USSR to Better Assess Modern Russia.” American Intelligence Journal 35, no. 2 (2018): 33–41.
   Google Scholar
• Nikki, I., A. Guttmann, and C. O. Meyer. “An Analytical Framework for Postmortems of European Foreign Policy: Should Decision-Makers Have Been Surprised?.” Intelligence and National Security 35, no. 2 23 date-in-citation. February 2020. 197–215.
   Web of Science ®Google Scholar
• Omand, D. “Reflections on Intelligence Analysts and Policymakers.” International Journal of Intelligence & CounterIntelligence 33, no. 3 July 2, 2020. 471–482.
   Web of Science ®Google Scholar
• Ostergard, R. L. “The West Africa Ebola Outbreak (2014-2016): A Health Intelligence Failure?.” Intelligence and National Security 35, no. 4 June 6, 2020. 477–492.
   Web of Science ®Google Scholar
• Palfy, A. “Bridging the Gap Between Collection and Analysis: Intelligence Information Processing and Data Governance.” International Journal of Intelligence & CounterIntelligence 28, no. 2 April 3, 2015. 365–376.
   Google Scholar
• Pecht, E., and A. Tishler. “The Value of Military Intelligence.” Defence and Peace Economics 26, no. 2 March 4, 2015. 179–211.
   Web of Science ®Google Scholar
• Rietjens, S. “Intelligence in Defence Organizations: A Tour De Force.” Intelligence and National Security 35, no. 5 July 28, 2020. 717–733.
   Web of Science ®Google Scholar
• Rietjens, S., J. Soeters, and W. Klumper “Measuring the Immeasurable? The Effects-Based Approach in Comprehensive Peace Operations.” International Journal of Public Administration 34, no. 5 (2011): 329–338.
   Google Scholar
• Ryan, M. “Wilful Blindness or Blissful Ignorance? The United States and the Successful Denuclearization of Iraq.” Intelligence and National Security 29, no. 3 May 4, 2014. 458–486.
   Google Scholar
• Saito, N. “Japanese Navy’s Tactical Intelligence Collection on the Eve of the Pacific War.” International Journal of Intelligence & CounterIntelligence 33, no. 3 July 2, 2020. 556–574.
   Web of Science ®Google Scholar
• Salmi, I. “Why Europe Needs Intelligence and Why Intelligence Needs Europe: “Intelligence Provides Analytical Insight into an Unpredictable and Complex Environment.” International Journal of Intelligence & CounterIntelligence 33, no. 3 July 2, 2020. 464–470.
   Web of Science ®Google Scholar
• Simon, J. M. “Intelligence Analysis As Practiced by the Cia.” International Journal of Intelligence & CounterIntelligence 26, no. 4 December 1, 2013. 641–651.
   Google Scholar
• Soares, J., G. Letens, N. Vallet, W. Van Bockhaven, H. Keathley-Herring, and E. Van Aken. “The Defence Performance Measurement Framework: Measuring the Performance of Defence Organisations at the Strategic Level.” Defence Studies 22, no. 1 (2022): 99–122.
   Google Scholar
• Speigel, I. “Adopting and Improving a New Forecasting Paradigm.” Intelligence and National Security 36, no. 7 November 10, 2021. 961–977.
   Web of Science ®Google Scholar
• Spoor, B., and M. Rothman. “On the Critical Utility of Complexity Theory in Intelligence Studies.” Intelligence and National Security 36, no. 4 June 7, 2021. 555–568.
   Web of Science ®Google Scholar
• Steinhart, A., and K. Avramov. “Is Everything Personal?: Political Leaders and Intelligence Organizations: A Typology.” International Journal of Intelligence & CounterIntelligence 26, no. 3 September 1, 2013. 530–549.
   Google Scholar
• Stivi-Kerbis, S. “The Surprise of Peace: The Challenge of Intelligence in Identifying Positive Strategic–Political Shifts.” International Journal of Intelligence & CounterIntelligence 32, no. 3 July 03,2019. 448–466.
   Web of Science ®Google Scholar
• Stromer-Galley, J., P. Rossini, K. Kenski, B. McKernan, B. Clegg, J. Folkestad, C. Østerlund, et al. “Flexible versus Structured Support for Reasoning: Enhancing Analytical Reasoning Through a Flexible Analytic Technique.” Intelligence and National Security 36, no. 2 February 23, 2021. 279–298.
   Web of Science ®Google Scholar
• Thomson, J. “Governance Costs and Defence Intelligence Provision in the UK: A Case-Study in Microeconomic Theory.” Intelligence and National Security 31, no. 6 September 18, 2016. 844–857.
   Web of Science ®Google Scholar
• Tranfield, D., D. Denyer, and P. Smart. “Towards a Methodology for Developing Evidence-Informed Management Knowledge by Means of Systematic Review.” British Journal of Management 14, no. 3 (2003): 207–222.
   Web of Science ®Google Scholar
• Triana, I., J. L. F. Héctor, and E. Ballesté. “Audit of a Competitive Intelligence Unit.” The International Journal of Intelligence, Security, and Public Affairs 19, no. 3 September03, 2017. 214–241.
   Google Scholar
• Tuinier, P. “Explaining the Depth and Breadth of International Intelligence Cooperation: Towards a Comprehensive Understanding.” Intelligence and National Security 36, no. 1 January 2, 2021. 116–138.
   Web of Science ®Google Scholar
• Turcotte, J.-M. “‘An Important Contribution to the Allied War Effort’: Canadian and North Atlantic Intelligence on German POWs, 1940–1945.” Intelligence and National Security 34, no. 2 February 23, 2019. 289–306.
   Web of Science ®Google Scholar
• Van Puyvelde, D. “Fusing Drug Enforcement: A Study of the El Paso Intelligence Center.” Intelligence and National Security 31, no. 6 September 18, 2016. 888–902.
   Web of Science ®Google Scholar
• Van Puyvelde, D., and S. Curtis “‘Standing on the Shoulders of Giants’: Diversity and Scholarship in Intelligence Studies.” Intelligence and National Security 31, no. 7 November 9, 2016. 1040–1054.
   Web of Science ®Google Scholar
• VristRønn, K. “Mis-) Informed Decisions? On Epistemic Reasonability of Intelligence Claims.” International Journal of Intelligence & CounterIntelligence 27, no. 2 June 1, 2014. 351–367.
   Google Scholar
• Walsh, P. F. “Improving Strategic Intelligence Analytical Practice Through Qualitative Social Research.” Intelligence and National Security 32, no. 5 July 29, 2017. 548–562.
   Web of Science ®Google Scholar
• Wheaton, K. “Evaluating Intelligence: Answering Questions Asked and Not.” International Journal of Intelligence & CounterIntelligence 22, no. 4 (2009): 614–631.
   Google Scholar
• Whitesmith, M. “The Efficacy of Ach in Mitigating Serial Position Effects and Confirmation Bias in an Intelligence Analysis Scenario.” Intelligence and National Security 34, no. 2 February 23, 2019. 225–242.
   Web of Science ®Google Scholar
• Whitesmith, M. “Experimental Research in Reducing the Risk of Cognitive Bias in Intelligence Analysis.” International Journal of Intelligence & CounterIntelligence 33, no. 2 April 2, 2020. 380–405.
   Web of Science ®Google Scholar
• Wilkinson, M. “Nerve Agent Development: A Lesson in Intelligence Failure?.” Journal of Intelligence History 14, no. 2 July 3, 2015. 96–111.
   Google Scholar
• Wilson, J. M., C. K. Lake, M. Matthews, M. Southard, R. M. Leone, and M. McCarthy “Health Security Warning Intelligence During First Contact with Covid: An Operations Perspective.” Intelligence and National Security 37, no. 2 February 23, 2022. 216–240.
   Web of Science ®Google Scholar
• Wilson, J. M., and T. McNamara “The 1999 West Nile Virus Warning Signal Revisited.” Intelligence and National Security 35, no. 4 June 6, 2020. 519–526.
   Web of Science ®Google Scholar
• Wilson, J. M., G. M. Scalaro, and J. A. Powell “Influenza Pandemic Warning Signals: Philadelphia in 1918 and 1977–1978.” Intelligence and National Security 35, no. 4 June 6, 2020. 502–518.
   Web of Science ®Google Scholar
• Wilson, M., K. Wnuk, J. Silvander, and T. Gorschek. “A Literature Review on the Effectiveness and Efficiency of Business Modeling.” E-Informatica Software Engineering Journal 12, no. 1 (2018): 265–302.
   Google Scholar
• Wirtz, J. J. “The Art of the Intelligence Autopsy.” Intelligence and National Security 29, no. 1 January 2, 2014. 1–18.
   Google Scholar
• Wirtz, J. J. “Indications and Warning in an Age of Uncertainty.” International Journal of Intelligence & CounterIntelligence 26, no. 3 01 date-in-citation. September 2013. 550–562.
   Google Scholar
• Wolfberg, A. “When Generals Consume Intelligence: The Problems That Arise and How They Solve Them.” Intelligence and National Security 32, no. 4 07 date-in-citation. June 2017. 460–478.
   Web of Science ®Google Scholar
• Work, J. D. “Evaluating Commercial Cyber Intelligence Activity.” International Journal of Intelligence & CounterIntelligence 33, no. 2 April 2, 2020. 278–308.
   Web of Science ®Google Scholar
• Yauri-Miranda, J. R. “Principles to Assess Accountability: A Study of Intelligence Agencies in Spain and Brazil.” International Journal of Intelligence & CounterIntelligence 34, no. 3 July 3, 2021. 583–613.
   Web of Science ®Google Scholar
• Zulauf, B. “From a Former Odni Ombudsperson Perspective: Safeguarding Objectivity in Intelligence Analysis.” Studies in Intelligence 63, no. 3 (2021): 35–39.
   Google Scholar