Automating War: The Need for Regulation

Abstract

New technological developments in the area of robotics and artificial intelligence have made robotic weapons systems of increasing autonomy possible. Although thousands of unmanned systems have been deployed, the vast majority are unarmed, used primarily for reconnaissance or removal of explosives. But deployment of armed robotic weapons has begun and promises to accelerate rapidly in the next decade. This article begins by proposing definitions of autonomous or robotic weapons, outlines the most important obstacles to their introduction, and options for arms control. It makes three claims: first, robotic weapons such as unmanned vehicles could largely replace human soldiers in the battlespace in one or two decades; second, for technical, economic, and operational reasons robotic weapons will become increasingly autonomous; finally, these new types of conventional weapons could result in new dangers to international security that should be addressed before the weapons are introduced and proliferate widely. It is suggested that an outright ban would be unlikely to be successful and that it may not even be desirable. A ban of particular types of offensive automatic weapons (AW) and special provisions on defensive types would make most sense.

Notes

Noel Sharkey, ‘Robot Wars Are a Reality’, Guardian, 18 August 2007.

Tom Simonite, ‘“Robot Arms Race” Underway, Expert Warns’, New Scientist, 27 February 2008.

‘Predator RQ-1/MQ-1/ MQ-9 Reaper Unmanned Aerial Vehicle, USA’, airforce-technology.com, 2007, available at: http://www.airforce-technology.com/projects/predator (accessed 15 August 2008).

Stew Magnuson, ‘Gun-Toting Ground Robots See Action in Iraqi Streets’, National Defense Magazine, September 2007; Peter Nowak, ‘“We Absolutely Don't Want to Ever Be in a Fair Fight”‘, CBC News, 21 April 2008.

Robert Gates, ‘Secretary Gates Remarks at Maxwell-Gunter Air Force Base, Montgomery Alabama’, DefenseLink, 21 April 2008.

Erik Sofge, ‘America's Robot Army: Are Unmanned Fighters Ready for Combat?’, Popular Mechanics, No. 185 (March 2008), p. 58.

Chris Osborn, ‘Army Looks to Put Fire Scout on Fast Track’, Army Times, 17 June 2008.

Unmanned Systems Roadmap 2007–2032 (Washington, DC: US Department of Defense, 10 December 2007), p. 10.

Max Boot, ‘Paradox of Technology’, The New Atlantis (Fall 2006), p. 23.

George and Meredith Friedman, The Future of War/Power, Technology and American World Dominance in the Twenty-First Century (New York: St. Martin's Griffin, 1996), Ch. 12, pp. 282–98.

This study is not in the public domain. A summary was published on the US Joint Forces Command website and is now archived, after having been withdrawn from the web, under: http://web.archive.org/web/20021022172516/http://www.jfcom.mil/about/fact_alpha.htm (accessed 15 February 2008).

‘Streetfighting Robot Challenge Announced’, The New Scientist, 24 January 2007.

David Isenberg, ‘Robots Replace Trigger Fingers in Iraq’, Asia Times Online, 29 August 2007.

Ronald Arkin, ‘Governing Lethal Behavior: Embedding Ethics in a Hybrid Deliberative/Reactive Robot Architecture’, Atlanta, GA: Georgia Institute of Technology, Technical Report, November 2007, p. 8.

Martin Shaw, The New Western Way of War/Risk-Transfer War and Its Crisis in Iraq (Cambridge: Polity Press, 2005), p. 79.

SIPRI Yearbook 2005 (Oxford: Oxford University Press, 2005), p. 329.

William Hartung, ‘Bush Military Budget Highest Since WWII’, CommonDreams.Org, 10 February 2007; Robert Higgs, ‘The Trillion-Dollar Defense Budget Is Already Here’, The Independent Institute, 15 March 2007.

Tim Weiner, ‘New Model Soldier Rolls Closer to Battle’, New York Times, 16 February 2005, available at: http://www.nytimes.com/2005/02/16/technology/16robots.html (accessed 15 August 2008).

Steven M. Shaker and Alan R. Wise, War Without Men/Robots on the Future Battlefield (Washington, DC: Pergamon-Brassey's, 1988), p. 64.

John Keller, ‘Navy Looks Into How to Control Next-generation Autonomous Unmanned Aircraft’, Military & Aerospace Electronics, 24 June 2005, available at: http://mae.pennnet.com/Articles/Article_Display.cfm?ARTICLE_ID=230972&p=32 (accessed 16 August 2008).

Lewis Page, ‘US Air Force May Allow Killbots to Be Flown by Non-Pilots’, The Register, 25 July 2008, available at: http://www.theregister.co.uk/2008/07/25/drone_boys_not_flyboys_any_more (accessed 16 August 2008).

Maryann Lawlor, ‘Miniaturization, Networking Pervade Future Unmanned Systems’, SIGNAL Magazine, April 2003.

Sharon Goudin, ‘Hack Attack Forces Pentagon to Take Computers Offline’, Information Week, 22 June 2007.

Boot, ‘Paradox of Technology’ (note 9), p. 26.

Noah Shachtman, ‘Attack of the Drones’, Wired Magazine 13.06 (June 2005), available at: http://www.wired.com/wired/archive/13.06/drones.html (accessed 3 August 2008).

Steven Featherstone, ‘The Coming Robot Army/Introducing America's Future Fighting Machines’, Harper's Magazine, February 2007, pp. 43–9.

Thomas K. Adams, ‘Future Warfare and the Decline of Human Decisionmaking (Weapons Automation)’, Parameters, Vol. 31, No. 4 (Winter 2001), pp. 57–71.

Compare Doug Beason, The E-Bomb: How America's New Directed Energy Weapons Will Change the Way Future Wars Will Be Fought (Cambridge, MA: DaCapo Press, 2005); ‘Fighting With Photons: The Most Famous Weapon of Science Fiction Is Rapidly Becoming Fact’, The Economist, 30 October 2008.

Martin Libicki, The Mesh and the Net: Speculations on Armed Conflict in a Time of Free Silicon (Washington, DC: National Defense University Press, 1994).

Unmanned Systems Roadmap 2007–2032, p. 10.

Sharkey, ‘Robot Wars Are a Reality’ (note 1).

Joseph Weizenbaum, Computer Power and Human Reason: From Judgement to Calculation (San Francisco: W.H. Freeman, 1976).

John Searle, ‘Minds, Brains, and Programs’, The Behavioral and Brain Sciences, Vol. 3, No. 3 (1980), pp. 417–57.

Noel Sharkey, ‘Another View: Roboticist Noel Sharkey on Wall-E’, Guardian, 22 July 2008, available at: http://www.guardian.co.uk/film/2008/jul/22/animation.robots (accessed 29 July 2008).

Kevin Warwick, The March of the Machines/Why the New Race of Robots Will Rule the World (London: Century, 1997), pp. 131–51.

Charles Arthur, ‘God Help Us If Machines Ever Think Like People’, Guardian, 20 June 2008.

Ray Kurzweil, The Singularity Is Near! When Humans Transcend Biology (London: Penguin, 2005); Peter Moon, ‘AI Will Surpass Human Intelligence After 2020’, Computerworld, 7 May 2007.

Helen Briggs, ‘Machines to “Match Man by 2029”’, BBC News, 16 February 2008. DARPA's estimate is 2030 according to David Ichbiah, Robots: From Science Fiction to Technological Revolution (New York: Harry N. Abrams, 2005), p. 507. IBM's Blue Brain project that started in 2005 could lead to the development of a human level artificial brain by about 2030. See NationMaster Encyclopaedia [online], available at: http://www.nationmaster.com/encyclopedia/Strong-ai (accessed 22 December 2008).

Philip Dunne, ‘Quantum Computing Steps Forward’, Physorg.com, 20 January 2006.

David Hambling, ‘Experimental AI Powers Robot Army’, Wired Blog, 14 September 2006.

Shaker and Wise, War Without Men (note 19), p. 170.

Compare US DoD Budget for 2007 and US DoD Unmanned Systems Roadmap 2007–2032.

‘Robotics to Play Major Role in Future Warfighting’, Roland Piquepaille's Technology Trends Blog, available at: http://radio.weblogs.com/0105910/2003/08/10.html (accessed 18 August 2008).

Lewis Page, ‘USAF Seeks Control of Aerial Kill-bots’, The Register, 8 August 2007; Lolita Baldor, ‘Air Force Creates New Pilot Training Program for Drones’, Associated Press, 23 October 2008.

Lewis Page, ‘USAF Ramps Up Kill-bot Fleet Following Gates Sackings’, The Register, 17 June 2008.

US National Defense Authorization Act Fiscal Year 2001, S.2549, Sec. 217.

David Isenberg, ‘Robots Replace Trigger Fingers in Iraq’, Asia Times Online, 29 August 2007.

John S. Canning, ‘Concept of Operations for Autonomous Systems’, available at: http://www.dtic.mil.ndia/2006disruptive_tech/canning.pdf (accessed 27 February 2008).

Arkin, ‘Governing Lethal Behavior’ (note 14).

Jason Mick, ‘Can Robots Commit War Crimes?’, Daily Tech Blog, 29 February 2008.

Paul Hirst, War and Power in the 21st Century/The State, Military Conflict and the International System (Oxford: Polity, 2001), p. 91.

Mike A. Guetlein, ‘Lethal Autonomous Weapons: Ethical and Doctrinal Implications’, Research Report, Maxwell, AFB: Air War College, 14 February 2008.

‘Experts Warn of Robotic Terrorism’, Associated Press, 28 February 2008.

‘Hezbollah “Air Power” First Flew in 2004’, Associated Press, 14 July 2006.

Instructions on ‘How to Build the Quintessential Sentry Gun’ can be found on the Internet: http://www.usmechatronics.com/old_page/turret.htm (accessed 31 July 2007).

Lewis Page, ‘Terrorist Robots Dissected – Anatomy of a Scare’, The Register, 2 March 2008.

Stephen Graham, ‘America's Robot Army’, The New Statesman, Vol. 135, No. 4796 (12 June 2006), pp. 12–15.

Lewis Page, ‘Reaper Aerial Killbots Enlist Mobile Phones Against Their Owners’, The Register, 28 April 2008.

Robert Mandel, Security, Strategy, and the Quest for Bloodless War (Boulder, CO: Lynne Rienner Publishers, 2004), p. 60.

Donald Macintyre, ‘“Bionic Wasps” Could Be Miniature Future Weapon with a Deadly Sting’, Independent, 18 November 2006.

‘Hybrid Insect MEMS (HI-MEMS)’, DARPA website, available at: http://www.darpa.mil/MTO/Programs/himems/index.html (accessed 16 August 2008).

David Hambling, ‘Laser Gunship Fires; Deniable Strikes Ahead?’, Wired Blog, 13 August 2008.

Tim Blackmore, War X/Human Extensions in Battlespace (Toronto: University of Toronto Press, 2005), p. 162.

Fred Reed, ‘Robotic Warfare Drawing Nearer’, The Washington Times, 10 February 2005.

William Saletan, ‘Joystick vs. Jihad/The Temptation of Remote Controlled Killing’, Slate, 12 February 2006.

Andrew Feikert, ‘Cruise Missile Proliferation’, Congressional Research Service Report, 28 July 2008.

Peter Asaro, ‘How Just Could a Robot War Be?’, in Philip Brey, Adam Briggle, and Katinka Waelbers (eds), Current Issues in Computing And Philosophy (Amsterdam: IOS Publishers, 2008), p. 5.

Robert Mandel, ‘Robots, Mercenaries, and Soldiers: The Comparative Utility of Future Fighting Forces’, Presentation at the National Annual Meeting of the International Studies Association, San Diego (March 2006).

Severo M. Ornstein, ‘Computers in Battle: A Human Overview’, in David Bellin and Gary Chapman, Computers in Battle/Will They Work? (New York: Harcourt Brace Jovanovich, 1987), p. 6.

K. Eric Drexler, Engines of Creation/The Coming Era of Nanotechnology (New York: Anchor Books, 1987), pp. 171–3.

One of the most influential critics of Drexler was the Nobel laureate Richard Smalley, who criticised the idea of molecular assemblers and Drexler's scare tactics in an exchange of open letters. Eric Drexler and Richard Smalley, ‘Drexler and Smalley Make the Case For and Against “Molecular Assembler”’, Chemical & Engineering News, Vol. 81, No. 48 (1 December 2003), pp. 37–42.

Jackrit Sukathorn, Andrew Cushing, and Gregory Chirikjian, ‘An Autonomous Self-Replicating Robotic System’, presented at the 2003 IEEE/ASME International Conference on Advanced Intelligent Mechtronics (2003).

Sean Dodson, ‘The Machine that Copies Itself’, Guardian, 3 July 2008.

Manuel De Landa, War in the Age of Intelligent Machines (New York: Zone Books, 1992), p. 7.

Hans Moravec, Robot: Mere Machine to Transcendent Mind (Oxford: Oxford University Press, 1999); Kevin Warwick, The March of the Machines/Why the New Race of Robots Will Rule the World (London: Century, 1997); Bill Joy, ‘Why the Future Doesn't Need Us’, Wired Magazine 8:04 (April 2000); The Artilect War/Cosmits Vs. Terrans: A Bitter Controversy Whether Mankind Should Build Godlike Massively Intelligent Machines (Palm Springs: ETC Publishers, 2005).

Elizer Yudkowsky, Creating Friendly AI 1.0. (2003), available at: http://www.singinst.org/CFAI/index.html (accessed 16 August 2008).

Lewis Page, ‘Blighty Joins Killer Robot Club with Afghan Strike’, The Register, 4 June 2008.

Pete Warren, ‘Launching a New Kind of Warfare’, Guardian, 26 October 2006.

Jürgen Altmann, Military Nanotechnology/Potential Applications and Preventive Arms Control (London: Routledge, 2006), p. 161.

Paul Marks, ‘Anti-landmine Campaigners Turn Sights on War Robots’, New Scientist, 28 March 2008.

Robert Hewson, ‘Cruise Missile Technology Proliferation Takes Off’, Jane's Intelligence Review, Vol. 17, No. 10 (October 2005), pp. 41–5.

US Joint Forces Command, ‘Military Robots of the Future’, About.com, 4 August 2003, available at <http://usmilitary.about.com/cs/weapons/a/robots_2.html> (accessed 19 February 2009).

Adam Hebert, ‘New Horizons for Combat UAVs’, Air Force Magazine, Vol. 86, No. 12 (1 December 2003), pp. 70–3.

‘Self-driving Cars Are Only 10 Years Away’, CBC News, 8 January 2008.

Altmann, Military Nanotechnology (note 79), pp. 165–7.

Frank Barnaby, The Automated Battlefield (New York: The Free Press, 1986), pp. 162–9.

Carl Conetta, ‘Nonoffensive Defense and the Transformation of US Defense Posture’, Cambridge, MA: Project on Defense Alternatives [online], July 1995, available at: http://www.comw.org/pda/nodglob.htm (accessed 15 December 2008).

Barnaby, The Automated Battlefield (note 85), p. 164.

Leslie L. Green, The Contemporary Law of Armed Conflict (Manchester: Manchester University Press, 2000), p. 194.

John J. Klein, ‘The Problematic Nexus: Where Unmanned Combat Air Vehicles and International Law Conflict’, Air & Space Power Journal [website], July 2003.

Thomas M. Georges, Digital Soul/Intelligent Machines and Human Values (Boulder, CO: Westview Press, 2003), p. 7.

Yudkowsky, Creating Friendly AI 1.0. (note 76), Ch. 1.

Michael Levi and Michael E. O'Hanlon, The Future of Arms Control (Washington, DC: Brookings Institution Press, 2005), p. 87.

Paul Hirst, ‘Future War’, Open Democracy [website], 17 October 2001, available at: http://www.opendemocracy.net/node/180/pdf (accessed 22 December 2008).