Risks of artificial intelligence

302 Pages·2016·2.95 MB·English

by  Muller

RISKS OF
A
rtificiAl
i
ntelligence

RISKS OF
A
rtificiAl
i
ntelligence
e
dited by
V c. M
incent üller
University of Oxford, UK
and
American College of Thessaloniki/Anatolia College, Greece
CRC Press
Taylor & Francis Group
6000 Broken Sound Parkway NW, Suite 300
Boca Raton, FL 33487-2742
© 2016 by Taylor & Francis Group, LLC
CRC Press is an imprint of Taylor & Francis Group, an Informa business
No claim to original U.S. Government works
Version Date: 20151012
International Standard Book Number-13: 978-1-4987-3483-7 (eBook - PDF)
This book contains information obtained from authentic and highly regarded sources. Reasonable
efforts have been made to publish reliable data and information, but the author and publisher cannot
assume responsibility for the validity of all materials or the consequences of their use. The authors and
publishers have attempted to trace the copyright holders of all material reproduced in this publication
and apologize to copyright holders if permission to publish in this form has not been obtained. If any
copyright material has not been acknowledged please write and let us know so we may rectify in any
future reprint.
Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced,
transmitted, or utilized in any form by any electronic, mechanical, or other means, now known or
hereafter invented, including photocopying, microfilming, and recording, or in any information stor-
age or retrieval system, without written permission from the publishers.
For permission to photocopy or use material electronically from this work, please access www.copy-
right.com (http://www.copyright.com/) or contact the Copyright Clearance Center, Inc. (CCC), 222
Rosewood Drive, Danvers, MA 01923, 978-750-8400. CCC is a not-for-profit organization that pro-
vides licenses and registration for a variety of users. For organizations that have been granted a photo-
copy license by the CCC, a separate system of payment has been arranged.
Trademark Notice: Product or corporate names may be trademarks or registered trademarks, and are
used only for identification and explanation without intent to infringe.
Visit the Taylor & Francis Web site at
http://www.taylorandfrancis.com
and the CRC Press Web site at
http://www.crcpress.com
Contents
Editor, vii
Contributors, ix
Chapter 1 ◾ E ditorial: Risks of Artificial Intelligence 1
VinCent C. Müller
Chapter 2 ◾ A utonomous Technology and the Greater
Human Good 9
SteVe OMOhundrO
Chapter 3 ◾ E rrors, Insights, and Lessons of Famous
Artificial Intelligence Predictions: And What
They Mean for the Future 29
Stuart arMStrOng, Kaj SOtala, and Seán S. ÓhÉigeartaigh
Chapter 4 ◾ P ath to More General Artificial Intelligence 69
ted gOertzel
Chapter 5 ◾ L imitations and Risks of Machine Ethics 87
MileS Brundage
Chapter 6 ◾ U tility Function Security in Artificially
Intelligent Agents 115
rOMan V. YaMpOlSKiY
v
vi ◾ Contents
Chapter 7 ◾ G oal-Oriented Learning Meta-Architecture:
Toward an Artificial General Intelligence
Meta-Architecture Enabling Both Goal
Preservation and Radical Self-Improvement 141
Ben gOertzel
Chapter 8 ◾ U niversal Empathy and Ethical Bias for
Artificial General Intelligence 161
alexeY pOtapOV and SergeY rOdiOnOV
Chapter 9 ◾ B ounding the Impact of Artificial General
Intelligence 179
andráS KOrnai
Chapter 10 ◾ E thics of Brain Emulations 213
anderS SandBerg
Chapter 11 ◾ L ong-Term Strategies for Ending Existential
Risk from Fast Takeoff 243
daniel deweY
Chapter 12 ◾ S ingularity, or How I Learned to Stop
Worrying and Love Artificial Intelligence 267
j. MarK BiShOp
INDEX, 281
Editor
Vincent C. Müller’s research focuses on the nature and future of com-
putational systems, particularly on the prospects and dangers of artifi-
cial intelligence. He is the president of the European Association for
Cognitive Systems and was the coordinator of the European Network
for Cognitive Systems, Robotics and Interaction, which has nearly 1000
members and is funded by the European Commission through two FP7
projects worth €3.9 million over 2009–2014 (www.eucognition.org). He
organizes a conference series, Theory and Philosophy of AI (www.pt-ai.
org) and is the principal investigator of a European Commission–funded
research project Digital DIY. He is currently working as professor of phi-
losophy, Division of Humanities & Social Sciences, Anatolia College/ACT,
P ylaia-Thessaloniki, Greece.
Müller has published a number of articles in leading journals on the
philosophy of computing, the philosophy of artificial intelligence and cog-
nitive science, and the philosophy of language, applied ethics, and related
areas. He has edited 10 volumes, mostly on the theory of cognitive systems
and artificial intelligence, and is preparing a monograph on the funda-
mental problems of artificial intelligence. Müller studied philosophy with
cognitive science, linguistics, and history at the universities of Marburg,
Hamburg, London, and Oxford. He was Stanley J. Seeger Visiting Fellow at
Princeton University and James Martin Research Fellow at the University
of Oxford.
ORCID: 0000-0002-4144-4957
vii

Contributors
Stuart Armstrong Ben Goertzel
The Future of Humanity Institute Novamente LLC
University of Oxford Rockville, Maryland
Oxford, UK
Ted Goertzel
Rutgers University
J. Mark Bishop
Camden, New Jersey
Cognitive Computing at
Goldsmiths
András Kornai
and
Computer and Automation
The Goldsmiths Centre for
Research Institute
Intelligent Data Analytics
Hungarian Academy of Sciences
(TCIDA)
Budapest, Hungary
University of London
London, UK and
Department of Computer Science
Miles Brundage
Boston University
Consortium for Science, Policy,
Boston, Massachusetts
and Outcomes
Arizona State University
Seán S. ÓhÉigeartaigh
Tempe, Arizona
The Future of Humanity Institute
University of Oxford
Daniel Dewey Oxford, UK
The Future of Humanity Institute
Oxford Martin School Steve Omohundro
University of Oxford Self-Aware Systems
Oxford, UK Palo Alto, California
ix
x ◾ Contributors
Alexey Potapov Sergey Rodionov
AIDEUS AIDEUS
St. Petersburg, Russia St. Petersburg, Russia
and
and
National Research University
of Information Technology, Aix Marseille Université, CNRS
Mechanics and Optics LAM (Laboratoire d’Astrophysique
St. Petersburg, Russia de Marseille)
Marseille, France