Parallel Metaheuristics: A New Class of Algorithms

561 Pages·2005·28.286 MB·English

PARALLEL
METAHEURISTICS
WILEY SERIES ON PARALLEL AND DISTRIBUTED COMPUTING
Series Editor: Albert Y. Zomaya
Parallel and Distributed Simulation Systems / Richard Fujimoto
Mobile Processing in Distributed and Open Environments / Peter Sapaty
Introduction to Parallel Algorithms / C. Xavier and S. S. lyengar
Solutions to Parallel and Distributed Computing Problems: Lessons from
Biological Sciences /Albert Y. Zomaya, Fikret Ercal, and Stephan Olariu (Editors)
Parallel and Distributed Computing: A Survey of Models, Paradigms, and
Approaches / Claudia Leopold
Fundamentals of Distributed Object Systems: A CORBA Perspective /
Zahir Tari and Omran Bukhres
Pipelined Processor Farms: Structured Design for Embedded Parallel
Systems I Martin Fleury and Andrew Downton
Handbook of Wireless Networks and Mobile Computing /
Ivan Stojmenovic (Editor)
Internet-BasedW orkflow Management: Toward a Semantic Web /
Dan C. Marinescu
Parallel Computing on Heterogeneous Networks / Alexey L. Lastovetsky
Performance Evaluation and Characteization of Parallel and Distributed
Computing Tools / Salim Hariri and Manish Parashar
Distributed Computing: Fundamentals, Simulations and Advanced Topics,
Second Edition / Hagit Attiya and Jennifer Welch
Smart Environments: Technology, Protocols, and Applications / Diane Cook
and Sajal Das
Fundamentals of Computer Organization and Architecture /
Mostafa Abd-El-Barr and Hesham El-Rewini
Advanced Computer Architecture and Parallel Processing / Hesham El-Rewini
and Mostafa Abd-El-Barr
UPC: Distributed Shared Memory Programming / Tarek El-Ghazawi,
William Carlson, Thomas Sterling, and Katherine Yelick
Handbook of Sensor Networks: Algorithms and Architectures /
Ivan Stojmenovic (Editor)
Parallel Metaheuristics: A New Class of Algorithms / Enrique Alba (Editor)
PARALLEL
METAHEURISTICS
A New Class of Algorithms
Edited by
Enrique Alba
@ZEiCIENCE
A JOHN WILEY & SONS, INC., PUBLICATION
Copyright Q 2005 by John Wiley & Sons, Inc. All rights reserved.
Published by John Wiley & Sons, Inc., Hoboken, New Jersey.
Published simultaneously in Canada.
No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form
or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as
permitted under Section 107 or 108 of the 1976 United States Copyright Act. without either the prior
written permission of the Publisher. or authorization through payment of the appropriate per-copy fee to
the Copyright Clearance Center. Inc., 222 Rosewood Drive, Danvers. MA 01923, [phone], fax
[phone]. or on the web at www.copyright.com. Requests to the Publisher for permission should
be addressed to the Permissions Department, John Wiley & Sons, Inc., 1 River Street, Hoboken. NJ
I1
07030, (201 ) 748-601 I, fax (201 ) 748-6008, or online at http://www.wiley.coni/go/permission.
Limit of LiabilityiDisclaimer of Warranty: While the publisher and author have used their best efforts in
preparing this book, they make no representations or warranties with respect to the accuracy or
completeness of the contents of this book and specifically disclaim any implied warranties of
merchantability or fitness for a particular purpose. No warranty may be created or extended by sales
representatives or written sales materials. The advice and strategies contained herein may not be
suitable for your situation. You should consult with a professional where appropriate. Neither the
publisher nor author shall be liable for any loss of profit or any other commercial damages, including
but not limited to special, incidental, consequential, or other damages.
For general information on our other products and services or for technical support, please contact our
Customer Care Department within the United States at [phone], outside the United States at
(3 17) 572-3993 or fax [phone].
Wiley also publishes its books in a variety of electronic formats. Some content that appears in print may
not be available in electronic format. For information about Wiley products. visit our web site at
www.wiley.com.
Libray of Congress Cataloging-in-Publication Data:
Parallel metaheuristics : a new class of algorithms /edited by Enrique Alba.
p. cm.
ISBN-I 3 978-0-471 -67806-9
ISBN- I0 0-47 1-67806-6 (cloth)
1. Mathematical optimization. 2. Parallel algorithms. 3. Operations
research. I. Alba, Enrique.
T57.P37 2005
5 19.6-4c22 2005001251
Printed in the United States of America
1 0 9 8 7 6 5 4 3 2 1
Contents
Foreword xi
...
Preface Xlll
Contributors xv
Part I INTROD JCTION TO n ETA t E JR STlCS AND PARALLELISR 1
1 An Introduction to Metaheuristic Techniques 3
Christiun Blum. Andrea Roli, Enrique Alba
1.1 Introduction 3
1.2 Trajectory Methods 8
1.3 Population-Eased Methods 19
1.4 Decentralized Metaheuristics 28
1.5 Hybridization of Metaheuristics 29
1.6 Conclusions 31
References 31
2 Measuring the Performance of Parallel Metaheuristics 43
Enrique Alba, Gabriel Luque
2.1 Introduction 43
2.2 Parallel Performance Measures 44
2.3 How to Report Results 48
2.4 Illustrating the Influence of Measures 54
2.5 Conclusions 60
References 60
3 New Technologies in Parallelism 63
Enriyue Albo. Antonio J. Nehro
3.1 Introduction 63
3.2 Parallel Computer Architectures: An Overview 63
3.3 Shared-Memory and Distributed-Memory Programming 65
V
CONTENTS
Vi
3.4 Shared-Memory Tools 68
3.5 Distributed-Memory Tools 70
3.6 Which of Them'? 74
3.7 Summary 75
References 76
4 Metaheuristics and Parallelism 79
Enrique Alba. El-Ghazali Talbi, Gabriel Luque. Nouredine Melab
4.1 Introduction 79
4.2 Parallel LSMs 80
4.3 Case Studies of Parallel LSMs 81
4.4 Parallel Evolutionary Algorithms 85
4.5 Case Studies of Parallel EAs 87
4.6 Other Models 93
4.7 Conclusions 95
References 96
Part II PARALLEL METAHEURISTIC MODELS 105
5 Parallel Genetic Algorithms 107
Gabriel Luque, Enrique Aha. Bemabe Dorronsoro
5.1 introduction 107
5.2 Panmictic Genetic Algorithms 108
5.3 Structured Genetic Algorithms 110
5.4 Parallel Genetic Algorithms 112
5.5 Experimental Results 1 I8
5.6 Summary 121
References 122
6 Parallel Genetic Programming 127
E Ferndndez. G. Spezzano, M. Tomassini. L. Vanneschi
6.1 Introduction to GP 127
6.2 Models of Parallel and Distributed GP 130
6.3 Problems 134
6.4 Real-Life Applications 137
6.5 Placement and Routing in FPGA 139
6.6 Data Classification Using Cellular Genetic Programming 144
6.7 Concluding Discussion 150
References 150
CONTENTS vii
7 Parallel Evolution Strategies 155
Gunter Rudolph
7.1 Introduction 155
7.2 Deployment Scenarios of Parallel Evolutionary Algorithms 156
7.3 Sequential Evolutionary Algorithms 159
7.4 Parallel Evolutionary Algorithms 159
7.5 Conclusions 165
References 165
8 Parallel Ant Colony Algorithms 171
Stefan Janson. Daniel Merkle, Martin Middendorf
8.1 Introduction 171
8.2 Ant Colony Optimization 172
8.3 Parallel ACO 175
8.4 Hardware Parallelization of ACO 190
8.5 Other Ant Colony Approaches 195
References 197
9 Parallel Estimation of Distribution Algorithms 203
Julio Madera. Enrique Alba, Alberto Ochoa
9.1 Introduction 203
9.2 Levels of Parallelism in EDA 204
9.3 Parallel Models for EDAs 206
9.4 A Classification of Parallel EDAs 216
9.5 Conclusions 219
References 220
10 Parallel Scatter Search 223
F. Garcia, M. Garcia. B. Melian, J. A. Moreno-Pkrez. J. M. Moreno-Vega
10.1 Introduction 223
10.2 Scatter Search 224
10.3 Parallel Scatter Search 225
10.4 Application of Scatter Search to the p-Median Problem 229
10.5 Application of Scatter Search to Feature Subset Selection 232
10.6 Computational Experiments 239
10.7 Conclusions 243
References 244
viii CONTENTS
11 Parallel Variable Neighborhood Search 247
Josi A. Moreno-Perez. Pierre Hansen, Nenad MladenoviL:
1 1.1 Introduction 247
1 1.2 The VNS Metaheuristic 24 8
11.3 The Parallelizations 25 1
1 1.4 Application of VNS for the p-median 258
1 1.5 Computational Experiments 262
1 1.6 Conclusions 263
References 264
12 Parallel Simulated Annealing 261
M. Emin Aydin, Vecihi Yi@t
12.1 Introduction 267
12.2 Simulated Annealing 268
12.3 Parallel Simulated Annealing 269
12.4 A Case Study 275
12.5 Summary 283
References 284
13 Parallel Tabu Search 289
Teodor Gabriel Cruinic. Michel Gendreuu. Jean- Yves Potvin
13.1 Introduction 289
13.2 Tabu Search 290
13.3 Parallelization Strategies for Tabu Search 29 1
13.4 Literature Review 294
13.5 Two Parallel Tabu Search Heuristics for Real-Time Fleet Manage-
ment 302
13.6 Perspectives and Research Directions 305
References 306
14 Parallel Greedy Randomized Adaptive Search Procedures 315
Mauricio G. C. Resende, Celso C. Riheiro
14.1 Introduction 315
14.2 Multiple-Walk Independent-Thread Strategies 317
14.3 Multiple-Walk Cooperative-Thread Strategies 323
14.4 Some Parallel GRASP Implementations 327
14.5 Conclusion 340
References 34 1
CONTENTS ix
15 Parallel Hybrid Metaheuristics 347
Carlos Cotta, El-Ghazali Talbi. Enrique Alba
15.1 Introduction 347
15.2 Historical Notes on Hybrid Metaheuristics 348
15.3 Classifying Hybrid Metaheuristics 350
15.4 Implementing Parallel Hybrid Metaheuristics 355
15.5 Applications of Parallel Hybrid Metaheuristics 358
15.6 Conclusions 359
References 359
16 Parallel Multiobjective Optimization 371
Antonio J. Nebro, Francisco Luna, El-Ghazali Talbi. Enrique Alba
16.1 Introduction 37 1
16.2 Parallel Metaheuristics for Multiobjective Optimization 372
16.3 Two Parallel Multiobjective Metaheuristics 377
16.4 Experimentation 379
16.5 Conclusions and Future Work 386
References 387
17 Parallel Heterogeneous Metaheuristics 395
Francisco Luna. Enrique Alba, Antonio J. Nebro
17.1 Introduction 395
17.2 Heterogeneous Metaheuristics Survey 397
17.3 Taxonomy of Parallel Heterogeneous Metaheuristics 400
17.4 Frameworks for Heterogeneous Metaheuristics 404
17.5 Concluding Remarks 406
17.6 Annotated Bibliography 407
References 412
Part 111 THEORY AND APPLICATIONS 423
18 Theory of Parallel Genetic Algorithms 425
Erick Cantu-Paz
18.1 Introduction 425
18.2 Master-Slave Parallel GAS 42 8
18.3 Multipopulation Parallel GAS 430
18.4 Cellular Parallel GAS 43 7
18.5 Conclusions 438
References 439
X CONTENTS
19 Parallel Metaheuristics Applications 441
Teodor Gabriel Crainic. Nourredine Hail
19.1 Introduction 447
19.2 Parallel Metaheuristics 44 8
19.3 Graph Coloring 45 1
19.4 Graph Partitioning 452
19.5 Steiner Tree Problem 456
19.6 Set Partitioning and Covering 457
19.7 Satisfiability Problems 459
19.8 Quadratic Assignment 462
19.9 Location Problems 464
19.10 Network Design 468
19.1 1 The Traveling Salesman Problem 47 1
19.12 Vehicle Routing Problems 476
19.13 Summary 479
References 480
20 Parallel Metaheuristics in Telecommunications 495
Sergio Nesmachnou: Hdctor Cancela. Enriqzre Alba, Francisco Chicano
20.1 Introduction 495
20.2 Network Design 496
20.3 Network Routing 502
20.4 Network Assignment and Dimensioning 504
20.5 Conclusions 510
References 510
21 Bioinformatics and Parallel Metaheuristics 51 7
Osuraldo Trek.A ndrPs Rodriguez
2 1.1 Introduction 517
21.2 Bioinformatics at a Glance 519
2 1.3 Parallel Computers 522
21.4 Bioinformatic Applications 526
2 1.5 Parallel Metaheuristics in Bioinformatics 534
21.6 Conclusions 543
References 543
Index 55 1