Pro .NET Performance

359 Pages·2012·7.573 MB·English

by  Sasha Goldshtein, Dima Zurbalev, Ido Flatow (auth.)

Pro .NET Per formance
Sasha Goldshtein
Dima Zurbalev
Ido Flatow
Pro .NET Performance
Copyright © 2012 by Sasha Goldshtein, Dima Zurbalev, and Ido Flatow
ThThis work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is
concerned, specififically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on
microfifilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer
software, or by similar or dissimilar methodology now known or hereafter developed. Exempted from this legal reservation
are brief excerpts in connection with reviews or scholarly analysis or material supplied specififi cally for the purpose of being
entered and executed on a computer system, for exclusiveuse by the purchaser of the work. Duplication of this publication
or parts thereof is permitted only under the provisions of the Copyright Law of the Publisher’s location, in its current version,
and permission for use must always be obtained from Springer. Permissions for use may be obtained through RightsLink at the
Copyright Clearance Center. Violations are liable to prosecution under the respective Copyright Law.
ISBN 978-1-43 02-4458-5
ISBN 978-1-4302-445 9-2 (eBook)
Trademarked names, logos, and images may appear in this book. Rather than use a trademark symbol with every occurrence of
a trademarked name, logo, or image we use the names, logos, and images only in an editorial fashion and to the benefifit of the
trademark owner, with no intention of infringement of the trademark.
ThTh e use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identifified as such,
is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights.
While the advice and information in this book are believed to be true and accurate at the date of publication, neither the
authors nor the editors nor the publisher can accept any legal responsibility for any errors or omissions that may be made. ThThe
publisher makes no warranty, express or implied, with respect to the material contained herein.
President and Publisher: Paul Manning
Lead Editor: Gwenan Spearing
Developmental Editor: Gwenan Spearing
Technical Reviewers: Todd Meister and Fabio Claudio Ferracchiati
Editorial Board: Steve Anglin, Ewan Buckingham, Gary Cornell, Louise Corrigan, Morgan Ertel, Jonathan Gennick,
Jonathan Hassell, Robert Hutchinson, Michelle Lowman, James Markham, Matthew Moodie, Jeffff Olson, Jeffffff rey
Pepper, Douglas Pundick, Ben Renow-Clarke, Dominic Shakeshaft, Gwenan Spearing, Matt Wade, Tom Welsh
Coordinating Editors: Corbin Collins and Kevin Shea
Copy Editor: Lori Cavanaugh
Compositor: SPi Global
Indexer: SPi Global
Artist: SPi Global
Cover Designer: Anna Ishchenko
Distributed to the book trade worldwide by Springer Science+Business Media New York, 233 Spring Street, 6th Floor,
New York, NY 10013. Phone 1-800-SPRINGER, fax [phone], [e-mail], or visit
www.springeronline.com.
For information on translations, please [e-mail], or visit www.apress.com.
Apress and friends of ED books may be purchased in bulk for academic, corporate, or promotional use. eBook versions and
licenses are also available for most titles. For more information, reference our Special Bulk Sales–eBook Licensing web page at
www.apress.com/bulk-sales.
Any source code or other supplementary materials referenced by the author in this text is available to readers at
www.apress.com/9781430244585. For more information about how to locate your book’s source code, go to
www.apress.com/source-code.
To my loving wife Dina, who is the sunshine of my life.
To my parents Boris and Marina, for making all the sacrififi ces so I don’t have to.
—Sasha
To my lovely wife Efrat, for reminding me that a muse is not gone, it is just playing hide and seek.
—Ido
Contents at a Glance
Foreword ......................................................................................................................xv
About the Authors .......................................................................................................xvii
About the Technical Reviewers ...................................................................................xix
Acknowledgments .......................................................................................................xxi
Introduction ...............................................................................................................xxiii
■ Chapter 1: Performance Metrics .................................................................................1
■ Chapter 2: Performance Measurement ........................................................................7
■ Chapter 3: Type Internals ..........................................................................................61
■ Chapter 4: Garbage Collection ...................................................................................91
■ Chapter 5: Collections and Generics ........................................................................145
■ Chapter 6: Concurrency and Parallelism .................................................................173
■ Chapter 7: Networking, I/O, and Serialization .........................................................215
■ Chapter 8: Unsafe Code and Interoperability ...........................................................235
■ Chapter 9: Algorithm Optimization ..........................................................................259
■ Chapter 10: Performance Patterns ..........................................................................277
■ Chapter 11: Web Application Performance ..............................................................305
Index ...........................................................................................................................335
v
C ontents
Foreword ......................................................................................................................xv
About the Authors .......................................................................................................xvii
About the Technical Reviewers ...................................................................................xix
Acknowledgments .......................................................................................................xxi
Introduction ...............................................................................................................xxiii
■ Chapter 1: Performance Metrics .................................................................................1
Performance Goals ..................................................................................................................2
Performance Metrics ...............................................................................................................4
Summary .................................................................................................................................6
■ Chapter 2: Performance Measurement ........................................................................7
Approaches to Performance Measurement .............................................................................7
Built-in Windows Tools ............................................................................................................7
Performance Counters ....................................................................................................................................8
Event Tracing for Windows (ETW) .................................................................................................................13
Time Profi lers ........................................................................................................................26
Visual Studio Sampling Profi ler ....................................................................................................................26
Visual Studio Instrumentation Profi ler ..........................................................................................................31
Advanced Uses of Time Profi lers ..................................................................................................................33
Allocation Profi lers ................................................................................................................35
Visual Studio Allocation Profi ler ....................................................................................................................35
CLR Profi ler ...................................................................................................................................................39
Memory Profi lers ...................................................................................................................44
ANTS Memory Profi ler ..................................................................................................................................44
vii
■ CONTENTS
SciTech .NET Memory Profi ler ......................................................................................................................47
Other Profi lers .......................................................................................................................49
Database and Data Access Profi lers .............................................................................................................49
Concurrency Profi lers ...................................................................................................................................50
I/O Profi lers ...................................................................................................................................................52
Microbenchmarking ..............................................................................................................53
Poor Microbenchmark Example ....................................................................................................................54
Microbenchmarking Guidelines ....................................................................................................................56
Summary ...............................................................................................................................58
■ Chapter 3: Type Internals ..........................................................................................61
An Example ...........................................................................................................................61
Semantic Differences between Reference Types and Value Types .......................................62
Storage, Allocation, and Deallocation ....................................................................................63
Reference Type Internals .......................................................................................................65
The Method Table .........................................................................................................................................66
Invoking Methods on Reference Type Instances...........................................................................................70
Sync Blocks And Thelock Keyword ............................................................................................................75
Value Type Internals ..............................................................................................................79
Value Type Limitations ..................................................................................................................................80
Virtual Methods on Value Types ....................................................................................................................82
Boxing ...........................................................................................................................................................82
Avoiding Boxing on Value Types with the Equals Method ...........................................................................84
The GetHashCodeMethod ...........................................................................................................................87
Best Practices for Using Value Types ....................................................................................89
Summary ...............................................................................................................................89
■ Chapter 4: Garbage Collection ...................................................................................91
Why Garbage Collection? ......................................................................................................91
Free List Management ..................................................................................................................................92
Reference-Counting Garbage Collection .......................................................................................................93
Tracing Garbage Collection....................................................................................................94
viii
■CONTENTS
Mark Phase ...................................................................................................................................................95
Sweep and Compact Phases ........................................................................................................................99
Pinning ........................................................................................................................................................102
Garbage Collection Flavors ..................................................................................................103
Pausing Threads for Garbage Collection .....................................................................................................103
Workstation GC ...........................................................................................................................................106
Server GC ....................................................................................................................................................107
Switching Between GC Flavors ...................................................................................................................108
Generations .........................................................................................................................110
Generational Model Assumptions ...............................................................................................................110
.NET Implementation of Generations ..........................................................................................................111
Large Object Heap ......................................................................................................................................115
References between Generations ...............................................................................................................116
Background GC ...........................................................................................................................................119
GC Segments and Virtual Memory .......................................................................................119
Finalization ..........................................................................................................................123
Manual Deterministic Finalization ..............................................................................................................123
Automatic Non-Deterministic Finalization ..................................................................................................123
Pitfalls of Non-Deterministic Finalization ...................................................................................................125
The Dispose Pattern ...................................................................................................................................128
Weak References ................................................................................................................130
Interacting with the Garbage Collector ................................................................................132
The System.GC Class ..................................................................................................................................132
Interacting with the GC using CLR Hosting .................................................................................................135
GC Triggers .................................................................................................................................................136
Garbage Collection Performance Best Practices .................................................................137
Generational Model .....................................................................................................................................137
Pinning ........................................................................................................................................................138
Finalization .................................................................................................................................................139
Miscellaneous Tips and Best Practices ......................................................................................................139
Summary .............................................................................................................................143
ix
■ CONTENTS
■ Chapter 5: Collections and Generics ........................................................................145
Generics ..............................................................................................................................145
.NET Generics .............................................................................................................................................148
Generic Constraints ....................................................................................................................................149
Implementation of CLR Generics ................................................................................................................151
Collections ...........................................................................................................................158
Concurrent Collections ...............................................................................................................................160
Cache Considerations .................................................................................................................................162
Custom Collections ..............................................................................................................166
Disjoint-Set (Union-Find) ............................................................................................................................166
Skip List ......................................................................................................................................................168
One-Shot Collections ..................................................................................................................................169
Summary .............................................................................................................................171
■ Chapter 6: Concurrency and Parallelism .................................................................173
Challenges and Gains ..........................................................................................................173
Why Concurrency and Parallelism? ............................................................................................................174
From Threads to Thread Pool to Tasks ................................................................................174
Task Parallelism ..........................................................................................................................................180
Data Parallelism .........................................................................................................................................186
C# 5 Async Methods ...................................................................................................................................190
Advanced Patterns in the TPL .....................................................................................................................193
Synchronization ...................................................................................................................194
Lock-Free Code ..........................................................................................................................................195
Windows Synchronization Mechanisms .....................................................................................................200
Cache Considerations .................................................................................................................................202
General Purpose GPU Computing ........................................................................................205
Introduction to C++ AMP ............................................................................................................................205
Matrix Multiplication ...................................................................................................................................207
N-Body Simulation ......................................................................................................................................208
Tiles and Shared Memory ...........................................................................................................................209
Summary .............................................................................................................................213
x
■CONTENTS
■ Chapter 7: Networking, I/O, and Serialization .........................................................215
General I/O Concepts ...........................................................................................................215
Synchronous and Asynchronous I/O ...........................................................................................................215
I/O Completion Ports ...................................................................................................................................217
NET Thread Pool .........................................................................................................................................220
Copying Memory .........................................................................................................................................221
Scatter–Gather I/O ...............................................................................................................221
File I/O .................................................................................................................................222
Cache Hinting .............................................................................................................................................222
Unbuffered I/O ............................................................................................................................................223
Networking ..........................................................................................................................223
Network Protocols ......................................................................................................................................223
Network Sockets ........................................................................................................................................225
Data Serialization and Deserialization .................................................................................226
Serializer Benchmarks ...............................................................................................................................226
DataSet Serialization ..................................................................................................................................229
Windows Communication Foundation .................................................................................229
Throttling ....................................................................................................................................................229
Process Model ............................................................................................................................................230
Caching .......................................................................................................................................................231
Asynchronous WCF Clients and Servers .....................................................................................................231
Bindings ......................................................................................................................................................233
Summary .............................................................................................................................234
■ Chapter 8: Unsafe Code and Interoperability ...........................................................235
Unsafe Code ........................................................................................................................235
Pinning and GC Handles .............................................................................................................................236
Lifetime Management .................................................................................................................................237
Allocating Unmanaged Memory .................................................................................................................237
Memory Pooling ..........................................................................................................................................238
xi
■ CONTENTS
P/Invoke ..............................................................................................................................239
PInvoke.net and P/Invoke Interop Assistant ................................................................................................240
Binding .......................................................................................................................................................241
Marshaler Stubs .........................................................................................................................................242
Blittable Types ............................................................................................................................................245
Marshaling Direction, Value and Reference Types ......................................................................................247
Code Access Security .................................................................................................................................248
COM Interoperability ............................................................................................................248
Lifetime Management .................................................................................................................................249
Apartment Marshaling ................................................................................................................................249
TLB Import and Code Access Security ........................................................................................................251
NoPIA ..........................................................................................................................................................251
Exceptions ..................................................................................................................................................252
C++/CLI Language Extensions ............................................................................................253
The marshal_as Helper Library ................................................................................................................255
IL Code vs. Native Code ..............................................................................................................................256
Windows 8 WinRT Interop ...................................................................................................256
Best Practices for Interop ....................................................................................................257
Summary .............................................................................................................................258
■ Chapter 9: Algorithm Optimization ..........................................................................259
Taxonomy of Complexity .....................................................................................................259
Big-Oh Notation ..........................................................................................................................................259
Turing Machines and Complexity Classes ..................................................................................................261
Memoization and Dynamic Programming ...........................................................................265
Edit Distance ...............................................................................................................................................266
All-Pairs-Shortest-Paths .............................................................................................................................267
Approximation .....................................................................................................................269
Traveling Salesman ....................................................................................................................................270
Maximum Cut .............................................................................................................................................271
xii