Measuring and Maximizing Training Impact: Bridging the Gap between Training and Business Results

218 Pages·2014·4.312 MB·English

by  Paul Leone (auth.)

Measuring and Maximizing Training Impact
This page intentionally left blank
Measuring and Maximizing
Training Impact
Bridging the Gap between
Training and Business Results
Paul Leone
measuring and maximizing training impact
Copyright © Paul Leone, 2014.
Softcover reprint of the hardcover 1st edition 2014 978-1-137-41479-3
All rights reserved.
First published in 2014 by
PALGRAVE MACMILLAN®
in the United States— a division of St. Martin’s Press LLC,
175 Fifth Avenue, New York, NY 10010.
Where this book is distributed in the UK, Europe and the rest of the world,
this is by Palgrave Macmillan, a division of Macmillan Publishers Limited,
registered in England, company number 785998, of Houndmills,
Basingstoke, Hampshire RG21 6XS.
Palgrave Macmillan is the global academic imprint of the above companies
and has companies and representatives throughout the world.
Palgrave® and Macmillan® are registered trademarks in the United States,
the United Kingdom, Europe and other countries.
ISBN 978-1-349-49038-7 ISBN 978-1-137-41048-1 (eBook)
DOI 10.1057/9781137410481
Library of Congress Cataloging-in-Publication Data
Leone, Paul.
Measuring and maximizing training impact : bridging the gap between
training and business results / Paul Leone.
pages cm
ISBN 978-1-349-49038-7
1. Employees—Training of. 2. Organizational effectiveness. I. Title.
HF5549.5.T7L466 2014
658.3124—dc23 2014006310
A catalogue record of the book is available from the British Library.
Design by Newgen Knowledge Works (P) Ltd., Chennai, India.
First edition: September 2014
10 9 8 7 6 5 4 3 2 1
Contents
List of Illustrations vii
Preface xi
Introduction Bridging the Gap between Training and
Business Results 1
Chapter 1 Did They Like It? 17
Chapter 2 Did They Learn Anything? 27
Chapter 3 Are They Doing Anything Different? 37
Chapter 4 Did It Impact the Business? 73
Chapter 5 Was It Worth It? 103
Chapter 6 How Do We Maximize Impact? 117
Summary 151
Conclusion 161
Case Study 1 Measuring the Impact of Leadership
Training 165
Case Study 2 Maximizing the Impact of Leadership
Training through Different Delivery Modes 185
Index 199
This page intentionally left blank
Illustrations
Figures
0.1 “The Bridge” 4
1.1 Quantitative results for Level 1 24
1.2 How to show qualitative results for Level 1 24
1.3 Sample of Level 1 qualitative report 25
2.1 Quantitative results for Level 2 33
2.2 Qualitative results for Level 2 33
2.3 Overall snapshot report for Levels 1 and 2 35
3.1 The ROI of building your bridge (the business case) 49
3.2 Domain of Level 3 behaviors 53
3.3 Picking the right leadership behaviors for a Level 3 54
3.4 Cutting the crap 56
3.5 Response distribution for a Level 3 question 65
3.6 Aggregate slide for all Level 3 behaviors 68
3.7 Level 3 qualitative results from direct reports after
a leadership training program 71
4.1 Level 4 analysis showing productivity differences
between those who improved their behaviors
(High Improvement) and those who did not
(No Improvement) 87
4.2 Calculating the effect 89
viii l Illustrations
4.3 Defining the “effected” population 92
4.4 Calculating your effect size 92
4.5 Level 4 showing differences in direct report
productivity caused by improving leadership 98
4.6 Level 4 analysis for a leadership program 99
4.7 Example of Level 4 qualitative analysis 100
5.1 The ROI formula 104
5.2 Calculating your “benefit” 108
5.3 Calculating your “cost” 109
5.4 Calculating your cost 110
5.5 Return on investment 112
6.1 Three “make or break” climate factors 139
6.2 How do your top three factors discriminate
between levels of impact? 141
6.3 Better climate = greater ROI 142
6.4 Target Impact Plan 147
6.5 Impact of TIP 148
S.1 The bridge 152
S.2 The measurement process 158
S.3 Final takeaways 159
CS1.1 The good leader profit chain 167
CS1.2 Level 1 results 172
CS1.3 Level 2 results 172
CS1.4 Level 3 results 174
CS1.5 Qualitative results for Level 3 175
CS1.6 Level 4 productivity differences 176
CS1.7 Calculating an overall effect size 179
CS1.8 Calculating the ROI for leadership training 180
CS1.9 Level 6—critical climate factors 182
CS2.1 Comparison of Level 1 and 2 scores 189
Illustrations l ix
CS2.2 Comparison of Level 3 improvement 190
CS2.3 Calculating a Level 4 “effect size” for online training 191
CS2.4 Overall effect sizes compared across delivery modes 192
Tables
0.1 The traditional five levels of evaluation 14
0.2 Six levels of evaluation 15
1.1 Example of a Level 1 survey 23
2.1 Sample Level 2 survey 32
2.2 L evels 1 and 2 measuring levels of satisfaction
and learning from training 34
3.1 Level 3 questions with improvement scale 64
6.1 Twelve factors for your climate assessment 124
6.2 The Transfer Climate Assessment 135
S.1 Measurement process, Levels 1 and 2 153
S.2 Measurement process, Levels 3–6 154
CS1.1 Six Levels of evaluation 168
CS2.1 Level 1–6 evaluation approach 187
CS2.2 Training benefits across delivery modes 193
CS2.3 Benefits, costs, and final ROI results for each
delivery mode 195