Program Evaluation in Practice: Core Concepts and Examples for Discussion and Analysis

226 Pages·2014·0.89 MB·English

by  Dean T. Spaulding

3GFFIRS 10/21/2013 13:54:14 Pageii
3GFFIRS 10/21/2013 13:54:14 Pagei
PROGRAM
EVALUATION
IN PRACTICE
3GFFIRS 10/21/2013 13:54:14 Pageii
3GFFIRS 10/21/2013 13:54:14 Pageiii
PROGRAM
EVALUATION
IN PRACTICE
Core Concepts and
Examples for
Discussion
and Analysis
Second Edition
DEAN T. SPAULDING
3GFFIRS 10/21/2013 13:54:14 Page iv
Cover design by © Arthur S. Aubry/Getty
Cover image: © khalus/Getty
Copyright © 2014 by John Wiley & Sons, Inc. All rights reserved.
Published by Jossey-Bass
A Wiley Brand
One Montgomery Street, Suite 1200, San Francisco, CA 94104-4594— www.josseybass.com
No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form
or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as
permitted under Section 107 or 108 of the 1976 United States Copyright Act, without either the prior
written permission of the publisher, or authorization through payment of the appropriate per-copy fee
to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, 978-750-8400,
fax [phone], or on the Web at www.copyright.com. Requests to the publisher for permission
should be addressed to the Permissio ns Department, John Wiley & Sons, Inc., 111 River Street,
Hoboken, NJ 07030, 201-748-6011, fax [phone], or online at www.wiley.com/go/permissions.
Limit of Liability/Disclaimer of Warranty: While the publisher and author have used their best efforts
in preparing this book, they make no representations or warranties with respect to the accuracy or
completeness of the contents of this book and speci fically disclaim any implied warranties of
merchantability or fitness for a particular purpose. No warranty may be created or extended by sales
representatives or written sales materials. The advice and strategies contained herein may not be
suitable for your situation. You should consult with a professional where appropriate. Neither the
publisher nor author shall be liable for any loss of pro fit or any other commercial damages, including
but not limited to special, incidental, consequential, or other damages. Readers should be aware that
Internet Web sites offered as citations and/or sources for further information may have changed or
disappeared between the time this was written and when it is read.
Jossey-Bass books and products are available through most bookstores. To contact Jossey-Bass
directly call our Customer Care Department within the U.S. at 800-956-7739, outside the U.S. at 317-
572-3986, or fax [phone].
Wiley publishes in a variety of print and electronic formats and by print-on-demand. Some material
includedwithstandardprintversionsofthisbookmaynotbeincludedine-booksorinprint-on-
demand.IfthisbookreferstomediasuchasaCDorDVDthatisnotincludedintheversionyou
purchased, you may download this material at http://booksupport.wiley.com. For more information
about Wiley products, visit www.wiley.com.
LibraryofCongressCataloging-in-PublicationData
Spaulding,DeanT.
Programevaluationinpractice:coreconceptsandexamplesfordiscussion
andanalysis/DeanT.Spaulding.–Secondedition
pagescm
Includesbibliographicalreferencesandindex.
ISBN978-1-118-34582-5(pbk.)–ISBN978-1-118-45021-5(pdf)–
ISBN978-1-118-45020-8(epub)
1. Educationalevaluation. 2. Schoolimprovementprograms–Evaluation.
I. Title.
LB2822.75.S692014
379.1ʹ58–dc23
2013027715
PrintedintheUnitedStatesofAmerica
SECONDEDITION
PBPRINTING 10 9 8 7 6 5 4 3 2 1
3GFTOC 10/21/2013 14:16:46 Pagev
CONTENTS
ListofTables,Figures,Exhibits,andBoxes xiii
Preface xvii
Acknowledgments xxi
TheAuthor xxiii
PART ONE: Introduction 1
CHAPTERONE:FOUNDATIONSOFPROGRAM
EVALUATION 3
WhatisProgramEvaluation? 5
InternalandExternalEvaluators 11
HowtoUseThisBook 13
TheEvaluationObjective 15
DesigningandDevelopinganEvaluationMatrix 19
DataCollection 20
TriangulationofData 31
WritingtheEvaluationReport 31
DisseminationandUseofEvaluationFindings 35
Summary 37
KeyConcepts 38
DiscussionQuestions 38
ClassActivities 39
SuggestedReading 39
v
3GFTOC 10/21/2013 14:16:47 Pagevi
vi
Contents
CHAPTERTWO:ETHICSINPROGRAM
EVALUATIONANDANOVERVIEWOF
EVALUATIONAPPROACHES 41
EthicsinProgramEvaluation 41
WhatisanEvaluationApproach? 43
Objectives-BasedApproach 44
Decision-BasedApproach 47
ParticipatoryApproach 50
Consumer-OrientedApproach 55
Expertise-OrientedApproach 55
EclecticApproach 56
Summary 56
KeyConcepts 57
DiscussionQuestions 57
ClassActivities 58
SuggestedReading 58
CHAPTERTHREE:IN-DEPTHLOOKATTHE
OBJECTIVES-BASEDAPPROACHTOEVALUATION 59
Objectives-BasedApproach 59
HowtoUseEvaluationObjectives 64
Summary 66
KeyConcepts 67
DiscussionQuestions 67
ClassActivities 67
SuggestedReading 67
PART TWO: CASE STUDIES 69
CHAPTERFOUR:IMPROVINGSTUDENT
PERFORMANCEINMATHEMATICSTHROUGH
INQUIRY-BASEDINSTRUCTION 71
3GFTOC 10/21/2013 14:16:47 Pagevii
vii
Contents
TheEvaluator 71
TheProgram 76
TheEvaluationPlan 78
SummaryofEvaluationActivitiesandFindings 81
FinalThoughts 86
KeyConcepts 86
DiscussionQuestions 87
ClassActivities 87
SuggestedReading 88
CHAPTERFIVE:EVALUATIONOFA
COMMUNITY-BASEDMENTORPROGRAM 89
TheEvaluator 89
TheProgram 91
TheEvaluationPlan 92
SummaryofEvaluationActivitiesandFindings 97
FinalThoughts 97
KeyConcepts 97
DiscussionQuestions 98
ClassActivities 98
SuggestedReading 99
CHAPTERSIX:TEACHERCANDIDATES
INTEGRATINGTECHNOLOGYINTOTHEIR
STUDENTTEACHINGEXPERIENCE 101
TheEvaluators 101
TheProgram 102
TheEvaluationPlan 102
SummaryofEvaluationActivitiesandFindings 108
FinalThoughts 108
KeyConcepts 108
DiscussionQuestions 108
3GFTOC 10/21/2013 14:16:47 Pageviii
viii
Contents
ClassActivities 109
SuggestedReading 110
CHAPTERSEVEN:EVALUATIONOFA
PROFESSIONALDEVELOPMENTTECHNOLOGY
PROJECTINALOW-PERFORMING
SCHOOLDISTRICT 111
TheEvaluator 111
TheProgram 112
TheEvaluationPlan 113
SummaryofEvaluationActivitiesandFindings 116
FinalThoughts 117
KeyConcepts 117
DiscussionQuestions 117
ClassActivities 118
SuggestedReading 119
CHAPTEREIGHT:EXPANSIONOFAHIGH
SCHOOLSCIENCEPROGRAM 121
TheEvaluators 121
TheProgram 122
TheEvaluationPlan 122
SummaryofEvaluationActivitiesandFindings 124
FinalThoughts 126
KeyConcepts 126
DiscussionQuestions 126
ClassActivities 127
SuggestedReading 127
CHAPTERNINE:EVALUATIONOFAPROVEN
PRACTICEFORREADINGACHIEVEMENT 129
TheEvaluators 129
TheProgram 130