ISE How to Design and Evaluate Research in Education

641 Pages·2022·33.907 MB·English

by  Jack R. Fraenkel, Norman E. Wallen, Helen Hyun

How to Design
and Evaluate
Research in Education
E L E V E N T H E D I T I O N
Jack R. Fraenkel
San Francisco State University
Norman E. Wallen
San Francisco State University
Helen H. Hyun
San Francisco State University
fra37742_fm_i-xxxiv.indd 1 04/10/21 11:49 AM
HOW TO DESIGN AND EVALUATE RESEARCH IN EDUCATION
Published by McGraw Hill LLC, 1325 Avenue of the Americas, New York, NY 10019. Copyright ©2023 by
McGraw Hill LLC. All rights reserved. Printed in the United States of America. No part of this publication may
be reproduced or distributed in any form or by any means, or stored in a database or retrieval system, without
the prior written consent of McGraw Hill LLC, including, but not limited to, in any network or other electronic
storage or transmission, or broadcast for distance learning.
Some ancillaries, including electronic and print components, may not be available to customers outside the
United States.
This book is printed on acid-free paper.
1 2 3 4 5 6 7 8 9 LWI 27 26 25 24 23 22
ISBN 978-1-265-18481-0
MHID 1-265-18481-X
Cover Image: (Multi-ethnic teacher and children in science lab): Kali9/E+/Getty Images
All credits appearing on page or at the end of the book are considered to be an extension
of the copyright page.
The Internet addresses listed in the text were accurate at the time of publication. The inclusion of a website does
not indicate an endorsement by the authors or McGraw Hill LLC, and McGraw Hill LLC does not guarantee the
accuracy of the information presented at these sites.
mheducation.com/highered
fra8481X_ise_ii.indd 2 05/10/21 5:23 AM
ABOUT THE AUTHORS
Jack R. Fraenkel was Professor Emeritus of Interdisciplinary
Studies in Education, and Director of the Research and Develop-
ment Center, College of Education, San Francisco State Univer-
sity. He received his PhD from Stanford University and taught
courses in research methodology for more than 30 years. In 1997,
he received the James A. Michener prize in writing for his writings
about the social studies and the social sciences. His recent work
centered on advising and assisting faculty and students in generat-
ing and developing research projects.
Courtesy of Norman E. Wallen
Norman E. Wallen is Professor Emeritus of Interdisciplinary
S tudies in Education at San Francisco State University. An expe-
rienced researcher, he received his PhD from Syracuse University
and taught courses in statistics and research design to master’s and
doctoral students for many years. He is a former member of the
City Council of Flagstaff, Arizona, and the Executive Committee,
Grand Canyon Chapter of the Sierra Club.
Courtesy of Norman E. Wallen
Helen H. Hyun is Professor of Interdisciplinary Studies in Educa-
tion at San Francisco State University. She received her doctor-
ate in education policy from Harvard University and has taught
courses in research methods, data analysis, and education policy
to master’s and doctoral students at San Francisco State and the
University of California at Berkeley. Her teaching and research in-
terests include higher education policy, equity and social justice
issues in education, and mixed methods research.
Courtesy of Helen H. Hyun
iii
fra37742_fm_i-xxxiv.indd 3 04/10/21 11:49 AM
To Marianne, Ava, and Jeff for all their support
iv
fra37742_fm_i-xxxiv.indd 4 04/10/21 11:49 AM
CONTENTS IN BRIEF
Preface xxiii
14 Single-Subject Research 294
PA R T 1
15 Correlational Research 324
Introduction to Research 16 Causal-Comparative Research 343
1
17 Survey Research 357
1 The Nature of Research 2
PA R T 5
PA R T 2
Introduction to Qualitative
The Basics of Educational
Research
379
Research
25
18 The Nature of Qualitative Research 380
2 The Research Problem 26
19 Observation and Interviewing 399
3 Locating and Reviewing the Literature 37
20 Content Analysis 431
4 Ethics and Research 60
5 Variables, Hypotheses, and Propositions 75
6 Sampling 90 PA R T 6
7 Instrumentation 110
Qualitative Research
8 Validity and Reliability 142
Methodologies
9 Internal Validity 160 447
21 Ethnographic Research 448
PA R T 3
22 Historical Research 480
Data Analysis
179
PA R T 7
10 Descriptive Statistics 180
11 Inferential Statistics 213 Mixed-Methods Studies
501
12 Statistics in Perspective 239
23 Mixed-Methods Research 502
PA R T 4
PA R T 8
Quantitative Research
Methodologies Research by Practitioners
257 527
13 Experimental Research 258 24 Action and Teacher Research 528
v
fra37742_fm_i-xxxiv.indd 5 04/10/21 11:49 AM
vi CONTENTS IN BRIEF
Appendixes
PA R T 9 A-1
APPENDIX A Portion of a Table of Random
Writing Research Proposals
Numbers A-2
and Reports 547 APPENDIX B Selected Values from a Normal Curve
Table A-3
25 P reparing Research Proposals and
APPENDIX C Chi-Square Distribution A-4
Reports 548
APPENDIX D Using Microsoft Excel A-5
Glossary
G-1
Index
I-1
fra37742_fm_i-xxxiv.indd 6 04/10/21 11:49 AM
CONTENTS
Preface xxiii
PA R T 1 Introduction to Research 1
1 The Nature of Research Critical Analysis of Research 16
2
A Brief Overview of the Research Process 19
Interactive and Applied Learning 3
Main Points 21
Some Examples of Educational
Key Terms 22
Concerns 3
For Discussion 23
Why Research Is of Value 4
References 23
Ways of Knowing 4
Research Exercise 1 24
Types of Research 7
Problem Sheet 1 24
General Research Types 15
PA R T 2 The Basics of Educational Research 25
2 The Research Problem 3 Locating and Reviewing the
26
Interactive and Applied Learning 27 Literature 37
What Is a Research Problem? 27 Interactive and Applied Learning 38
Research Questions 27 The Definition and Value of a Literature Review 38
Characteristics of Good Research Questions 28 Types of Sources 38
Main Points 34 Steps Involved in a Literature Search 39
Key Terms 35 Doing a Computer Search 44
For Discussion 35 Writing the Literature Review Report 51
Research Exercise 2 36 Main Points 56
Problem Sheet 2 36 Key Terms 58
For Discussion 58
vii
fra37742_fm_i-xxxiv.indd 7 04/10/21 11:49 AM
viii CONTENTS
References 58 Nonrandom Sampling Methods 97
Research Exercise 3 59 A Review of Sampling Methods 100
Problem Sheet 3 59 Sample Size 102
External Validity: Generalizing from a Sample 103
4 Ethics and Research
60
Main Points 106
Interactive and Applied Learning 61 Key Terms 107
Some Examples of Unethical Practice 61 For Discussion 107
A Statement of Ethical Principles 61 Research Exercise 6 109
Protecting Participants from Harm 63 Problem Sheet 6 109
Ensuring Confidentiality of Research Data 64
When (If Ever) Is Deception of Subjects Justified? 64 7 Instrumentation
110
Three Examples Involving Ethical Concerns 65
Interactive and Applied Learning 111
Research with Children 67
What Are Data? 111
Regulation of Research 67
Means of Classifying Data-Collection
Academic Cheating and Plagiarism 70
Instruments 113
Main Points 72
Examples of Data-Collection Instruments 116
Key Terms 72
Norm-Referenced Versus Criterion-Referenced
For Discussion 72
Instruments 132
References 73
Measurement Scales 133
Research Exercise 4 74
Preparing Data for Analysis 136
Problem Sheet 4 74
Main Points 138
5 Variables, Hypotheses, Key Terms 139
For Discussion 139
and Propositions
75
References 140
Interactive and Applied Learning 76
Research Exercise 7 141
The Importance of Studying Problem Sheet 7 141
Relationships 76
Variables 77
8 Validity and Reliability
Hypotheses and Propositions 82 142
Main Points 87 Interactive and Applied Learning 143
Key Terms 88 The Importance of Valid
For Discussion 88 Instrumentation 143
References 88 Validity 143
Research Exercise 5 89 Reliability 149
Problem Sheet 5 89 Main Points 157
Key Terms 157
6 Sampling
90 For Discussion 158
Interactive and Applied Learning 91 References 158
What Is a Sample? 91 Research Exercise 8 159
Random Sampling Methods 94 Problem Sheet 8 159
fra37742_fm_i-xxxiv.indd 8 04/10/21 11:49 AM
CONTENTS ix
9 Internal Validity Main Points 175
160
Key Terms 176
Interactive and Applied Learning 161
For Discussion 177
What Is Internal Validity? 161
References 177
Threats to Internal Validity 162
Research Exercise 9 178
How Can a Researcher Minimize These Threats
Problem Sheet 9 178
to Internal Validity? 174
PA R T 3 Data Analysis 179
10 Descriptive Statistics Main Points 235
180
Key Terms 237
Interactive and Applied Learning 181
For Discussion 237
Statistics Versus Parameters 181
Research Exercise 11 238
Two Fundamental Types of Numerical Data 181
Problem Sheet 11 238
Types of Scores 183
Techniques for Summarizing Quantitative Data 184 12 Statistics in Perspective
239
Techniques for Summarizing Categorical Data 203 Interactive and Applied Learning 240
Main Points 209
Approaches to Research 240
Key Terms 210
Comparing Groups: Quantitative Data 241
For Discussion 211
Relating Variables Within a Group: Quantitative
Research Exercise 10 212
Data 245
Problem Sheet 10 212
Comparing Groups: Categorical Data 249
Relating Variables Within a Group: Categorical
11 Inferential Statistics
213 Data 251
Interactive and Applied Learning 214 A Recap of Recommendations 253
What Are Inferential Statistics? 214 Main Points 253
The Logic of Inferential Statistics 215 Key Terms 254
Hypothesis Testing 222 For Discussion 254
Practical Versus Statistical Significance 224 Research Exercise 12 255
Inference Techniques 227 Problem Sheet 12 255
PA R T 4 Quantitative Research Methodologies 257
13 Experimental Research Control of Threats to Internal Validity: A Summary 273
258
Evaluating the Likelihood of a Threat to Internal
Interactive and Applied Learning 259
Validity in Experimental Studies 275
The Uniqueness of Experimental Research 259
Control of Experimental Treatments 278
Essential Characteristics of Experimental Research 260
An Example of Experimental Research 279
Control of Extraneous Variables 262
Analysis of the Study 287
Group Designs in Experimental Research 262
Main Points 289
fra37742_fm_i-xxxiv.indd 9 04/10/21 11:49 AM