Applied Psychometrics Using SPSS and Amos

288 Pages·2016·18.71 MB·English

by  Holmes Finch

Applied Psychometrics
Using SPSS and AMOS

Applied Psychometrics
Using SPSS and AMOS
W. Holmes Finch
Ball State University
Jason C. Immekus
University of Louisville
Brian F. French
Washington State University
INFORMATION AGE PUBLISHING, INC.
Charlotte, NC • www.infoagepub.com
Library of Congress Cataloging-in-Publication Data
A CIP record for this book is available from the Library of Congress
http://www.loc.gov
ISBN: 978-1-68123-526-4 (Paperback)
978-1-68123-527-1 (Hardcover)
978-1-68123-528-8 (ebook)
Copyright © 2016 Information Age Publishing Inc.
All rights reserved. No part of this publication may be reproduced, stored in a
retrieval system, or transmitted, in any form or by any means, electronic, mechanical,
photocopying, microfilming, recording or otherwise, without written permission
from the publisher.
Printed in the United States of America
Contents
Preface ...........................................................................................ix
1 Introduction to Psychometric Concepts .........................................1
Measurement Basics ..........................................................................1
Classical Test Theory ........................................................................2
Item Response Theory ......................................................................5
Dichotomous Items ............................................................................5
Polytomous Items ............................................................................10
2 Item Analysis .................................................................................15
Introduction ....................................................................................15
Classical Test Theory Item Difficulty.............................................15
CTT Item Difficulty for Dichotomous Items....................................15
CTT Item Difficulty for Polytomous Items ........................................27
Classical Test Theory Item Discrimination ...................................29
Extreme Groups Calculation Method ...............................................30
Biserial/Point Biserial Correlations ................................................40
Chapter Summary ...........................................................................46
3 Reliability ......................................................................................47
Introduction ....................................................................................47
Measures of Internal Consistency ..................................................48
KR-20 ............................................................................................49
Cronbach’s α for Ordinal Data .......................................................61
v
vi  Contents
Split-Half Reliability .......................................................................64
Test–Retest Reliability .....................................................................70
Chapter Summary ...........................................................................73
4 Generalizability Theory .................................................................75
Introduction ....................................................................................75
G-Studies/D-Studies .......................................................................76
Variance Components ....................................................................77
Generalizability Coefficient/Phi Coefficient ................................80
Example 1: One Facet Crossed Design .............................................81
Example 2: Two Facet Crossed Design .............................................88
Chapter Summary ...........................................................................93
5 Validity ..........................................................................................95
Introduction ....................................................................................95
Types or Sources of Validity Evidence ...........................................97
Concurrent Validity ......................................................................101
Considerations in Concurrent Validity Assessment .........................112
Predictive Validity ..........................................................................114
Discriminant Groups Validity .......................................................116
Construct Validity .........................................................................127
Exploratory Factor Analysis as a Tool for Investigating Construct
Validity ..................................................................................127
Confirmatory Factor Analysis as a Tool for Investigating Construct
Validity ..................................................................................150
Fitting a CFA Model Using AMOS ...............................................153
Chapter Summary .........................................................................166
6 Issues in Scoring ..........................................................................169
Introduction ..................................................................................169
Types of Scores ..............................................................................170
Raw Scores ...................................................................................170
Weighted Scores ............................................................................171
Percentile Scores ............................................................................171
Standard Scores ............................................................................173
Calculation of Raw Scores Using SPSS .........................................176
Calculation of Weighted Scores Using SPSS ...............................183
Calculation of Percentiles Using SPSS ........................................188
Contents  vii
Calculation of Standardized Scores Using SPSS ........................191
Chapter Summary .........................................................................193
7 Differential Item Functioning ......................................................195
Introduction ..................................................................................195
DIF Versus Impact .........................................................................199
Mantel–Haenszel Test ...................................................................199
Logistic Regression .......................................................................203
Examples .......................................................................................206
Logistic Regression Example .........................................................215
Chapter Summary .........................................................................222
8 Equating ......................................................................................225
Introduction ..................................................................................225
Equating Sampling Designs .........................................................226
Mean Equating ..............................................................................229
Linear Equating ............................................................................237
Equipercentile Equating ..............................................................251
Chapter Summary .........................................................................271
References ...................................................................................273

Preface
This book was developed to provide a “one-stop” resource for many
common analyses that an applied researcher might complete when
working with various instruments to measure educational and psychologi-
cal traits. We have developed examples, collected our favorite examples and
resources, and provided explanations of analyses in one easily digestible
text. Many of the analyses presented assist in providing the recommended
evidence to support the inferences drawn from scores from such instru-
ments. That is, the results from applying these techniques assist providing
score reliability and validity evidence.
Through our years as graduate students and the first segment of our
academic lives, we have explored the use of various programs for scale de-
velopment and the study of the psychometric properties of the scores to
provide such evidence. We have had the experience, as I am sure many of
you have had, of turning to multiple books for instructions and examples
to complete analyses in the scale development and validation process. For
those readers just beginning on the psychometric ride, you too will soon ex-
perience this. By no means will this book stop the need for multiple sourc-
es, in fact, that is always encouraged. However, this book should allow the
reader to use this as a main guide and supplement to experience analyses
described in major text books. Our examples are intended to be clear and
concise with SPSS examples that can be easily adapted to fit many situa-
tions, as the reader learns and uses various techniques.
Applied Psychometrics Using SPSS and AMOS, pages ix–x
Copyright © 2016 by Information Age Publishing
All rights of reproduction in any form reserved. ix