An analysis of data validity for measures of effectiveness of information systems.

182 Pages·3 MB·en_US

by  Regens, Gregory M.;Haga, William James.

NAVAL POSTGRADUATE SCHOOL
Monterey, California
THESIS
AN ANALYSIS OFDATAVALIDITY
FORMEASURES OF
EFFECTIVENESS OFINFORMATION SYSTEMS
by
Gregory M. Regens
March 1991
ThesisAdvisor: WilliamJ. Haga
Approved forpublicrelease; distribution isunlimited
T254715

SECURITYCLASSIFICATIONOFTHISPAGE
REPORT DOCUMENTATION PAGE
1a REPORTSECURITYCLASSIFICATION 1b.RESTRICTIVEMARKINGS
UNCLASSIFIED
2a.SECURITYCLASSIFICATIONAUTHORITY 3 DISTRIBUTION/AVAILABILITYOFREPORT
Approvedfor publicrelease;distributionisunlimited.
2b.DECLASSIFICATION/DOWNGRADINGSCHEDULE
4.PERFORMINGORGANIZATIONREPORTNUMBER(S) 5 MONITORINGORGANIZATIONREPORTNUMBER(S)
6a.NAMEOFPERFORMINGORGANIZATION 6b.OFFICESYMBOL 7a.NAMEOFMONITORINGORGANIZATION
NavalPostgraduateSchool (Ifapplicable) NavalPostgraduateSchool
37
6c.ADDRESS(Crty,State,andZIPCode) 7b.ADDRESS(Crty,State,andZIPCode)
Monterey,CA 93943-5000 Monterey,CA 93943-5000
8a.NAMEOFFUNDING/SPONSORING 8b.OFFICESYMBOL 9.PROCUREMENTINSTRUMENTIDENTIFICATIONNUMBER
ORGANIZATION (Ifapplicable)
8c.ADDRESS(City,State,andZIPCode) 10.SOURCEOFFUNDINGNUMBERS
ProgramElementNo ProjectNo WorkUnitAccession
Number
11.TITLE(IncludeSecurityClassification)
ANANALYSISOFDATAVALIDITYFORMEASURESOFEFFECTIVENESSOFINFORMATIONSYSTEMS
12 PERSONALAUTHOR(S) Regens,GregoryM.
13a.TYPEOFREPORT 13b.TIMECOVERED 14 DATEOFREPORT(year,month,day) 15 PAGECOUNT
Master'sThesis From To March 1991 166
16.SUPPLEMENTARYNOTATION
TheviewsexpressedinthisthesisarethoseoftheauthoranddonotreflecttheofficialpolicyorpositionoftheDepartmentofDefenseortheU.S.
Government.
17.COSATICODES 18.SUBJECTTERMS(continueonreverseifnecessaryandidentifybyblocknumber)
FIELD GROUP SUBGROUP datacollection,effectiveness,evaluation,informationsystems,validity
19.ABSTRACT(continueonreverseifnecessaryandidentifybyblocknumber)
Thisthesisexaminesvalidityissuesassociatedwiththeuseofdatacollectiontechniquesininformationsystemsresearch. Itpresentsan
analysisof37studiesthatpurportedtoempiricallyassesstheeffectivenessofinformationsystems. Thesestudieswereevaluatedtodetermine
thevalidityofmeasuresofeffectivenssofinformationsystems. Eachstudywasreviewedtoidentify(1)datacollectiontechniquesused,(2)
purportedmeasuresofthetechniques,(3)waysinwhichthetechniqueswereadministered,and(4)discussionsofvalidityissuesarisingfromthe
useofthetechniques.
Findingsindicatethatinformationsystemsresearchershaveadopteddatacollectiontechniquescommonlyusedbysocialscientists;however,
theylargelyignoreorareunawareofassociatedvalidityissues. Overhalfofthestudiesinvolvedquestionnairesandfewerthanaquarter
addressedvalidityissues. Consequently,thecredibilityofinformationsystemsresearchisvulnerabletochallenge.
20.DISTRIBUTION/AVAILABILITYOFABSTRACT 21.ABSTRACTSECURITYCLASSIFICATION
PI UNCLASSIFIED/UNLIMITED IH SAMEASREPORT IH OTICUSERS Unclassified
22a NAMEOFRESPONSIBLEINDIVIDUAL 22b.TELEPHONE(IncludeAreacode) 22c.OFFICESYMBOL
WilliamJ.Haga [phone] AS/HG
DD FORM 1473,84 MAR 83APReditionmaybeuseduntilexhausted SECURITYCLASSIFICATIONOFTHISPAGE
Allothereditionsareobsolete UNCLASSIFIED
Approved for public release; distribution is unlimited
An Analysis of Data Validity
for Measures of
Effectiveness of Information Systems
by
Gregory M. Regens
Captain, United States Army
B.S., University of Arizona, 1981
Submitted in partial fulfillment
of the requirements for the degree of
MASTER OF SCIENCE IN INFORMATION SYSTEMS MANAGEMENT
from the
NAVAL POSTGRADUATE SCHOOL
March 1991