Table Of Content::
NAVAL POSTGRADUATE SCHOOL
Monterey
California
,
THESIS
EVALUATION OF A USER INFORMATION
SATISFACTION SHORT-FORM INSTRUMENT
by
Mark S. Lockhart
March 1992
Co-Advisor Moshe Zviran
Co-Advisor Kishore Sengupta
Approved for public release; distribution is unlimited
T258353
UNCLASSIFIED
SECl pity ClasS'F'Cat.on Oc This page
REPORT DOCUMENTATION PAGE FormApproved
OMBNo 0704 0188
la REPORT SECURITY CLASSIFICATION lb RESTRICTIVE MARKINGS
UNCLASSIFIED
2a SECURITY CLASSIFICATION AUTHORITY 3 DISTRIBUTION/AVAILABILITY OF REPORT
Approved for public release;
2b DECLASSIFICATION < DOWNGRADING SCHEDULE distribution is unlimited
4 PERFORMING ORGANIZATION REPORT NUMBER(S) 5 MONITORING ORGANIZATION REPORT NUMBER(S)
6a NAME OF PERFORMING ORGANIZATION 6b OFFICE SYMBOL 7a NAME OF MONITORING ORGANIZATION
(If applicable)
Naval Postgraduate Schoo cs Naval Postgraduate School
6c ADDRESS [City. State, and ZIPCode) 7d ADDRESS{City. State and ZIPCode)
Monterey, CA 93943-5000 Monterey, CA 93943-5000
Sa NAME OF FUNDING /SPONSORING 8b OFFICE SYMBOL 9 PROCUREMENT INSTRUMENT IDENTIFICATION NUMBER
ORGANIZATION (If applicable)
8c ADDRESSfOry, State, and ZIPCode) 10 SOURCE OF FUNDING NUMBERS
PROGRAM PROJECT TASK WORK UNIT
ELEMENT NO NO NO ACCESSION NO
11 TITLE (Include Security Classification) EVALUATION OF A USER INFORMATION SATISFACTION
SHORT-FORM INSTRUMENT
12 PERSONAL AUTHOR(S)
LOCKHART, Mark S
13a TYPE OF REPORT 3b TIME COVERED DATE OF REPORT (Year Month Day) 5 PAGE COUN
Master's Thesis FROM TO 1992 127
i6 supplementary nota-ion The views expressed in this thesis are those of the
author and do not reflect the official policy or position of the Depart'
merit of Defense or the US Governments
COSATI codes 18 SUBJECT TERMS [Continue on reverse if necessary and identify by block number)
FIELD GROUP SUB-GROUP UIS instrument validation; CHCS evaluation
19 ABSTRACT (Continue on reverse if necessary and identify by block number)
The objectives were to validate and evaluate the Baroudi and Orlikowski
[2] short-form UIS instrument as a surrogate measurement of effectiveness
of the Department of Defense's Composite Health Care System (CHCS).
Hurd [1], using the short-form UIS instrument at the Naval Hospital
Charleston, suggested a fundamental change existed in the instrument's
structure due to the impact of contractor's services with the CHCS. The
three Navy CHCS operational testing and evaluation hospitals were used
in this study.
The short-form UIS instrument was found to be inadequate for evaluation
of overall UIS of the CHCS. Limitations found were: a fundamental change
in the factor structure; unevenly distributed variables in a couple of
20 DISTRIBUTION AVAILABILITY OF ABSTRACT 21 ABSTRACT SECURITV CLASSIFICATION
.
XD UNCLASSIFIED/UNLIMITED CD SAME AS RPT DTIC USERS UNCLASSIFIED
22a NAME OF RESPONSIBLE INDIVIDUAL 22b TELEPHONE (Include Area Code) 2c OFFICE SYMBO:
ZVIRAN, Moshe 408-646-2489 AS/7.V
DDForm 1473, JUN 86 Previouseditionsareobsolete SECURITY CLASSIFICATION OF THIS PAGE
S/N 0102-LF-014-6603 UNCLASSIFIED
.
UNCLASSIFIED
(< i inn , r\ OSSIFICATION or THIS PAGF
19. cont
factors; low reliability in one factor; no assessment of user inter-
face with the system; and inconsistent convergent validity findings.
A proposed re-design is presented.
Statistically significant differences in UIS between groups and
sites were found for the four factor solution. Participants were
divided into three functional user groups: Physicians, Medical Support
and Administrative Support. All three groups were satisfied with the
local Management Information Department staff and services and the
system's output. All three groups were dissatisfied with the con-
tractor services. Physicians were significantly less satisfied in
three out of the four factors. No significant correlation between
time of use of the system and UIS was found, except for the Administra
tive group's positive correlation with the system's output.
OD Form 1473. JUN 86 (Reverse) SECURITY CLASSIFICATION OF THIS P/
UNCLASSIFIED
li
Approved for public release; distribution is unlimited
Evaluation of a User Information Satisfaction
Short-Form Instrument
by
Mark S Lockhart
.
Lieutenant Commander, /Medical Services Corps
United States Navy
B.A. SUNY at Oneonta, 1974
,
Submitted in partial fulfillment of the
requirements for the degree of
MASTER OF SCIENCE IN INFORMATION SYSTEMS
from the
NAVAL POSTGRADUATE SCHOOL
March 1992
. .
7117
CI
ABSTRACT
The objectives of this thesis were to validate and
evaluate the Baroudi and Orlikowski [2] short-form UIS
instrument as a surrogate measurement of effectiveness of the
Department of Defense's Composite Health Care System (CHCS)
Hurd [1], using the short-form UIS instrument at the Naval
Hospital Charleston, suggested that a fundamental change in
the instrument's structure due to significant impact of
contractor's services with the CHCS. The three Navy CHCS
operational testing and evaluation hospitals were used in this
study
The short-form UIS instrument was found to be inadequate
for evaluation of overall UIS of the CHCS. Limitations found
were: a fundamental change in the factor structure; unevenly
distributed variables in a couple of factors; low reliability
in one factor; no assessment of user interface with the
system; and inconsistent convergent validity findings. A
proposed re-design is presented.
Statistically significant differences in UIS between
groups and sites were found for the four factor solution.
Participants were divided into three functional user groups:
Physicians, Medical Support, and Administrative Support. All
three groups were satisfied with the local Management
Information Department staff and services and the system's
output. All three groups were dissatisfied with the
contractor services. Physicians were significantly less
satisfied in three out of the four factors. No significant
correlation between time of use of the system and UIS was
found, except for the Administrative group's positive
correlation with the system's output.
IV
