Correlational analysis of survey and model-generated workload values

108 Pages·1.3 MB·en_US

by  Galvin, James J.;Lind, Judith H.

NAVAL POSTGRADUATE SCHOOL
Monterey, California
THESIS
CORRELATIONAL ANALYSIS OF SURVEY AND
MODEL-GENERATED WORKLOAD VALUES
by
JamesJ. Galvin Jr.
September, 1991
ThesisAdvisor: Judith H. Lind
Approved for public release; distribution is unlimited
T260317

HLianauiuu
vj
SECURITYCLASSIFICATIONOF THISPAGE
REPORT DOCUMENTATION PAGE
1a REPORTSECURITYCLASSIFICATION lb RESTRICTIVE MARKINGS
UNCLASSIFIED
2a SECURITYCLASSIFICATIONAUTHORITY 3 DISTRIBUTION/AVAILABILITYOF REPORT
Approvedfor publicrelease;distributionisunlimited.
2b DECLASSIFICATION/DOWNGRADINGSCHEDULE
4 PERFORMINGORGANIZATION REPORTNUMBER(S) 5 MONITORINGORGANIZATION REPORT NUMBER(S)
6a NAMEOFPERFORMINGORGANIZATION 6b OFFICE SYMBOL 7a NAMEOF MONITORINGORGANIZATION
Naval PostgraduateSchool (Itapplicable) NavalPostgraduateSchool
OK
6c ADDRESS(City. State,andZIPCode) 7b ADDRESS(City,State,andZIPCode)
Monterey,CA 93943 5000 Monterey,CA 93943 5000
8a NAME OF FUNDING/SPONSORING 8b OFFICESYMBOL 9 PROCUREMENTINSTRUMENT IDENTIFICATION NUMBER
ORGANIZATION (Ifapplicable)
8c ADDRESS(City, State,andZIPCode) 10 SOURCE OFFUNDING NUMBERS
ProgramtlemenlNo Pro|caNo WorkUnitAccev>ion
Number
11 TITLE(IncludeSecurityClassification)
CORRELATIONALANALYSISOFSUKVEY AND MODEL-GENERATEDWORKLOADVALUES (UNCLASSIFIED)
12 PERSONALAUTHOR(S) Galvin,James,J., Jr
13a TYPEOFREPORT 13b TIMECOVERED 14 DATEOF REPORT(year,month,day) 15 PAGE COUNT
Master'sThesis From To 1991,Sept 99
16 SUPPLEMENTARY NOTATION
Theviewsexpressedinthisthesisarethoseoftheauthoranddonotreflecttheofficial policyorpositionoftheDepartmentofDefenseortheU.S.
Government.
17 COSATICODES 18 SUBJECTTERMS(continueonreverseifnecessaryandidentitybyblocknumber)
FIELD GROUP SUBGROUP WORKLOAD,TASKLOADINGMODEL,HELICOPTERPILOTWORKLOAD,ARMY
AIRCREW/AIRCRAFTINTEGRATION PROGRAM,MIDAS,WORKLOADSURVEY
19 ABSTRACT(continueonreverseifnecessaryandidentifybyblocknumber)
ThisstudyexaminestheaccuracyofanArmyhelicopterpilotworkloadmeasuringmodelcalledtheTask Loading Model. Themodelisa
submodeloftheArmy-NASAAircrew/AircraftIntegrationProgram'sMan-MachineIntegrationDesignand AnalysisSystem. Themodel's
workload leveloutputwascorrelatedwiththesubjectiveworkload measurementsofseveralgroupsofpilotsevaluatingavarietyofflighttasks.
Seventy-oneArmyaviatorscompletedsurveysrequiringscaledratingsandpairedcomparisonsofworkload relatedtocommonflighttasks
conducteddaringtypicalmissions. Theirresponseswereexaminedforinternalconsistencyand poolingbymeansofnonparametrictests.
Aviator-supplieddatawasfoundtoberobustandreliable. Pooled responsedatawascorrelated withmodel-generateddatatodeterminethe
accuracyofthemodel. ResultsofthisstudyshowthattheTaskLoadingModelispresentlyinadequate,butdisplayspromisingtrendsandshould
befurtherrefined.
20 DISTRIBUTION/AVAILABILITYOFABSTRACT 21 ABSTRACTSECURITYCLASSIFICATION
Q
UNCIASSlFIED/UNUMniL' SAMLASKIPOK1 J D1ICUSCKS Unclassified
22a NAMEOF RESPONSIBLE INDIVIDUAL 22b TELEPHONE (IncludeAreacode) 22c OFFICE SYMBOL
Judith H.Lind 408 646 2543 CodeOR/Li
DD FORM 1473. 84 MAR 83APReditionmaybeused untilexhausted SECURITYCLASSIFICATIONOFTHIS PAGE
Allothereditionsareobsolete Unclassified
Approved for public release; distribution is unlimited.
Correlational Analysis of Survey and
Model-Generated Workload Values
by
James J. Galvin Jr.
Captain, United States Army
B.S., United States Military Academy
Submitted in partial fulfillment
of the requirements for the degree of
MASTER OF SCIENCE IN OPERATIONS RESEARCH
from the
NAVAL POSTGRADUATE SCHOOL
September 1991
11
ABSTRACT
This study examines the accuracy of an Army helicopter
pilot workload measuring model called the Task Loading Model.
The model is a submodel of the Army-NASA Aircrew/Aircraft
Integration Program's Man-Machine Integration Design and
Analysis System. The model's workload level output was
correlated with the subjective workload measurements of
several groups of pilots evaluating a variety of flight tasks.
Seventy-one Army aviators completed surveys requiring scaled
ratings and paired comparisons of workload related to common
flight tasks conducted during typical missions. Their
responses were examined for internal consistency and pooling
by means of nonparametric tests. Aviator-supplied data was
found to be robust and reliable. Pooled response data was
correlated with model-generated data to determine the accuracy
of the model. Results of this study show that the Task
Loading Model is presently inadequate, but displays promising
trends and should be further refined.
111
. . ..... ......
CI
TABLE OF CONTENTS
I INTRODUCTION 1
A BACKGROUND 1
1. Operator Error and the Design Process 1
2 Army-NASA Design Tool: MIDAS 2
3 MIDAS Task Loading Model 4
B TLM PROBLEMS 5
C PURPOSE AND SCOPE 6
II METHODOLOGY 7
A. STUDY OVERVIEW 7
B SCENARIOS AND TASKS 7
1. Flight Scenario Development 7
2 Task Selection 8
C. SUBJECTIVE WORKLOAD MEASUREMENT TECHNIQUES 12
1. Selection of Measurement Techniques 12
2 Rating Scales 12
3 Thurstone s Method 13
. '
D SURVEY CONSTRUCTION 14
1 Survey Format 14
2 Survey Content 15
3. Minimizing the Social-Desirability Response 16
.
E. SURVEY ADMINISTRATION 17
IV