Table Of ContentHuman–Automation
Interaction Design
Transportation Human Factors: Aerospace, Aviation,
Maritime, Rail, and Road Series
Series Editor: Professor Neville A. Stanton,
University of Southampton, UK
Automobile Automation
Distributed Cognition on the Road
Victoria A. Banks and Neville A. Stanton
Eco-Driving
From Strategies to Interfaces
Rich C. McIlroy and Neville A. Stanton
Driver Reactions to Automated Vehicles
A Practical Guide for Design and Evaluation
Alexander Eriksson and Neville A. Stanton
Systems Thinking in Practice
Applications of the Event Analysis of Systemic Teamwork Method
Paul Salmon, Neville A. Stanton, and Guy Walker
Individual Latent Error Detection (I-LED)
Making Systems Safer
Justin R.E. Saward and Neville A. Stanton
Driver Distraction
A Sociotechnical Systems Approach
Katie J. Parnell, Neville A. Stanton, and Katherine L. Plant
Designing Interaction and Interfaces for Automated Vehicles
User-Centred Ecological Design and Testing
Neville A. Stanton, Kirsten M.A. Revell, and Patrick Langdon
Human – Automation Interaction Design
Developing a Vehicle Automation Assistant
Jediah R. Clark, Neville A. Stanton, and Kirsten M.A. Revell
For more information about this series, please visit: www.crcpress.com/
Transportation-Human-Factors/book-series/CRCTRNHUMFACAER
Human–Automation
Interaction Design
Developing a Vehicle
Automation Assistant
Jediah R. Clark, Neville A. Stanton
and Kirsten M.A. Revell
First edition published 2022
by CRC Press
6000 Broken Sound Parkway NW, Suite 300, Boca Raton, FL 33487–2742
and by CRC Press
2 Park Square, Milton Park, Abingdon, Oxon, OX14 4RN
© 2022 Jediah R. Clark, Neville A. Stanton and Kirsten M. A. Revell
CRC Press is an imprint of Taylor & Francis Group, LLC
Reasonable efforts have been made to publish reliable data and information, but the author and
publisher cannot assume responsibility for the validity of all materials or the consequences of
their use. The authors and publishers have attempted to trace the copyright holders of all material
reproduced in this publication and apologize to copyright holders if permission to publish in this
form has not been obtained. If any copyright material has not been acknowledged please write and
let us know so we may rectify in any future reprint.
Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced,
transmitted, or utilized in any form by any electronic, mechanical, or other means, now known or
hereafter invented, including photocopying, microf lming, and recording, or in any information
storage or retrieval system, without written permission from the publishers.
For permission to photocopy or use material electronically from this work, access www.
copyright.com or contact the Copyright Clearance Center, Inc. (CCC), 222 Rosewood Drive,
Danvers, MA 01923, 978–750–8400. For works that are not available on CCC please contact
[email protected]
Trademark notice : Product or corporate names may be trademarks or registered trademarks and
are used only for identif cation and explanation without intent to infringe.
ISBN: 978-1-032-10161-3 (hbk)
ISBN: 978-1-032-10162-0 (pbk)
ISBN: 978-1-003-21396-3 (ebk)
DOI: 10.1201/9781003213963
Typeset in Times
by Apex CoVantage, LLC
Contents
Preface....................................................................................................................... xi
Acknowledgements .................................................................................................xiii
Authors ..................................................................................................................... xv
Chapter 1 Introduction .......................................................................................... 1
1.1 Background .................................................................................. 1
1.2 Research Motivation .................................................................... 2
1.3 Research Outcomes and Hypotheses ........................................... 3
1.3.1 Research Outcomes .......................................................... 4
1.3.2 Research Hypotheses ....................................................... 4
1.4 Book Structure ............................................................................. 5
1.4.1 Chapter 1—Overview of Book . ........................................ 5
1.4.2 Chapter 2—Automated Vehicles as a Copilot:
Setting the Scene for Effective Human–Automation
Collaboration .................................................................... 5
1.4.3 C hapter 3—Cognitive Work Analysis to
Improve Communication in AV Interactions ................... 7
1.4.4 Chapter 4—Review of Handover Tools and
Techniques in High-Risk Shift-Work Domains ............... 7
1.4.5 Chapter 5—Replicating Human–Human
Communication in a Vehicle: A Simulation
Study ................................................................................. 7
1 .4.6 Chapter 6—Directability and Eye-Gaze:
Exploring Interactions between Vocal Cues
and the Use of Visual Displays ........................................ 8
1.4.7 Chapter 7—Participatory Workshops for
Designing Interactions in Automated
Vehicles ............................................................................ 8
1.4.8 Chapter 8—Designing Automated Vehicle
Interactions Using Design with Intent .............................. 8
1.4.9 Chapter 9—Validation and Testing of Final
Interaction Design Concepts for Automated
Vehicles ............................................................................ 9
1.4.10 Chapter 10—Conclusions................................................. 9
1.5 Contribution of Knowledge ......................................................... 9
1.6 Future Directions ........................................................................10
v
vi Contents
Section I Scoping the Issues and Solutions
that Other Domains Face with
Task Continuity
Chapter 2 Vehicle Automation as a Copilot: Setting the Scene for
Effective Human–Automation Collaboration .................................... 13
2.1 Levels of Automation and the Handover ................................... 13
2 .2 Emergent Issues in Level 3 and 4 Automation .......................... 14
2 .3 Current State of Handover Assistants ....................................... 16
2 .4 Communication during Automated Driving ............................. 16
2 .5 Distributed Situation Awareness ............................................... 17
2.6 Joint Activity ............................................................................. 18
2.7 Summarizing Theories ..............................................................19
2.8 Future Directions ....................................................................... 21
Chapter 3 Cognitive Work Analysis to Improve Communication
in AV Interactions .............................................................................. 23
3 .1 What Is Cognitive Work Analysis? ............................................ 23
3 .1.1 Work Domain Analysis .................................................. 24
3 .1.2 Contextual Activity Template ......................................... 24
3 .1.3 Social and Organization Cooperation
Analysis .......................................................................... 25
3 .2 Development of Analysis ........................................................... 25
3.2.1 Participants ..................................................................... 25
3.2.2 Abstraction Hierarchy .................................................... 25
3 .2.3 Identifying Physical Components .................................. 25
3 .2.4 Identifying Purposes and Functions ............................... 26
3 .2.5 Contextual Activity Template/Social and Organization
Cooperation Analysis ..................................................... 26
3 .2.6 Development of Analysis ............................................... 26
3.3 Results ....................................................................................... 27
3 .3.1 Work Domain Analysis .................................................. 27
3 .3.2 Vocal and Audio Communication ..................................28
3.3.3 Physical Inputs. ............................................................... 29
3 .3.4 Contextual Activity Template ......................................... 30
3 .3.5 Social Organization and Cooperation Analysis ............. 31
3.4 Discussion .................................................................................. 31
3.4.1 Future Directions ............................................................ 35
Chapter 4 Review of Handover Tools and Techniques in High-Risk
Shift-Work Domains ........................................................................... 37
4.1 Introduction ............................................................................... 37
4 .1.1 The Handover of Control and Responsibility ................. 38
Contents vii
4.1.2 Applying Distributed Situation Awareness to the
Handover Task ................................................................ 40
4.1.3 Purpose of the Review ....................................................41
4.2 Method. .......................................................................................41
4.2.1 Search Methods and Source Selection ............................41
4.3 Results and Discussion ...............................................................43
4.3.1 Overview of Handover Tools/Techniques .......................43
4.3.2 Standardizing Handover Protocol ...................................43
4.3.3 Vocal Communication, Face-to-Face and Bidirectional
Exchange of Information (HTTs 2, 5, and 7) ................. 46
4.3.4 Use of Past Information ...................................................47
4.3.5 Training Programs ......................................................... 48
4.3.6 Use of Technology .......................................................... 48
4.3.7 Adaptation of Task or Setting ......................................... 49
4.3.8 Compatible Mental Model .............................................. 49
4.3.9 Preparation ..................................................................... 50
4.3.10 A Contextual Handover .................................................. 50
4.3.11 Other Handover Tools and Techniques
(HTTs 12–19) ..................................................................51
4.3.12 HTTs and the DSA Guidelines ........................................52
4.4 Conclusion ..................................................................................53
4.4.1 Future Directions .............................................................53
Section II Pilot Testing These Concepts in
Automated Driving
Chapter 5 Replicating Human–Human Communication in a
Vehicle: A Simulation Study ...............................................................57
5.1 Introduction ................................................................................57
5 .1.1 Applying Human Communication Theory to
Human–Machine Handover ............................................57
5 .1.2 Current Study, Aims, and Hypotheses ............................59
5.2 Method ....................................................................................... 60
5.2.1 Participants ..................................................................... 60
5.2.2 Experimental Conditions ................................................ 60
5.2.3 Design ..............................................................................62
5.2.4 Apparatus ....................................................................... 63
5.2.5 Procedure ....................................................................... 64
5 .2.6 Method of Analysis ........................................................ 65
5.3 Results ....................................................................................... 65
5.3.1 ‘Free-Form’ Conditions .................................................. 65
5 .3.2 Use of Open Questioning ............................................... 68
5 .3.3 NASA-TLX, SUS, and SAS ........................................... 68
5.3.4 Change in Speed following Handover ............................ 69
viii Contents
5.3.5 Lateral Velocity following Handover ............................. 69
5.3.6 Qualitative Feedback .......................................................72
5.4 Discussion ...................................................................................74
5.5 Conclusions ................................................................................ 77
5.5.1 Future Directions ............................................................ 77
Chapter 6 Directability and Eye-Gaze: Exploring Interactions
between Vocal Cues and the Use of Visual Displays ..........................79
6.1 Introduction ................................................................................79
6.1.1 Visual Gaze and Automated Driving ..............................79
6.2 Method ...................................................................................... 80
6.2.1 Participants ..................................................................... 80
6.2.2 Design ..............................................................................81
6.2.3 Apparatus ....................................................................... 83
6.2.4 Procedure ....................................................................... 85
6.2.5 Method of Analysis ........................................................ 86
6.3 Results ....................................................................................... 86
6.3.1 Handover Process Visual Gaze Durations ..................... 86
6.3.2 Demographics and Behavioral Factors. .......................... 89
6.3.3 Post-Handover (Manual Driving) Visual
Gaze Durations ............................................................... 90
6.4 Discussion .................................................................................. 92
6.4.1 Conclusions .................................................................... 94
6.4.2 Future Directions ............................................................ 95
Section III D esigning New Interfaces and
Interactions for Automated
Vehicle Communication
Chapter 7 Participatory Workshops for Designing Interactions
in Automated Vehicles ....................................................................... 99
7.1 Introduction ................................................................................ 99
7.1.1 Driver Skill in C/HAVs .................................................. 99
7.1.2 Current Study and Research Questions ........................ 100
7.2 Method ......................................................................................101
7.2.1 Participants ....................................................................101
7.2.2 Design ............................................................................101
7.2.3 Procedure ......................................................................102
7.2.4 Method of Analysis .......................................................103
7.3 Results .......................................................................................103
7.3.1 Learner Handover Design .............................................105
7.3.2 Intermediate Handover Design .....................................105
7 .3.3 Advanced Handover Design ..........................................108
Contents ix
7.3.4 Handback Designs .........................................................109
7.4 Discussion .................................................................................111
7 .4.1 Comparison of Groups’ Handover Designs ..................111
7 .4.2 Changes When Shorter Time Out of the Loop .............113
7 .4.3 Comparison of Groups’ Handback Designs ..................113
7 .4.4 Relevance to DSA and JA .............................................114
7.4.5 Limitations ....................................................................115
7.4.6 Conclusion .....................................................................115
7.4.7 Future Directions ...........................................................116
Chapter 8 Designing Automated Vehicle Interactions Using Design
with Intent .........................................................................................117
8.1 Introduction ..............................................................................117
8 .1.1 Introduction to Design with Intent ................................117
8.1.2 Design with Intent for In-Vehicle Interface Design ......118
8.1.3 Current Application .......................................................119
8.2 Method .....................................................................................119
8.2.1 Participants ....................................................................119
8.2.2 Design ............................................................................119
8.2.3 Materials ........................................................................120
8.2.4 Procedure ......................................................................121
8 .2.5 Method of Analysis .......................................................122
8.3 Results ......................................................................................122
8 .3.1 Themes Generated during Divergent Stage ..................122
8 .3.2 Solution Generated for Convergent Stage .....................127
8.4 Discussion .................................................................................128
8 .4.1 Overview of Findings ....................................................128
8 .4.2 Applications to Future AVs ...........................................129
8 .4.3 Relevance to DSA and JA .............................................130
8 .4.4 DwI and the Future ........................................................131
8.4.5 Conclusion .....................................................................131
8.4.6 Future Directions ...........................................................132
Section IV Testing and Validating a Novel Prototype
Chapter 9 Validation and Testing of Final Interaction Design Concepts
for Automated Vehicles .....................................................................135
9.1 Introduction. ..............................................................................135
9.1.1 Summary of Automation Assistants .............................135
9.1.2 Summary of the Design Process ...................................137
9.1.3 Overview of Final Handover Assistant Design .............138
9.1.4 The Development of Steeri ............................................139
9.2 Method ......................................................................................145
9.2.1 Participants ....................................................................145
