Table Of ContentMathematics and Visualization
Michael Burch · Lewis Chuang
Brian Fisher · Albrecht Schmidt
Daniel Weiskopf Editors
Eye Tracking
and Visualization
Foundations, Techniques, and Applications.
ETVIS 2015
Mathematics and Visualization
SeriesEditors
Hans-ChristianHege
DavidHoffman
ChristopherR.Johnson
KonradPolthier
MartinRumpf
Moreinformationaboutthisseriesathttp://www.springer.com/series/4562
Michael Burch • Lewis Chuang (cid:129) Brian Fisher (cid:129)
Albrecht Schmidt (cid:129) Daniel Weiskopf
Editors
Eye Tracking and
Visualization
Foundations, Techniques, and Applications.
ETVIS 2015
123
ETVIS
Editors
MichaelBurch LewisChuang
VISUS,UniversityofStuttgart MaxPlanckInstituteforBiological
Stuttgart,Germany Cybernetics
TuRbingen,Germany
BrianFisher AlbrechtSchmidt
SIAT,SimonFraserUniversity VIS,UniversityofStuttgart
Surrey Stuttgart,Germany
BC,Canada
DanielWeiskopf
VISUS,UniversityofStuttgart
Stuttgart,Germany
ISSN1612-3786 ISSN2197-666X (electronic)
MathematicsandVisualization
ISBN978-3-319-47023-8 ISBN978-3-319-47024-5 (eBook)
DOI10.1007/978-3-319-47024-5
LibraryofCongressControlNumber:2017931067
MathematicsSubjectClassification(2010):62-07,62-09,62P15,68-04,68-06,68U05,68U20
©SpringerInternationalPublishingAG2017
Thisworkissubjecttocopyright.AllrightsarereservedbythePublisher,whetherthewholeorpartof
thematerialisconcerned,specificallytherightsoftranslation,reprinting,reuseofillustrations,recitation,
broadcasting,reproductiononmicrofilmsorinanyotherphysicalway,andtransmissionorinformation
storageandretrieval,electronicadaptation,computersoftware,orbysimilarordissimilarmethodology
nowknownorhereafterdeveloped.
Theuseofgeneraldescriptivenames,registerednames,trademarks,servicemarks,etc.inthispublication
doesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevant
protectivelawsandregulationsandthereforefreeforgeneraluse.
Thepublisher,theauthorsandtheeditorsaresafetoassumethattheadviceandinformationinthisbook
arebelievedtobetrueandaccurateatthedateofpublication.Neitherthepublishernortheauthorsor
theeditorsgiveawarranty,expressorimplied,withrespecttothematerialcontainedhereinorforany
errorsoromissionsthatmayhavebeenmade.Thepublisherremainsneutralwithregardtojurisdictional
claimsinpublishedmapsandinstitutionalaffiliations.
Coverillustrationfrom“VisualizingEyeMovementsinFormalCognitiveModels”byJ.TimothyBalint,
BradReynolds,LeslieM.Blaha,andTimHalversonwithkindpermissionbytheauthors
Printedonacid-freepaper
ThisSpringerimprintispublishedbySpringerNature
TheregisteredcompanyisSpringerInternationalPublishingAG
Theregisteredcompanyaddressis:Gewerbestrasse11,6330Cham,Switzerland
Preface
Technological advances in computer vision algorithms and sensor hardware have
greatlyreducedtheimplementationandfinancialcostsofeyetracking,makingthis
dataacquisitionmethodaccessible to a largepopulationofresearchers.Thus,itis
unsurprisingto witness a significant increase in its use as a research tool in fields
beyondthetraditionaldomainsofbiologicalvision,psychology,andneuroscience,
inparticular,invisualizationandhuman-computerinteractionresearch.Recording
theobserver’sgazecanrevealhowdynamicgraphicaldisplaysarevisuallyaccessed
anditcanshowthevisualinformationthatisrelevanttotheobserveratanygiven
pointintime.Nonetheless,standardizedpracticesfortechnicalimplementationsand
datainterpretationremainunresolved.
One of the key challengeslies in the analysis, interaction, and visualization of
complexspatio-temporaldatasetsofgazebehavior,whichisfurthercomplicatedby
complementarydatasetssuchassemanticlabels,userinteractionsand/oraccompa-
nyingphysiologicalsensorrecordings.Ultimately,theresearchobjectiveistoallow
eye-trackingdata to be effectively interpretedin terms of the observer’sdecision-
makingand cognitiveprocesses. To achieve this, it is necessary to draw upon our
currentunderstandingofgaze-behavioracrossvariousandrelatedfields,fromvision
andcognitiontovisualization.
Therefore, the analysis and visualization of such spatio-temporal gaze data—
along with additionally attached data from the stimulus or further physiological
sensorrecordings—becomesachallengingfactorinthisemergingdiscipline.From
theperspectivesofhuman-computerinteractionandcognitivescience,thiswillbe
key to a better understandingof human behavior and the cognitive processes that
underlieit,whichwouldtranslatetogenuineadvancesinuser-centeredcomputing
systems.Takentogether,thismakeseyetrackinganimportantfieldtobeunderstood,
be it in the sense of data analysis and visualization, interaction, or user-based
evaluationofvisualization.
v
vi Preface
ETVISWorkshop
To foster this growing field of eye tracking and visualization, we organized a
workshopattheIEEEVISConference(http://ieeevis.org):TheFirst Workshop on
Eye Tracking and Visualization (ETVIS). The workshop took place in Chicago,
Illinois,USA,onOctober25,2015.Itswebpageiswww.etvis.org.
Thegoalofthisworkshopwastwofold.First,weintendedtobuildacommunity
ofeye-trackingresearcherswithinthevisualizationcommunity.Sinceeye-tracking
relatedresearchhas beenconductedin informationvisualization,scientific visual-
ization,andvisualanalytics,thisworkshopservedasawayofconnectingbetween
these subfields that are represented at IEEE VIS and share a common interest
in eye tracking. Second, the workshop established connections to related fields,
in particular, to human-computer interaction, cognitive science, and psychology,
promotingthe exchangeof established practicesandinnovativeuse scenarios. We
were pleased with the interdisciplinarity of the attendees, including researchers
fromhuman-computerinteraction,psychology,cognitivescience,andeye-tracking
research to complement the traditional IEEE VIS audience. In particular, a large
portionof the attendees indicatedthat they were first-time attendeesof IEEE VIS
and that ETVIS was the reason for attending IEEE VIS 2015. Thus, we saw that
this novel initiative worked well in establishing common grounds across diverse
disciplinesandpromotinginterdisciplinarydialog.
The program of ETVIS 2015 consisted of two parts: The first part (morning
sessions) was organized as the workshop itself. The program started with the
keynote presentation by Kenneth Holmqvist (Lund University) on “Measures and
VisualizationsfromEyeMovementData.”Hepresentedacomprehensiveoverview
ofthemanydifferentmeasuresthatresearchersuseoneye-trackingdataandshowed
severalof the visualization techniquesthat have evolvedover the last 15 years. A
centralquestiontotakeawayfromhistalkis:whenisvisualizationofeyegazedata
helpfulandwhendoesitjustprovidethepeoplewhouseitwitha“wrong”senseof
understanding?Hehighlightedthisissuebyusingheatmapsasanexample,which
are particularly popular in (web) usability. He discussed interesting examples of
un-reflected uses of visualizations and the over-interpretation of heat maps. This
providedagreatstartingpointforfurtherdiscussions.
Thekeynotewasfollowedbyoralpresentationsoftheacceptedworkshoppapers.
In the afternoon, there was an accompanying meetup session to foster in-depth
and open discussions between all attendees and allow for planning for the future
of ETVIS. The success of ETVIS 2015 led us to organize a follow-up workshop
at IEEE VIS 2016: ETVIS 2016 will take place October 23, 2016, in Baltimore,
Maryland,USA.
MoreinformationabouttheETVISworkshopscanbefoundonthewebpageof
theworkshops:www.etvis.org.
Preface vii
Review Process
The chapters of this bookwere selected and revised duringa review process with
severalstages.Itstartedwithacallforshortpapers(4pagesand1additionalpage
for references) for ETVIS 2015. Submitted papers were reviewed by members of
the international program committee (IPC) of ETVIS 2015 (see the list of IPC
memberson page ix). We had 3–4 reviewsper paper. Decisions aboutacceptance
weremadebytheETVIS2015organizers,whoarealsotheeditorsofthisbook.For
submissionsthathadconflictswithsomeoftheorganizers,thereviewprocesswas
hiddenfromtheseorganizersanddecisionsweremadebytheotherorganizers.We
accepted 13 papers to the workshop. The workshop papers were not published as
archivalpapers.
For the book, we invited the ETVIS authors to submit revised and extended
versionsoftheirpapers.Inaddition,wesolicitedtwoadditionalchaptersubmissions
in order to complementthe contents and scope of the book:“A Task-Based View
on the Visual Analysis of Eye Tracking Data” (by Kurzhals et al.) as a survey
of visualization techniques for analyzing eye-tracking data, and “Unsupervised
Clustering of EOG as a Viable Substitute for Optical Eye Tracking” (Flad et al.)
as a complementary basis of data acquisition in eye-tracking experiments. All
submitted chapters were reviewed by 2–3 expert reviewers (see page ix for the
list of reviewers);for mostbookchaptersubmissions,there was(partial)reviewer
continuityfromtheETVISreviewprocess.Decisionsaboutacceptanceweremade
bytheeditorsofthisbook.Again,wetookcarethatreviewinganddecision-making
werehiddenfromeditorswithconflicts.Attheend,weaccepted12extendedETVIS
papersandthetwoadditionalchaptersforthebook.
Organization ofthisBook
The book is organized in two parts with a total of 14 chapters. The first part
covers “Visualization, Visual Analytics, and User Interfaces”. Its first chapter
provides an overview of visualization approaches toward analyzing data that is
acquiredin the contextof eye-trackingexperiments:the chapter entitled “A Task-
Based View on the Visual Analysisof Eye-TrackingData” (by Kurzhalset al.). It
includesreferencestoseveralotherchaptersofthisbooktoprovideanoverarching
perspectiveonhowvisualizationcanbeusedtoimprovetheanalysisofeye-tracking
data. The following two chapters covervisualization techniquesthat highlightthe
temporalaspectofattentionandeyemovementpatterns:“InteractiveVisualization
forUnderstandingofAttentionPatterns”(Nguyenetal.)and“TheVERPExplorer:
AToolforExploringEyeMovementsofVisual-CognitiveTasksUsingRecurrence
Plots” (Demiralp et al.). Then, Löwe et al. show gaze information in the context
of immersive video stimuli (“Gaze Visualization for Immersive Video”). Blaha
et al. describe a visual-motor analytics dashboard that supports the joint study of
viii Preface
eye movement and hand/finger movement dynamics (“Capturing You Watching
You: Characterizing Visual-Motor Dynamics in Touchscreen Interactions”). The
followingchapterintegratesthevisualizationofeye-trackingdatainthecontextof
theACT-Rcognitivearchitecture:“VisualizingEyeMovementsinFormalCognitive
Models” (Balint et al.). Then, Beck et al. discuss “Word-Sized Eye-Tracking
Visualizations” to augment transcribed recordings for protocol analysis with eye-
trackingdata. Finally, Tateosian et al. describe“GazeGIS: A Gaze-basedReading
andDynamicGeographicInformationSystem”.
The second part contains chapters that focus on “Data and Metrics”. Flad et
al.investigateelectrooculography(EOG)asanalternativeofacquiringinformation
about eye movements in the chapter on “Unsupervised Clustering of EOG as a
Viable Substitute for Optical Eye Tracking”. This is followed by a chapter on
data acquisition with opticalmonoculargaze tracking—witha focuson accuracy:
“Accuracy of Monocular Gaze Tracking on 3D Geometry” (Wang et al.). Ma et
al.applytomographymethodstoobtainadescriptionof3Dsaliency(“3DSaliency
fromEyeTrackingwithTomography”).Schulzetal.addresstheissueofincorrect
eye-tracking data and how such data can be cleaned with visualization support
(“VisualDataCleansingofLow-LevelEye-TrackingData”).Thelasttwochapters
ofthisbookdiscussmetricsforeyetracking:“VisualizingDynamicAmbient/Focal
AttentionwithCoefficientK ”(DuchowskiandKrejtz)and“EyeFixationMetrics
forLargeScaleEvaluationandComparisonofInformationVisualizations”(Bylin-
skiietal.).
We hope that this book will stimulate further research in the interdisciplinary
areaofeyetrackingandvisualization,fosteringtheinteractionbetweenresearchers
fromvisualizationandotherdisciplines.
Stuttgart,Germany MichaelBurch
Tübingen,Germany LewisChuang
Surrey,Canada BrianFisher
Stuttgart,Germany AlbrechtSchmidt
Stuttgart,Germany DanielWeiskopf
July2016
Acknowledgements
The initiative for the First Workshop on Eye Tracking and Visualization (ETVIS)
was triggered by the Collaborative Research Center SFB/Transregio 161 (“Quan-
titative Methods for Visual Computing”, www.sfbtrr161.de). We acknowledge
the financial support by the German Research Foundation (DFG) for the
SFB/Transregio161andtheorganizationofETVIS2015.
SpecialthanksgotoKunoKurzhalsforhisgreathelpinorganizingETVIS2015
andpreparingthisbookcompilation.
Reviewers andMembers oftheInternational Program
Committee
We thank the following expert reviewers for their support of ETVIS 2015 as
membersoftheinternationalprogramcommitteeand/ortheirhelpasreviewersof
theextendedbookchaptersubmissions:
NataliaAndrienko KennethHolmqvist
FlorianAlt TonyHuang
StellaAtkins PeterKiefer
TanjaBlascheck AndrewKun
AndreasBulling KunoKurzhals
ArzuÇöltekin LarsLinsen
RaimundDachselt AidongLu
LoesvanDam RadosławMantiuk
StephanDiehl RudolfNetzel
AndrewDuchowski SebastianPannasch
SteveFranconeri ThiessPfeiffer
WayneGray MarioRomero
JohnHenderson SophieStellmach
ix
