Table Of ContentLecture Notes in Artificial Intelligence 6895
Subseries of Lecture Notes in Computer Science
LNAISeriesEditors
RandyGoebel
UniversityofAlberta,Edmonton,Canada
YuzuruTanaka
HokkaidoUniversity,Sapporo,Japan
WolfgangWahlster
DFKIandSaarlandUniversity,Saarbrücken,Germany
LNAIFoundingSeriesEditor
JoergSiekmann
DFKIandSaarlandUniversity,Saarbrücken,Germany
Hannes Högni Vilhjálmsson
Stefan Kopp Stacy Marsella
Kristinn R. Thórisson (Eds.)
Intelligent
Virtual Agents
11th International Conference, IVA 2011
Reykjavik, Iceland, September 15-17, 2011
Proceedings
1 3
SeriesEditors
RandyGoebel,UniversityofAlberta,Edmonton,Canada
JörgSiekmann,UniversityofSaarland,Saarbrücken,Germany
WolfgangWahlster,DFKIandUniversityofSaarland,Saarbrücken,Germany
VolumeEditors
HannesHögniVilhjálmsson
ReykjavikUniversity,Iceland
E-mail:[email protected]
StefanKopp
BielefeldUniversity,Germany
E-mail:[email protected]
StacyMarsella
UniversityofSouthernCalifornia,PlayaVista,CA,USA
E-mail:[email protected]
KristinnR.Thórisson
ReykjavikUniversity,Iceland
E-mail:[email protected]
ISSN0302-9743 e-ISSN1611-3349
ISBN978-3-642-23973-1 e-ISBN978-3-642-23974-8
DOI10.1007/978-3-642-23974-8
SpringerHeidelbergDordrechtLondonNewYork
LibraryofCongressControlNumber:2011935934
CRSubjectClassification(1998):I.2,I.2.11,H.4-5,D.2,I.4,I.6
LNCSSublibrary:SL7–ArtificialIntelligence
©Springer-VerlagBerlinHeidelberg2011
Thisworkissubjecttocopyright.Allrightsarereserved,whetherthewholeorpartofthematerialis
concerned,specificallytherightsoftranslation,reprinting,re-useofillustrations,recitation,broadcasting,
reproductiononmicrofilmsorinanyotherway,andstorageindatabanks.Duplicationofthispublication
orpartsthereofispermittedonlyundertheprovisionsoftheGermanCopyrightLawofSeptember9,1965,
initscurrentversion,andpermissionforusemustalwaysbeobtainedfromSpringer.Violationsareliable
toprosecutionundertheGermanCopyrightLaw.
Theuseofgeneraldescriptivenames,registerednames,trademarks,etc.inthispublicationdoesnotimply,
evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevantprotectivelaws
andregulationsandthereforefreeforgeneraluse.
Typesetting:Camera-readybyauthor,dataconversionbyScientificPublishingServices,Chennai,India
Printedonacid-freepaper
SpringerispartofSpringerScience+BusinessMedia(www.springer.com)
Preface
Welcome to the proceedings of the 11th International Conference on Intelligent
Virtual Agents. While this conference represents a field of specialization within
computer science and artificial intelligence, it celebrates an endeavor that re-
quires the integration of knowledge, methodologies and theories from a wide
range of fields such as sociology,psychology,linguistic, cognitive science and in-
teractivemedia.The visionis bold:essentiallycreateourownlikenessinsilicon.
Intelligent virtual agents are animated characters that not only move, but also
exhibit human-like competence when dealing with the world around them, be
it virtual or real. In particular these agents communicate with humans or with
each other using natural human modalities such as speech and gesture. They
are capable of real-time perception, cognition and action that allows them to
participate autonomously in dynamic social environments.
Intelligent virtual agents are not built overnight or by lone practitioners.
These are complex systems, built layer by layer, integrating numerous com-
ponents that address important functions suchas visualobject tracking,speech
recognition,perceptualmemory,languageunderstanding,reactivebehavior,rea-
soning, planning, action scheduling and articulation. Advances are made by
sharing knowledge, components and techniques. Therefore the annual IVA con-
ference is central to advancing the state of the art. It is an interdisciplinary
forumforpresentingresearchonmodeling,developingandevaluatingIVAswith
a focus on communicative abilities and social behavior.
IVAwasstartedin1998asaworkshopattheEuropeanConferenceonArtifi-
cialIntelligenceonIntelligentVirtualEnvironmentsinBrighton,UK,whichwas
followedby a similar one in 1999in Salford,Manchester.Then dedicatedstand-
alone IVA conferences took place in Madrid, Spain, in 2001, Irsee, Germany,
in 2003, and Kos, Greece, in 2005. Since 2006 IVA has become a full-fledged
annual international event, which was first held in Marina del Rey, California,
then Paris, France, in 2007, Tokyo, Japan, in 2008, Amsterdam, The Nether-
lands,in 2009andPhiladelphia,Pennsylvania,in 2010.Since 2005IVA has also
hosted the Gathering of Animated Lifelike Agents (GALA), a festival to show-
case state-of-the-artagents createdby students, academic or industrial research
groups. This year’s conference in Reykjavik, Iceland, represented a range of ex-
pertise,fromdifferentscientificandartisticdisciplines,andhighlightedthevalue
of both theoretical and practical work needed to bring intelligent virtual agents
to life.
The special topic of IVA 2011 was language and culture. These are the very
things that make us uniquely human and represent the knowledge that gets
passed from generation to generation. This knowledge is also being passed on
to our virtual humans, incidentally or by design, and therefore these agents
never merely exist in a cultural vacuum. By default, the agents may end up
VI Preface
reflecting the culture of their creators, which may need to be acknowledged
when deployed elsewhere. But culture and language can also be deliberately
manipulated, for example to create agents for training, heritage preservation or
cross-cultural communication. Some of the papers in these proceedings address
the topic directly, but we encourage readers to be aware of the linguistic and
cultural background that each agent brings with it.
IVA 2011 received altogether 91 submissions. Out of the 69 long paper sub-
missions, only 18 were accepted for the long papers track. Furthermore, there
were 27 short papers presented in the single-track paper session, and 25 demo
and poster papers were on display. IVA continues to develop and improve the
anonymousreviewingprocess,andthis yeara specialauthorrebuttalphase was
introducedforthefirsttime.Webelievethatthisresultedinmoreinformedfinal
reviews and therefore is something IVA will continue to use. Another novelty at
IVA 2011 was the digital-only distribution of the conference proceedings.While
reducing cost and bulk, not to mention the carbon footprint, the proceedings
still retain full standing in the Springer series. More and more conferences are
adopting this approach,which probably will stay with IVA in the future.
IVA 2011 was locally organized by the Center for Analysis and Design of
Intelligent Agents (CADIA) at Reykjavik University and the Icelandic Institute
for Intelligent Machines (IIIM), with the generous support of the Cognitive In-
teraction Technology Center of Excellence (CITEC) at Bielefeld University and
the Institute forCreativeTechnologies(ICT) atthe UniversityofSouthernCal-
ifornia. We would like to wholeheartedly thank the scientific committees that
helped shape a quality conference program, the Senior Program Committee for
taking on great responsibility and the Program Committee for their time and
genuineeffort.We alsowanttothankourkeynotespeakersforcrossingdomains
and sharing their insights with us. Furthermore, we would like to express great
appreciationfortheworkputinbyYngviBjo¨rnssonthatoversawtheposterand
demosession,andbyourtirelessstudentvolunteersandtheircoordinatorAngelo
Cafaro that kept everything running smoothly. We are grateful for the charac-
ter graphic designs contributed by Gunnar Steinn Valgar sson and the timely
(cid:0)
conference system support from Thomas Preuss. Lydia Eichelmann helped to
assemble the proceedings book. Finally, we would like to express deep gratitude
to Ragnhei ur Stefa´nsdo´ttir of RS Travel Solutions, who managed everything
(cid:0)
from registration and financials to decoration and local travel logistics.
OfcourseIVA2011wouldnothavebeenpossiblewithoutthevaluablecontri-
butions of the authors, whose dedication extends beyond the creation of intelli-
gentvirtualagentstothe creationandsupportofavibrantresearchcommunity
that nurtures our passion for the field.
September 2011 Hannes H¨ogni Vilhja´lmsson
Stefan Kopp
Stacy Marsella
Kristinn R. Th´orisson
Organization
Reviewers
Maria Arinbjarnar Daniel Kudenko Nadine Pfeiffer-Lessman
Christian Becker-Asano Brent Lance Hannes Pirker
Kirsten Bergmann Jina Lee Paul Piwek
Nadia Berthouze James Lester Rui Prada
Hendrik Buschmeier Benjamin Lok Scott Prevost
Yiorgos Chrysanthou Mary Lou Maher David Pynadath
Nicolas Courty Brian Magerko Stefan Rank
Morteza Dehghani Andrew Marriott Matthias Rehm
Carlos Delgado-Mata Stacy Marsella Dennis Reidsma
Zhigang Deng Carlos Martinho David Roberts
Frank Dignum Jean-Claude Martin Nicolas Sabouret
Arjan Egges Masood Masoodian Kenji Sagae
Birgit Endrass David Moffat Magy Seif El-Nasr
Friederike Eyssel Louis-Philippe Morency Ari Shapiro
Patrick Gebhard Hideyuki Nakanishi Mei Si
Sylvie Gibet Radoslaw Niewiadomski Candy Sidner
Marco Gillies Anton Nijholt Ulrike Spierling
Agneta Gulz Toyoaki Nishida Matthew Stone
Steffi Heidig Magalie Ochs Demetri Terzopoulos
Alexis Heloir Patrick Olivier Daniel Thalmann
Jesus Ibanez Jeff Orkin Mari¨et Theune
Mitsuru Ishizuka Igor Pandzic David Traum
Marcelo Kallmann Sabine Payr Hannes Vilhj´almsson
Stefan Kopp Christopher Peters Vinoba
Nicole Kra¨mer Paolo Petta Vinayagamoorthy
Brigitte Krenn Laura Pfeifer Marilyn Walker
Michael Kriegel Thies Pfeiffer Ning Wang
Table of Contents
Social and Dramatic Interaction
Culture-Related Topic Selection in Small Talk Conversations across
Germany and Japan.............................................. 1
Birgit Endrass, Yukiko Nakano, Afia Akhter Lipi,
Matthias Rehm, and Elisabeth Andr´e
“I Like Your Shirt” - Dialogue Acts for Enabling Social Talk in
ConversationalAgents............................................ 14
Tina Klu¨wer
Virtual Clones: Data-Driven Social Navigation....................... 28
Doron Friedman and Peleg Tuchman
Tilt Riders: Improvisational Agents Who Know What the Scene Is
about .......................................................... 35
Ant´onio Brisson, Brian Magerko, and Ana Paiva
Digital Improvisational Theatre: Party Quirks ....................... 42
Brian Magerko, Christopher DeLeon, and Peter Dohogne
Where to Sit? The Study and Implementation of Seat Selection in
Public Places.................................................... 48
Elin Carstensdottir, Kristin Gudmundsdottir,
Gunnar Valgardsson, and Hannes Vilhjalmsson
Guides and Relational Agents
Relational Agents Improve Engagement and Learning in Science
Museum Visitors................................................. 55
Timothy Bickmore, Laura Pfeifer, and Daniel Schulman
Virtual Rapport 2.0 .............................................. 68
Lixing Huang, Louis-Philippe Morency, and Jonathan Gratch
It’s in Their Eyes: A Study on Female and Male Virtual Humans’
Gaze ........................................................... 80
Philipp Kulms, Nicole C. Kra¨mer, Jonathan Gratch, and Sin-Hwa
Kang
Get Involved in an Interactive Virtual Tour of Brest Harbour: Follow
the Guide and Participate......................................... 93
Mukesh Barange, Pierre De Loor, Vincent Louis, Ronan Querrec,
Julien Soler, Thanh-Hai Trinh, E´ric Maisel, and Pierre Chevaillier
X Table of Contents
Using Virtual Tour Behavior to Build Dialogue Models for Training
Review ......................................................... 100
Antonio Roque, Dusan Jan, Mark Core, and David Traum
Posture, Relationship, and Discourse Structure: Models of Nonverbal
Behavior for Long-Term Interaction ................................ 106
Daniel Schulman and Timothy Bickmore
Nonverbal Behavior
Sign Language Avatars: Animation and Comprehensibility ............ 113
Michael Kipp, Alexis Heloir, and Quan Nguyen
How to Train Your Avatar: A Data Driven Approach to Gesture
Generation...................................................... 127
Chung-Cheng Chiu and Stacy Marsella
Nonverbal Action Selection for Explanations Using an Enhanced
Behavior Net .................................................... 141
Javier Snaider, Andrew M. Olney, and Natalie Person
Providing Gender to Embodied ConversationalAgents................ 148
Marco Vala, Gabriel Blanco, and Ana Paiva
Modeling Gaze Behavior for Virtual Demonstrators .................. 155
Yazhou Huang, Justin L. Matthews, Teenie Matlock, and
Marcelo Kallmann
A Framework for Motion Based Bodily Enaction with Virtual
Characters ...................................................... 162
Roberto Pugliese and Klaus Lehtonen
Adaptation and Coordination
Towards Conversational Agents That Attend to and Adapt to
Communicative User Feedback..................................... 169
Hendrik Buschmeier and Stefan Kopp
Quid Pro Quo? Reciprocal Self-disclosure and Communicative
Accomodation towards a Virtual Interviewer ........................ 183
Astrid M. von der Pu¨tten, Laura Hoffmann, Jennifer Klatt, and
Nicole C. Kra¨mer
Creating Familiarity through Adaptive Behavior Generation in
Human-Agent Interaction ......................................... 195
Ramin Yaghoubzadeh and Stefan Kopp
Contextual Affordances for Intelligent Virtual Characters ............. 202
Frederick W.P. Heckel and G. Michael Youngblood
Table of Contents XI
Negotiations in the Context of AIDS Prevention: An Agent-Based
Model Using Theory of Mind ...................................... 209
Jennifer Klatt, Stacy Marsella, and Nicole C. Kra¨mer
Listening and Feedback
Towards More Comprehensive Listening Behavior: Beyond the Bobble
Head ........................................................... 216
Zhiyang Wang, Jina Lee, and Stacy Marsella
Backchannels:Quantity, Type and Timing Matters................... 228
Ronald Poppe, Khiet P. Truong, and Dirk Heylen
Modeling Side Participants and Bystanders: The Importance of Being
a Laugh Track................................................... 240
Jina Lee and Stacy Marsella
Appropriate and Inappropriate Timing of Listener Responses from
Multiple Perspectives............................................. 248
Iwan de Kok and Dirk Heylen
Identifying Utterances Addressed to an Agent in Multiparty
Human–Agent Conversations ...................................... 255
Naoya Baba, Hung-Hsuan Huang, and Yukiko I. Nakano
Estimating a User’s Conversational Engagement Based on Head Pose
Information ..................................................... 262
Ryota Ooko, Ryo Ishii, and Yukiko I. Nakano
Frameworks and Tools
Demonstrating and Testing the BML Compliance of BML Realizers .... 269
Herwin van Welbergen, Yuyu Xu, Marcus Thiebaux, Wei-Wen Feng,
Jingqiao Fu, Dennis Reidsma, and Ari Shapiro
Robots Meet IVAs: A Mind-Body Interface for Migrating Artificial
Intelligent Agents ................................................ 282
Michael Kriegel, Ruth Aylett, Pedro Cuba, Marco Vala, and
Ana Paiva
Multimodal Plan Representation for Adaptable BML Scheduling....... 296
Dennis Reidsma, Herwin van Welbergen, and Job Zwiers
Towards the Rapid Development of a Natural Language Understanding
Module ......................................................... 309
Catarina Moreira, Ana Cristina Mendes, Lu´ısa Coheur, and
Bruno Martins
