Context Aware Human-Robot and Human-Agent Interaction

301 Pages·2016·14.09 MB·English

by  Nadia Magnenat-Thalmann

Human–Computer Interaction Series
Nadia Magnenat-Thalmann
Junsong Yuan
Daniel Thalmann
Bum-Jae You Editors
Context Aware
Human-Robot
and
Human-Agent
Interaction
–
Human Computer Interaction Series
Editors-in-chief
Desney Tan
Microsoft Research, USA
Jean Vanderdonckt
Université catholique de Louvain, Belgium
HCI is a multidisciplinary field focused on human aspects of the development of
computer technology. As computer-based technology becomes increasingly
pervasive—not just in developed countries, but worldwide—the need to take a
human-centered approach in the design and development of this technology
becomes ever more important. For roughly 30 years now, researchers and
practitioners in computational and behavioral sciences have worked to identify
theory and practice that influences the direction of these technologies, and this
diverse work makes up the field of human-computer interaction. Broadly speaking
it includes the study of what technology might be able to do for people and how
people might interact with the technology. The HCI series publishes books that
advancethescienceandtechnologyofdevelopingsystemswhicharebotheffective
and satisfying for people in a wide variety of contexts. Titles focus on theoretical
perspectives (such as formal approaches drawn from a variety of behavioral
sciences), practical approaches (such as the techniques for effectively integrating
user needs in system development), and social issues (such as the determinants of
utility, usability and acceptability).
Titles published within the Human–Computer Interaction Series are included in
ThomsonReuters’BookCitationIndex,TheDBLPComputerScienceBibliography
and The HCI Bibliography.
More information about this series at http://www.springer.com/series/6033
Nadia Magnenat-Thalmann
Junsong Yuan Daniel Thalmann
(cid:129)
Bum-Jae You
Editors
Context Aware Human-
Robot and Human-Agent
Interaction
123
Editors
Nadia Magnenat-Thalmann DanielThalmann
Institute for Media Innovation, SCE Institute for Media Innovation, SCE
NanyangTechnological University NanyangTechnological University
Singapore Singapore
Singapore Singapore
JunsongYuan Bum-JaeYou
Institute for Media Innovation, EEE Centerof HCI for Coexistence
NanyangTechnological University Korea Institute of Science andTechnology
Singapore Seoul
Singapore SouthKorea
ISSN 1571-5035
Human–Computer Interaction Series
ISBN978-3-319-19946-7 ISBN978-3-319-19947-4 (eBook)
DOI 10.1007/978-3-319-19947-4
LibraryofCongressControlNumber:2015942809
SpringerChamHeidelbergNewYorkDordrechtLondon
©SpringerInternationalPublishingSwitzerland2016
Thisworkissubjecttocopyright.AllrightsarereservedbythePublisher,whetherthewholeorpart
of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations,
recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission
orinformationstorageandretrieval,electronicadaptation,computersoftware,orbysimilarordissimilar
methodologynowknownorhereafterdeveloped.
The use of general descriptive names, registered names, trademarks, service marks, etc. in this
publicationdoesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfrom
therelevantprotectivelawsandregulationsandthereforefreeforgeneraluse.
The publisher, the authors and the editors are safe to assume that the advice and information in this
book are believed to be true and accurate at the date of publication. Neither the publisher nor the
authorsortheeditorsgiveawarranty,expressorimplied,withrespecttothematerialcontainedhereinor
foranyerrorsoromissionsthatmayhavebeenmade.
Printedonacid-freepaper
SpringerInternationalPublishingAGSwitzerlandispartofSpringerScience+BusinessMedia
(www.springer.com)
Preface
ThisbookisthefirstbooktodescribehowAutonomousVirtualHumansandSocial
Robotscaninteractwithrealpeople,beawareofthesepeopleandtheenvironment
and react to various situations. The book explains the main techniques for the
trackingandtheanalysisofhumansandtheirbehaviourincludingfacialexpressions,
bodyandhandgesturesandsoundlocalization.Itexplainshowthevirtualhumanand
thesocialrobotshouldreactattherighttimebasedontheperceptiontheyhavefrom
the real participants. It describes how to create socially interactive behaviour gen-
eration forvirtualcharactersandsocial robotsusingthesame modalities ashuman
do:verbal,bodygestures,facialexpressionsandgaze.Thebookalsodiscusseshowa
virtualhumanorasocialrobotcanreplacearealhumaninaremotelocation.
The contributors of this book are international experts in the field. Several
of them come from different institutes/schools in Nanyang Technological
University(NTU)inSingapore:InstituteforMediaInnovation,SchoolofElectrical
and Electronic Engineering, and School of Art, Design and Media. Three chapters
have contributorsfrom thewell-known Korea Institute ofScience and Technology
in Seoul. Other contributors are from France and China. In total, more than 100
researchers have contributed to this book.
Thisbookispartlytheresultoftwolargeongoingprojectsdevelopedintwomain
centres:theCentreofHuman-centredInteractionforCoexistenceinSeoulatKorea
Institute of Science and Technology (KIST) and the BeingThere Center (BTC) in
NTU in Singapore. The research done by the authors in the BeingThere Centre in
NTU is supported by the Singapore National Research Foundation under its
International Research Centre Funding Initiative and administered by the IDM
Programme. The research done at the Korea Institute of Science and Technology
(KIST)issupportedbytheMinistryofEducation,ScienceandTechnologyinKorea.
Singapore Nadia Magnenat-Thalmann
Singapore Junsong Yuan
Singapore Daniel Thalmann
South Korea Bum-Jae You
January 2015
v
Contents
Part I User Understanding Through Multisensory Perception
1 Face and Facial Expressions Recognition and Analysis. . . . . . . . . 3
Jianfeng Ren, Xudong Jiang and Junsong Yuan
2 Body Movement Analysis and Recognition. . . . . . . . . . . . . . . . . . 31
Yang Xiao, Hui Liang, Junsong Yuan and Daniel Thalmann
3 Sound Source Localization and Tracking. . . . . . . . . . . . . . . . . . . 55
Kai Wu and Andy W.H. Khong
Part II Facial and Body Modelling Animation
4 Modelling Conversation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81
Martin Constable, Justin Dauwels, Shoko Dauwels,
Rasheed Umer, Mengyu Zhou and Yasir Tahir
5 Personalized Body Modeling. . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
Hyewon Seo
6 Parameterized Facial Modelling and Animation. . . . . . . . . . . . . . 133
Junghyun Cho, Heeseung Choi, Sang Chul Ahn and Ig-Jae Kim
7 Motion-Based Learning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151
Il Hong Suh and Sang Hyoung Lee
8 Responsive Motion Generation . . . . . . . . . . . . . . . . . . . . . . . . . . 175
Sukwon Lee and Sung-Hee Lee
vii
viii Contents
9 Shared Object Manipulation. . . . . . . . . . . . . . . . . . . . . . . . . . . . 191
Jun Lee, Nadia Magnenat-Thalmann and Daniel Thalmann
Part III Modelling Human Behaviours
10 Modeling Personality, Mood, and Emotions. . . . . . . . . . . . . . . . . 211
Juzheng Zhang, Jianmin Zheng and Nadia Magnenat-Thalmann
11 Motion Control for Social Behaviors . . . . . . . . . . . . . . . . . . . . . . 237
Aryel Beck, Zhang Zhijun and Nadia Magnenat-Thalmann
12 Multiple Virtual Human Interactions. . . . . . . . . . . . . . . . . . . . . . 257
Samuel Lemercier and Daniel Thalmann
13 Multimodal and Multi-party Social Interactions. . . . . . . . . . . . . . 275
Zerrin Yumak and Nadia Magnenat-Thalmann
Contributors
Sang Chul Ahn Centre of Human-centred Interaction for Coexistence, Korea
Institute of Science and Technology, Seoul, Korea
Aryel Beck BeingThere Centre, Nanyang Technological University, Singapore,
Singapore
Junghyun Cho Centre of Human-centred Interaction for Coexistence, Korea
Institute of Science and Technology, Seoul, Korea
Heeseung Choi Centre of Human-centred Interaction for Coexistence, Korea
Institute of Science and Technology, Seoul, Korea
XudongJiang BeingThereCentre,NanyangTechnologicalUniversity,Singapore,
Singapore
Justin Dauwels BeingThere Centre, Nanyang Technological University,
Singapore, Singapore
Andy W.H. Khong BeingThere Centre, Nanyang Technological University,
Singapore, Singapore
Ig-JaeKim CentreofHuman-centred InteractionforCoexistence,KoreaInstitute
of Science and Technology, Seoul, Korea
Jun Lee BeingThere Centre, Nanyang Technological University, Singapore,
Singapore
Sang Hyoung Lee Hanyang University, Seoul, Korea
SukwonLee KoreaAdvancedInstituteofScienceandTechnology,Daejon,Korea
Sung-Hee Lee Korea Advanced Institute of Science and Technology, Daejon,
Korea
Samuel Lemercier BeingThere Centre, Nanyang Technological University,
Singapore, Singapore
ix
x Contributors
Hui Liang BeingThere Centre, Nanyang Technological University, Singapore,
Singapore
Nadia Magnenat-Thalmann BeingThere Centre, Nanyang Technological
University, Singapore, Singapore
Constable Martin BeingThere Centre, Nanyang Technological University,
Singapore, Singapore
Mengyu Zhou BeingThere Centre, Nanyang Technological University,
Singapore, Singapore
Rasheed Umer BeingThere Centre, Nanyang Technological University,
Singapore, Singapore
JianfengRen BeingThereCentre,NanyangTechnologicalUniversity,Singapore,
Singapore
Hyewon Seo CNRS-University of Strasbourg, Strasbourg, France
Shoko Dauwels BeingThere Centre, Nanyang Technological University,
Singapore, Singapore
Il Hong Suh Hanyang University, Seoul, Korea
Daniel Thalmann BeingThere Centre, Nanyang Technological University,
Singapore, Singapore
Kai Wu BeingThere Centre, Nanyang Technological University, Singapore,
Singapore
Yang Xiao School of Automation, Huazhong University of Science and
Technology, Wuhan, China
Yasir Tahir BeingThere Centre, Nanyang Technological University, Singapore,
Singapore
Junsong Yuan BeingThere Centre, Nanyang Technological University,
Singapore, Singapore
Zerrin Yumak BeingThere Centre, Nanyang Technological University,
Singapore, Singapore
Juzheng Zhang BeingThere Centre, Nanyang Technological University,
Singapore, Singapore
Jianmin Zheng BeingThere Centre, Nanyang Technological University,
Singapore, Singapore
ZhangZhijun BeingThereCentre,NanyangTechnologicalUniversity,Singapore,
Singapore