Table Of ContentSignals and Communication Technology
Alexander Rudnicky
Antoine Raux
Ian Lane
Teruhisa Misu Editors
Situated Dialog
in Speech-
Based Human-
Computer
Interaction
Signals and Communication Technology
More information about this series at http://www.springer.com/series/4748
Alexander Rudnicky Antoine Raux
(cid:129)
Ian Lane Teruhisa Misu
(cid:129)
Editors
Situated Dialog
in Speech-Based
Human-Computer
Interaction
123
Editors
Alexander Rudnicky IanLane
Schoolof Computer Science Carnegie MellonUniversity
Carnegie MellonUniversity Silicon Valley
Pittsburgh, PA Moffett Field,CA
USA USA
AntoineRaux Teruhisa Misu
Cupertino, CA Mountain View,CA
USA USA
ISSN 1860-4862 ISSN 1860-4870 (electronic)
Signals andCommunication Technology
ISBN978-3-319-21833-5 ISBN978-3-319-21834-2 (eBook)
DOI 10.1007/978-3-319-21834-2
LibraryofCongressControlNumber:2015949507
SpringerChamHeidelbergNewYorkDordrechtLondon
©SpringerInternationalPublishingSwitzerland2016
Thisworkissubjecttocopyright.AllrightsarereservedbythePublisher,whetherthewholeorpart
of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations,
recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission
orinformationstorageandretrieval,electronicadaptation,computersoftware,orbysimilarordissimilar
methodologynowknownorhereafterdeveloped.
The use of general descriptive names, registered names, trademarks, service marks, etc. in this
publicationdoesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfrom
therelevantprotectivelawsandregulationsandthereforefreeforgeneraluse.
The publisher, the authors and the editors are safe to assume that the advice and information in this
book are believed to be true and accurate at the date of publication. Neither the publisher nor the
authorsortheeditorsgiveawarranty,expressorimplied,withrespecttothematerialcontainedhereinor
foranyerrorsoromissionsthatmayhavebeenmade.
Printedonacid-freepaper
SpringerInternationalPublishingAGSwitzerlandispartofSpringerScience+BusinessMedia
(www.springer.com)
Contents
Part I Dialog Management and Spoken Language Processing
Evaluation of Statistical POMDP-Based Dialogue Systems
in Noisy Environments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Steve Young, Catherine Breslin, Milica Gašić, Matthew Henderson,
Dongho Kim, Martin Szummer, Blaise Thomson, Pirros Tsiakoulis
and Eli Tzirkel Hancock
Syntactic Filtering and Content-Based Retrieval of Twitter Sentences
for the Generation of System Utterances in Dialogue Systems. . . . . . . . 15
Ryuichiro Higashinaka, Nozomi Kobayashi, Toru Hirano,
Chiaki Miyazaki, Toyomi Meguro, Toshiro Makino
and Yoshihiro Matsuo
Knowledge-Guided Interpretation and Generation
of Task-Oriented Dialogue . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
Alfredo Gabaldon, Pat Langley, Ben Meadows and Ted Selker
Justification and Transparency Explanations in Dialogue Systems
to Maintain Human-Computer Trust. . . . . . . . . . . . . . . . . . . . . . . . . . 41
Florian Nothdurft and Wolfgang Minker
Dialogue Management for User-Centered Adaptive Dialogue . . . . . . . . 51
Stefan Ultes, Hüseyin Dikme and Wolfgang Minker
Chat-Like Conversational System Based on Selection
of Reply Generating Module with Reinforcement Learning. . . . . . . . . . 63
Tomohide Shibata, Yusuke Egashira and Sadao Kurohashi
Investigating Critical Speech Recognition Errors in Spoken
Short Messages. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
Aasish Pappu, Teruhisa Misu and Rakesh Gupta
v
vi Contents
Part II Human Interaction with Dialog Systems
The HRI-CMU Corpus of Situated In-Car Interactions . . . . . . . . . . . . 85
David Cohen, Akshay Chandrashekaran, Ian Lane
and Antoine Raux
Detecting ‘Request Alternatives’ User Dialog Acts
from Dialog Context. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
Yi Ma and Eric Fosler-Lussier
Emotion and Its Triggers in Human Spoken Dialogue:
Recognition and Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103
Nurul Lubis, Sakriani Sakti, Graham Neubig, Tomoki Toda,
Ayu Purwarianti and Satoshi Nakamura
Evaluation of In-Car SDS Notification Concepts for Incoming
Proactive Events. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111
Hansjörg Hofmann, Mario Hermanutz, Vanessa Tobisch,
Ute Ehrlich, André Berton and Wolfgang Minker
Construction and Analysis of a Persuasive Dialogue Corpus. . . . . . . . . 125
Takuya Hiraoka, Graham Neubig, Sakriani Sakti, Tomoki Toda
and Satoshi Nakamura
Evaluating Model that Predicts When People Will Speak
to a Humanoid Robot and Handling Variations of Individuals
and Instructions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139
Takaaki Sugiyama, Kazunori Komatani and Satoshi Sato
Entrainment in Pedestrian Direction Giving: How Many
Kinds of Entrainment? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 151
Zhichao Hu, Gabrielle Halberg, Carolynn R. Jimenez
and Marilyn A. Walker
Situated Interaction in a Multilingual Spoken Information
Access Framework . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 165
Niklas Laxström, Kristiina Jokinen and Graham Wilcock
Part III Speech Recognition and Core Technologies
A Turbo-Decoding Weighted Forward-Backward Algorithm
for Multimodal Speech Recognition. . . . . . . . . . . . . . . . . . . . . . . . . . . 179
Simon Receveur, David Scheler and Tim Fingscheidt
Engine-Independent ASR Error Management for Dialog Systems. . . . . 193
Junhwi Choi, Donghyeon Lee, Seounghan Ryu, Kyusong Lee,
Kyungduk Kim, Hyungjong Noh and Gary Geunbae Lee
Contents vii
Restoring Incorrectly Segmented Keywords and Turn-Taking
Caused by Short Pauses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205
Kazunori Komatani, Naoki Hotta and Satoshi Sato
A Semi-automated Evaluation Metric for Dialogue
Model Coherence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 217
Sudeep Gandhe and David Traum
Part I
Dialog Management and Spoken
Language Processing
Evaluation of Statistical POMDP-Based
Dialogue Systems in Noisy Environments
SteveYoung,CatherineBreslin,MilicaGašic´,MatthewHenderson,
DonghoKim,MartinSzummer,BlaiseThomson,PirrosTsiakoulis
andEliTzirkelHancock
Abstract Comparedtoconventionalhand-craftedrule-baseddialoguemanagement
systems,statisticalPOMDP-baseddialoguemanagersofferthepromiseofincreased
robustness, reduced development and maintenance costs, and scaleability to large
open-domains. As a consequence, there has been considerable research activity in
approachestostatisticalspokendialoguesystemsoverrecentyears.However,build-
inganddeployingareal-timespokendialoguesystemisexpensive,andevenwhen
operational,itishardtorecruitsufficientuserstogetstatisticallysignificantresults.
Instead,researchershavetendedtoevaluateusingusersimulatorsorbyreprocess-
ingexistingcorpora,bothofwhichareunconvincingpredictorsofactualrealworld
performance.Thispaperdescribesthedeploymentofareal-worldrestaurantinfor-
mation system and its evaluation in a motor car using subjects recruited locally
andbyremoteusersrecruitedusingAmazonMechanicalTurk.Thepaperexplores
threekeyquestions:arestatisticaldialoguesystemsmorerobustthanconventional
hand-crafted systems; how does the performance of a system evaluated on a user
simulatorcomparetoperformancewithrealusers;andcanperformanceofasystem
tested over the telephone network be used to predict performance in more hostile
environments such as a motor car? The results show that the statistical approach
isindeedmorerobust,butresultsfromasimulatorsignificantlyover-estimateper-
formancebothabsoluteandrelative.Finally,bymatchingWERrates,performance
results obtained over the telephone can provide useful predictors of performance
innoisierenvironmentssuchasthemotorcar,butagaintheytendtoover-estimate
performance.
B
S.Young ( )·C.Breslin·M.Gašic´·M.Henderson·D.Kim·M.Szummer·
B.Thomson·P.Tsiakoulis
CambridgeUniversityEngineeringDepartment,Cambridge,UK
e-mail:[email protected]
E.T.Hancock
GeneralMotorsAdvancedTechnicalCenter,Herzliya,Israel
e-mail:[email protected]
©SpringerInternationalPublishingSwitzerland2016 3
A.Rudnickyetal.(eds.),SituatedDialoginSpeech-Based
Human-ComputerInteraction,SignalsandCommunicationTechnology,
DOI10.1007/978-3-319-21834-2_1
