Social Emotions in Nature and Artifact

223 Pages·2013·1.69 MB·English

by  Jonathan Gratch

Social Emotions in Nature and Artifact
OXFORD SERIES ON COGNITIVE MODELS
AND ARCHITECTURES
Series Editor : Frank E. Ritter
Series Board
Rich Carlson
Gary Cottrell
Robert L. Goldstone
Eva Hudlicka
Pat Langley
Robert St. Amant
Richard M. Young
Integrated Models of Cognitive Systems
Edited by Wayne D. Gray
In Order to Learn:
How the Sequence of Topics Infl uences Learning
Edited by Frank E. Ritter, Josef Nerb,
Erno Lehtinen, and Timothy O’Shea
How Can the Human Mind Occur
in the Physical Universe?
By John R. Anderson
Principles of Synthetic Intelligence PSI:
An Architecture of Motivated Cognition
By Joscha Bach
The Multitasking Mind
By David D. Salvucci and Niels A. Taatgen
How to Build a Brain:
A Neural Architecture for Biological Cognition
By Chris Eliasmith
Minding Norms:
Mechanisms and Dynamics of Social Order in Agent Societies
Edited by Rosaria Conte, Giulia Andrighetto, and Marco Campennì
Social Emotions in Nature and Artifact
Edited by Jonathan Gratch and Stacy Marsella
Social Emotions in Nature and Artifact
Edited by Jonathan Gratch and Stacy Marsella
1
1

Oxford University Press is a department of the University of Oxford.
It furthers the University’s objective of excellence in research, scholarship,
and education by publishing worldwide.
Oxford New York
Auckland Cape Town Dar es Salaam Hong Kong Karachi
Kuala Lumpur Madrid Melbourne Mexico City Nairobi
New Delhi Shanghai Taipei Toronto
With offi ces in
Argentina Austria Brazil Chile Czech Republic France Greece
Guatemala Hungary Italy Japan Poland Portugal Singapore
South Korea Switzerland Thailand Turkey Ukraine Vietnam
Oxford is a registered trademark of Oxford University Press in the UK and certain other
countries.
Published in the United States of America by
Oxford University Press
198 Madison Avenue, New York, NY 10016
© Oxford University Press 2014
All rights reserved. No part of this publication may be reproduced, stored in a
retrieval system, or transmitted, in any form or by any means, without the prior
permission in writing of Oxford University Press, or as expressly permitted by law,
by license, or under terms agreed with the appropriate reproduction rights organization.
Inquiries concerning reproduction outside the scope of the above should be sent to the Rights
Department, Oxford University Press, at the address above.
You must not circulate this work in any other form,
and you must impose this same condition on any acquirer.
Library of Congress Cataloging-in-Publication Data
Social emotions in nature and artifact / edited by Jonathan Gratch, Stacy Marsella.
pages cm. – (Oxford series on cognitive models and architecture)
Includes bibliographical references and index.
ISBN 978–0–19–538764–3
1. Psychology—Computer simulation. 2. Emotions —Computer simulation. 3. Artifi cial intelligence. I. Gratch,
Jonathan (Jonathan Matthew), 1963– II. Marsella, Stacy.
BF39.5.S63 2014
152.4—dc23
2013008884
9780195387643
9 8 7 6 5 4 3 2 1
Printed in the United States of America on acid-free paper
Contents
Preface vii 7. Toward Effective Automatic Recognition Systems
of Emotion in Speech 110
Contributors ix
Carlos Busso, Murtaza Bulut, & Shrikanth
Narayanan
Introduction: Toward an Information Processing
Revolution in Social Emotions 1
8. The Role of Context in Affective Behavior
Jonathan Gratch & Stacy Marsella
Understanding 128
Louis-Philippe Morency
1. On the Sociality of Emotion-Eliciting Appraisals:
Two Aspects 16
9. Computational Models of Expressive Behaviors
Craig A. Smith & Leslie D. Kirby
for a Virtual Agent 143
Rados ł aw Niewiadomski, Sylwia Julia
2. Processes of Emotional Meaning and Response
Hyniewska, & Catherine Pelachaud
Coordination 29
Brian Parkinson
10. Early Emotional Communication: Novel
Approaches to Interaction 162
3. Challenge, Threat, and Social Infl uence in
Daniel S. Messinger, Mohammad H. Mahoor,
Digital Immersive Virtual Environments 44
Sy-Miin Chow, John D. Haltigan, Steven Cadavid,
Jim Blascovich
& Jeffrey F. Cohn
4. Requirements for a Process Model of Appraisal
11. Using Social Agents to Explore Theories of
From a Social Functional Perspective 55
Rapport and Emotional Resonance 181
Stacy Marsella & Jonathan Gratch
Jonathan Gratch, Sin-Hwa Kang, & Ning Wang
5. Modeling Theory of Mind and Cognitive
Index 199
Appraisal With Decision-Theoretic Agents 70
David V. Pynadath, Mei Si, & Stacy Marsella
6. Automatic Facial Expression Recognition 88
Jacob Whitehill, Marian Stewart Bartlett, &
Javier R. Movellan
v
This page intentionally left blank
Preface
W ithin emotion, social psychology and human– emotional trajectories with human participants
computer interaction research, there’s been growing (Chapters 4–9)
interest in the role of emotions in social interactions. ● Discuss computational models of social cogni-
Concepts like rapport, emotional contagion, or emer- tion that can represent and reason about the
gent emotions presuppose that people rapidly detect evolving relationship between interaction part-
nonverbal affective cues, make inferences about the ners (Chapters 4–5)
other party’s mental state, and respond in ways that ● Present the current and future potential of sens-
coconstruct an emotional trajectory between par- ing technology to reliably detect and classify
ticipants. Through this process, people can synchro- affective nonverbal cues (Chapters 6–8)
nize their thoughts and behaviors (promoting social ● Discuss the potential of computational methods
bonds, enhancing trust, and increasing communica- as tools for empirical research into human trans-
tive effi ciency), or desynchronize (establishing per- actional processes (Chapter 4)
sonal space and accentuating differences in status, ● Consider methodological approaches for assess-
power, or beliefs). Recent advances in biometrics and ing the social consequences of socioemotional
artifi cial intelligence are allowing computer systems systems (Chapters 10–11)
to engage in this nonverbal dance, on the one hand
opening a wealth of possibilities for human–machine
systems, and on the other, creating powerful new tools Intended Audience
for behavioral science research. This book reports on
the state of the art in both social science theory and The book has several relevant audiences. It is primarily
computational methods and illustrates how these two addressed to researchers working at the intersection of
fi elds, together, can both facilitate and illuminate social psychology and computing, including such sci-
human social processes. entifi c disciplines as affective computing, human–com-
The book has several aims: puter interaction, human–robot interaction, behavioral
economics, cognitive modeling, computational social
● Present current social science theories of social science, and artifi cial intelligence. It should also appeal
emotions from cognitive, biological, social, and to researchers in emotion and social psychology, espe-
developmental perspectives (Chapters 1–3, 10) cially those interested in using computer technology as
● Strengthen the theoretical foundation for build- a methodological tool for empirical research. The book
ing computational systems that coconstruct capitalizes on recent interest in affective science.
vii
This page intentionally left blank
Contributors
Marian Stewart Bartlett John D. Haltigan
Institute for Neural Computation University of North Carolina
University of California Greensboro, NC
San Diego, CA
Sylwia Julia Hyniewska
Jim Blascovich Universit é de Gen è ve, FPSE, and
Department of Psychological and Brain Sciences and TSI, Telecom ParisTech
Research Center for Virtual Environments and Paris, France
Behavior
University of California, Santa Barbara Sin-Hwa Kang
Institute for Creative Technologies
Murtaza Bulut University of Southern California
Philips Research Los Angeles, CA
Eindhoven, Netherlands
Leslie D. Kirby
Carlos Busso Department of Psychology
The University of Texas at Dallas Vanderbilt University
Nashville, TN
Steven Cadavid
Department of Electrical and Computer Engineering Mohammad H. Mahoor
University of Miami Department of Electrical and Computer Engineering
University of Denver
Sy-Miin Chow Denver, CO
University of North Carolina
Chapel Hill, NC Stacy Marsella
Institute for Creative Technologies
Jeffrey F. Cohn University of Southern California
Los Angeles, CA
University of Pittsburgh and
Carnegie Mellon University
Pittsburgh, PA Daniel S. Messinger
University of Miami
Jonathan Gratch Miami, FL
Institute for Creative Technologies
University of Southern California
Los Angeles, CA
ix