Table Of ContentProbing Experience
From Assessment of User Emotions and Behaviour
to Development of Products
Philips Research
VOLUME 8
Editor-in-Chief
Dr. Frank Toolenaar
Philips Research Laboratories Eindhoven The Netherlands
SCOPE TO THE ‘PHILIPS RESEARCH BOOK SERIES’
As one of the largest private sector research establishments in the world, Philips
Research is shaping the future with technology inventions that meet peoples’ needs
and desires in the digital age. While the ultimate user benefi ts of these inventions end
up on the high-streeet shelves, the often pioneering scientifi c and technological basis
usually remains less visisble.
This ‘Philips Research Book Series’ has been set up as a way for Philips researchers
to contribute to the scientifi c community by publishing their comprehensive results
and theories in book form.
Dr. Rick Harwig
Probing Experience
From Assessment of User Emotions and Behaviour
to Development of Products
Edited by
Joyce H.D.M. Westerink
Philips Research, Eindhoven
The Netherlands
Martin Ouwerkerk
Philips Research, Eindhoven
The Netherlands
Thérèse J.M. Overbeek
Philips Research, Eindhoven
The Netherlands
W. Frank Pasveer
Philips Research, Eindhoven
The Netherlands
and
Boris de Ruyter
Philips Research, Eindhoven
The Netherlands
A C.I.P. Catalogue record for this book is available from the Library of Congress.
ISBN 978-1-4020-6592-7 (HB)
ISBN 978-1-4020-6593-4 (e-book)
Published by Springer,
P.O. Box 17, 3300 AA Dordrecht, The Netherlands.
www.springer.com
Printed on acid-free paper
Library of Congress Control Number: 2007941277
All Rights Reserved
© 2008 Springer Science + Business Media B.V.
No part of this work may be reproduced, stored in a retrieval system, or transmitted in any form or by
any means, electronic, mechanical, photocopying, microfilming, recording or otherwise, without written
permission from the Publisher, with the exception of any material supplied specifically for the purpose of
being entered and executed on a computer system, for exclusive use by the purchaser of the work.
Contents
Foreword by Fred Boekhorst . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
Contributors. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
Introduction: Probing Experience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Joyce Westerink, Martin Ouwerkerk, Thérèse Overbeek,
Frank Pasveer and Boris de Ruyter
1 Experience in Products . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Joyce Westerink
Part I Probing In Order To Quantify
2 Inquiring About People’s Affective Product Judgements. . . . . . . . . . . . . . 11
Jettie Hoonhout
3 Atmosphere Metrics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
Ingrid Vogels
4 In Search of the X-factor to Develop
Experience Measurement Tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Ingrid Mulder and Harry van Vliet
5 Probing Experiences: Logs, Traces, Self-report
and a Sense of Wonder . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
Erik Geelhoed, Josephine Reid, Richard Hull and Sharon Baurley
6 Objective Emotional Assessment of Industrial Products . . . . . . . . . . . . . . 69
Wolfram Boucsein and Florian Schaefer
7 Measuring Experiences in Gaming and TV Applications . . . . . . . . . . . . . 77
Rosemarie J.E. Rajae-Joordens
v
vi Contents
8 Sensing Affective Experience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
Jennifer A. Healey
9 Brain, Skin and Cosmetics: Sensory Aspects Objectivated
by Functional Magnetic Resonance Imaging. . . . . . . . . . . . . . . . . . . . . . . 101
Bernard Querleux
10 The Assessment of Stress. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109
Ad Vingerhoets
11 Discovery of T-templates and Their Real-Time
Interpretation using Theme . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119
Magnus S. Magnusson
Part II Probing In Order To Feed Back
12 Where Will The User “drive” Future Technology?. . . . . . . . . . . . . . . . . . 129
Antonio Maria Calvosa and Amedeo Visconti
13 A Wearable EMG Monitoring System for Emotions
Assessment. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139
Cecilia Vera-Munoz, Laura Pastor-Sanz, Guiseppe Fico,
Maria Teresa Arredondo, Francesca Benuzzi and Angel Blanco
14 Computing Emotion Awareness through Galvanic Skin
Response and Facial Electromyography. . . . . . . . . . . . . . . . . . . . . . . . . . . 149
Joyce H.D.M. Westerink, Egon L. van den Broek,
Marleen H. Schut, Jan van Herk and Kees Tuinenbreijer
15 Unobtrusive Sensing of Psychophysiological Parameters . . . . . . . . . . . . . 163
Martin Ouwerkerk, Frank Pasveer and Geert Langereis
16 It’s Heart Rhythm not Rate That Counts. . . . . . . . . . . . . . . . . . . . . . . . . . 195
Deborah Rozman, Rollin McCraty and Dana Tomasino
17 Transformative Experience on the Home Computer. . . . . . . . . . . . . . . . . 205
Kurt R. Smith
18 The Emotional Computer Adaptive to Human Emotion . . . . . . . . . . . . . . 209
Mincheol Whang
19 Using Physiological Measures for Task Adaptation . . . . . . . . . . . . . . . . . 221
Ben Mulder, Dick de Waard, Piet Hoogeboom,
Lennart Quispel and Arjan Stuiver
20 The Usability of Cardiovascular and Electrodermal
Measures for Adaptive Automation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 235
Florian Schaefer, Andrea Haarmann and Wolfram Boucsein
Foreword
Fred Boekhorst
Steady progress in Information and Communication technology has
advanced the Internet, once merely a tool for exchange of scientific informa-
tion between universities, to a platform that enables the transformation of our
society. In this new, digital society, people can take more informed decisions
because of new mechanisms for finding what you’re looking for [Google],
new mechanisms of accessing background knowledge [Wikipedia], new ways
of engaging with one another [chat], new ways of trading goods [e-Bay] and
many more. While these represent already profound changes in our lifestyle,
the effects of digitizing society have just begun.
So far, the Internet has made information accessible through computer
screens but the next wave will be “The Internet of Things”. Environments
will become smart and responsive to the presence of people and objects. The
key underlying technology here is embedded sensor technology that allows
sensors to monitor people and their environment and to communicate meas-
urements. The combination of the Internet [representing Intelligence and per-
vasiveness] and sensor networks [representing Ambient probing] will unlock
many new applications, for example in the field of optimized logistics, smart
agriculture or more intelligent living environments. At Philips, we have set
up three different laboratory environments that aim to research how an intel-
ligent environment could help people. One of those environments is called
“Care-Lab” in which we investigate how technology could help elderly main-
tain an independent lifestyle. Another example is our Shop-Lab, where we
experiment with audio-, video-, lighting- and computer-vision technology to
create a new shopping environment.
We have to realize ourselves that, while the enabling technologies have
many fascinating aspects, the one thing that truly matters is the experience
it creates in people’s mind. Hence, while our Experience Labs [Home-Lab,
Care-Lab, Shop-Lab] are packed with intelligent sensor technology to probe
the environment, the Labs are also packed with observation technology to be
vii
viii Foreword
able to start understanding how to create a desired experience, for example
the experience of feeling safe and secure.
So, probing experiences, the theme of this book is a goal with multiple
meanings: on the one hand, it relates to probing environments, deriving data
from it to enable more informed support systems to aid the user in their goals;
on the other hand, it relates to understanding and measuring the experience
we try to evoke.
The book serves the purpose of bringing together experts in diverse fields.
I hope that these proceedings serve the purpose of yielding new insights and
stimulating further, original thinking.
Enjoy reading,
Fred M. Boekhorst.
Senior Vice President Philips Research
Program Manager Lifestyle
Contributors
Maria Teresa Arredondo
Life Supporting Technologies, Universidad Politécnica de Madrid (UPM)
Ramiro de Meztu 7, 28040 Madrid, Spain
Sharon Baurley
The University of the Arts London,
Central Saint Martins College of Art and Design
Southampton Row, London WC1B 4AP, UK
Francesca Benuzzi
Università di Modena e Reggio Emilia
Via Università 4, 41100 Modena (MO), Italy
Angel Blanco
SIEMENS S.A.
Spain
Fred M. Boekhorst
Philips Research
High Tech Campus 34, 5656 AE Eindhoven, The Netherlands
Wolfram Boucsein
Physiological Psychology
University of Wuppertal, D-42097 Wuppertal, Germany
Egon L. van den Broek
Center for Telematics and Information Technology (CTIT),
University of Twente
Postbus 217, 7500 AE Enschede, The Netherlands
ix
x Contributors
Antonio Maria Calvosa
Innovation Team, Ferrari S.p.A, GT division
Via Abetone Inf. 4, 41053 Maranello, Italy
Guiseppe Fico
Life Supporting Technologies, Universidad Politécnica de Madrid (UPM)
Spain
Erik Geelhoed
Hewlett-Packard Laboratories
Filton Road, Stoke Gifford, Bristol BS34 8QZ, UK
Andrea Haarmann
Physiological Psychology, University of Wuppertal
D-42097 Wuppertal, Germany
Jennifer A. Healey
Intel Massachusetts, Inc., Advanced Technology Group, Digital Health
20 Ames St., Cambridge, MA 01239, Massachusetts, USA
Jan van Herk
Philips Research
High Tech Campus 34, 5656 AE Eindhoven, The Netherlands
Piet Hoogeboom
National Aerospace Laboratory (NLR)
Anthony Fokkerweg 2,1059 CM Amsterdam, The Netherlands
Jettie Hoonhout
Philips Research
High Tech Campus 34, 5656 AE Eindhoven, The Netherlands
Richard Hull
Hewlett-Packard Laboratories
Filton Road, Stoke Gifford, Bristol BS34 8QZ, UK
Geert Langereis
Philips Research
High Tech Campus 34, 5656 AE Eindhoven, The Netherlands
Magnus S. Magnusson,
Human Behavior Laboratory, University of Iceland and PatternVision Ltd
Reykjavik, Iceland
