Table Of ContentHeinrichHussmann,GerritMeixner,andDetlefZuehlke(Eds.)
Model-DrivenDevelopmentofAdvancedUserInterfaces
StudiesinComputationalIntelligence,Volume340
Editor-in-Chief
Prof.JanuszKacprzyk
SystemsResearchInstitute
PolishAcademyofSciences
ul.Newelska6
01-447Warsaw
Poland
E-mail:[email protected]
Furthervolumesofthisseriescanbefoundonour
homepage:springer.com Vol.329.SantiCaballe´,FatosXhafa,andAjithAbraham(Eds.)
IntelligentNetworking,CollaborativeSystemsand
Vol.318.OscarCastillo,JanuszKacprzyk, Applications,2010
andWitoldPedrycz(Eds.) ISBN978-3-642-16792-8
SoftComputingforIntelligentControl Vol.330.SteffenRendle
andMobileRobotics,2010 Context-AwareRankingwithFactorizationModels,2010
ISBN978-3-642-15533-8 ISBN978-3-642-16897-0
Vol.319.TakayukiIto,MinjieZhang,ValentinRobu, Vol.331.AthenaVakaliandLakhmiC.Jain(Eds.)
ShaheenFatima,TokuroMatsuo, NewDirectionsinWebDataManagement1,2011
andHirofumiYamaki(Eds.) ISBN978-3-642-17550-3
InnovationsinAgent-BasedComplex
AutomatedNegotiations,2010 Vol.332.JianguoZhang,LingShao,LeiZhang,and
ISBN978-3-642-15611-3 GraemeA.Jones(Eds.)
IntelligentVideoEventAnalysisandUnderstanding,2011
Vol.320.xxx ISBN978-3-642-17553-4
Vol.321.DimitriPlemenosandGeorgiosMiaoulis(Eds.) Vol.333.FedjaHadzic,HenryTan,andTharamS.Dillon
IntelligentComputerGraphics2010 MiningofDatawithComplexStructures,2011
ISBN978-3-642-15689-2 ISBN978-3-642-17556-5
Vol.322.BrunoBaruqueandEmilioCorchado(Eds.) Vol.334.ÁlvaroHerreroandEmilioCorchado(Eds.)
FusionMethodsforUnsupervisedLearningEnsembles,2010 MobileHybridIntrusionDetection,2011
ISBN978-3-642-16204-6 ISBN978-3-642-18298-3
Vol.323.YingxuWang,DuZhang,andWitoldKinsner(Eds.) Vol.335.RadomirS.StankovicandRadomirS.Stankovic
AdvancesinCognitiveInformatics,2010 FromBooleanLogictoSwitchingCircuitsandAutomata,2011
ISBN978-3-642-16082-0 ISBN978-3-642-11681-0
Vol.324.AlessandroSoro,VargiuEloisa,GiulianoArmano, Vol.336.PaoloRemagnino,DorothyN.Monekosso,and
andGavinoPaddeu(Eds.) LakhmiC.Jain(Eds.)
InformationRetrievalandMininginDistributed InnovationsinDefenceSupportSystems–3,2011
Environments,2010 ISBN978-3-642-18277-8
ISBN978-3-642-16088-2
Vol.337.SherylBrahnamandLakhmiC.Jain(Eds.)
Vol.325.QuanBaiandNaokiFukuta(Eds.) AdvancedComputationalIntelligenceParadigmsin
AdvancesinPracticalMulti-AgentSystems,2010 Healthcare6,2011
ISBN978-3-642-16097-4 ISBN978-3-642-17823-8
Vol.326.SherylBrahnamandLakhmiC.Jain(Eds.)
Vol.338.LakhmiC.Jain,EugeneV.Aidman,and
AdvancedComputationalIntelligenceParadigmsin
CaniciousAbeynayake(Eds.)
Healthcare5,2010
InnovationsinDefenceSupportSystems–2,2011
ISBN978-3-642-16094-3
ISBN978-3-642-17763-7
Vol.327.SlawomirWiakand
Vol.339.HalinaKwasnicka,LakhmiC.Jain(Eds.)
EwaNapieralska-Juszczak(Eds.)
InnovationsinIntelligentImageAnalysis,2010
ComputationalMethodsfortheInnovativeDesignof
ISBN978-3-642-17933-4
ElectricalDevices,2010
ISBN978-3-642-16224-4
Vol.340.HeinrichHussmann,GerritMeixner,and
Vol.328.RaoulHuysandViktorK.Jirsa(Eds.) DetlefZuehlke(Eds.)
NonlinearDynamicsinHumanBehavior,2010 Model-DrivenDevelopmentofAdvancedUserInterfaces,2011
ISBN978-3-642-16261-9 ISBN978-3-642-14561-2
Heinrich Hussmann,Gerrit Meixner,and
Detlef Zuehlke (Eds.)
Model-Driven Development
of Advanced User
Interfaces
123
Prof.Dr.HeinrichHussmann Prof.Dr.DetlefZuehlke
Ludwig-Maximilians-UniversitätMünchen DeutschesForschungszentrumfür
Lehr-undForschungseinheit KünstlicheIntelligenz(DFKI)
Medieninformatik InnovativeFabriksysteme(IFS)
Amalienstr.17 TrippstadterStr.122
80333München 67663Kaiserslautern
Germany Germany
E-mail:Hussmann@ifi.lmu.de E-mail:[email protected]
Dr.GerritMeixner
DeutschesForschungszentrumfür
KünstlicheIntelligenz(DFKI)
InnovativeFabriksysteme(IFS)
TrippstadterStr.122
67663Kaiserslautern
Germany
E-mail:[email protected]
ISBN 978-3-642-14561-2 e-ISBN 978-3-642-14562-9
DOI 10.1007/978-3-642-14562-9
Studiesin Computational Intelligence ISSN1860-949X
(cid:2)c 2011 Springer-VerlagBerlin Heidelberg
Thisworkissubjecttocopyright.Allrightsarereserved,whetherthewholeorpart
of the material is concerned, specifically therights of translation, reprinting,reuse
ofillustrations, recitation,broadcasting, reproductiononmicrofilmorinanyother
way, and storage in data banks. Duplication of this publication or parts thereof is
permittedonlyundertheprovisionsoftheGermanCopyrightLawofSeptember9,
1965, in its current version, and permission for use must always be obtained from
Springer. Violations are liable to prosecution undertheGerman Copyright Law.
The use of general descriptive names, registered names, trademarks, etc. in this
publication does not imply, even in the absence of a specific statement, that such
names are exempt from the relevant protective laws and regulations and therefore
free for general use.
Typeset&CoverDesign:ScientificPublishing ServicesPvt. Ltd., Chennai, India.
Printed on acid-free paper
9 8 7 6 5 4 3 2 1
springer.com
Preface
Model-Driven Development (MDD) has become an important paradigm in soft-
ware development. The approach claims to provide a solution for systematic and
efficient software development for the highly complex systems developed now-
adays. It uses models, i.e. abstract representations of certain aspects of a system,
as primary artifacts in the development process. Models are often visual models,
like Unified Modeling Language (UML) models, but can also be represented in
textual formats like the Extensible Markup Language (XML). A model-driven
development process usually makes use of different models on different levels of
abstraction. Model transformations are used to transform a model (semi)
automatically into another (usually less abstract) model and finally into implemen-
tation code. MDD provides a large number of powerful concepts and tools to deal
with models, meta-models, and model transformations.
Model-driven development of user interfaces applies the principles of MDD to
the target domain of user interfaces. Modern user interface development requires
the usage of extensive pre-fabricated software libraries and frameworks and has a
strong tendency that the code becomes rather platform-specific. Therefore, MDD
is a highly interesting technology for user interface development. MDD can help
to hide the complexity of libraries and frameworks by using adequate abstractions,
and MDD can achieve some degree of platform-independence through abstract in-
terface models. The fact that different models of the same system may describe
different views of the same system is also helpful, for instance, to separate the
content (what is displayed) from the design (how it is displayed) into distinct
models. Also for the emerging the paradigm of ubiquitous computing MDD is an
interesting technology. Ubiquitous computing requires user interfaces which run
on diverse target platforms in a consistent way, can adapt at runtime to the current
application context or even migrate at runtime between different devices. Plat-
form-independent, abstract models provide an excellent base to address such
requirements.
The topics discussed in this book are intended to give a broad overview of the
currents state of research in MDD for user interface development, in particular for
advanced user interface concepts. Topics include, e.g., foundations and principles
of models required for modeling (specific aspects of) advanced or non-standard
user interfaces, tools supporting model-driven development of advanced user in-
terfaces, adaptation and customization mechanisms for model transformations
leading to tailored advanced user interfaces with a high degree of usability,
the combination of models and informal design knowledge in a model-driven
VI Preface
development process and project experience on user interface development using a
model-driven development approach.
The specific chapters in this book cover a relatively broad spectrum of detailed
research topics concerning, e.g., method engineering, formal description techniques,
multi front-end engineering, development of multimodal user interfaces, models at
development-time and at run-time, business process modeling, task modeling lan-
guages (e.g., useML, CTT, AMBOSS), user interface description languages (e.g.,
DISL, UIML, UsiXML, XAML), model transformation languages (e.g., ATL, QVT,
T:XML), optimization of automatic generated user interfaces, informal design
knowledge, user-centered software engineering and mixed interaction.
The idea of this book is based on the very successful workshop series of
“Model-Driven Development of Advanced User Interfaces (MDDAUI)”. The
MDDAUI workshops were organized initially at the MODELS conference (2005,
2006 and 2007) mainly attracting software engineers and HCI researchers with a
strong technical background. In 2009, the workshop took place at the Intelligent
User Interfaces (IUI) conference, focusing topics at the intersection between HCI
and Artificial Intelligence (AI). The last workshop up to now, in 2010, was con-
ducted at the conference on Human Factors in Computing Systems (CHI) which
focused more on user experience related aspects rather than pure technological
innovations in model-driven development. Based on the contributions to this
workshop, the editors have invited selected authors to contribute timely and origi-
nal research papers to this book.
This book provides an outstanding overview as well as deep insights into the
area of model-driven development of advanced user interfaces, which is an emer-
ging topic in the intersection of Human-Computer-Interaction and Software-
Engineering. Besides aiming to be the reference in its area, this book is intended
as a very significant and valuable source for professional researchers as well as
senior and post-graduate computer science and engineering students.
This book could not be completed without the help of many people. We would
like to thank all the authors for their contribution to the book and their effort in
addressing reviewers’ and editorial feedback. Thanks also go to all the other par-
ticipants and program committee members of former MDDAUI workshops. Fi-
nally, we would like to thank Eva Hestermann-Beyerle and Birgit Kollmar-Thoni
at Springer (Heidelberg, Germany) for their assistance in publishing this book in a
timely fashion.
October 2010 Heinrich Hussmann
Gerrit Meixner
Detlef Zuehlke
Contents
Model-Driven Useware Engineering.......................... 1
Gerrit Meixner, Marc Seissler, Kai Breiner
Multi Front-End Engineering ................................ 27
Goetz Botterweck
A Design Space for User Interface Composition.............. 43
Fabio Patern`o, Carmen Santoro, Lucio Davide Spano
Applying Meta-Modeling for the Definition of
Model-Driven Development Methods of Advanced User
Interfaces.................................................... 67
Stefan Sauer
Using Storyboards to Integrate Models and Informal
Design Knowledge ........................................... 87
Mieke Haesen, Jan Van den Bergh, Jan Meskens, Kris Luyten,
Sylvain Degrandsart, Serge Demeyer, Karin Coninx
Optimized GUI Generation for Small Screens................ 107
David Raneburger, Roman Popp, Sevan Kavaldjian,
Hermann Kaindl, Ju¨rgen Falb
Business Performer-Centered Design of User Interfaces...... 123
Kˆenia Sousa, Jean Vanderdonckt
A Formal Model-Based Approach for Designing
Interruptions-Tolerant Advanced User Interfaces ............ 143
Philippe Palanque, Marco Winckler, C´elia Martinie
Dynamic Distribution and Layouting of Model-Based User
Interfaces in Smart Environments ........................... 171
Dirk Roscher, Grzegorz Lehmann, Veit Schwartze,
Marco Blumendorf, Sahin Albayrak
VIII Contents
Model-Driven Development of Interactive Multimedia
Applications with MML ..................................... 199
Andreas Pleuss, Heinrich Hussmann
Taking Advantage of Model-Driven Engineering
Foundations for Mixed Interaction Design ................... 219
Guillaume Gauffre, Emmanuel Dubois
T:XML: A Tool Supporting User Interface Model
Transformation .............................................. 241
V´ıctor Lo´pez-Jaquero, Francisco Montero, Pascual Gonza´lez
Formalizing Interaction Patterns............................. 257
Paolo Bottoni, Esther Guerra, Juan de Lara
Task Models in the Context of User Interface
Development ................................................ 277
Gerd Szwillus
Author Index................................................ 303
Model-Driven Useware Engineering
Gerrit Meixner, Marc Seissler, and Kai Breiner*
Abstract. User-oriented hardware and software development relies on a systematic
development process based on a comprehensive analysis focusing on the users’
requirements and preferences. Such a development process calls for the integration
of numerous disciplines, from psychology and ergonomics to computer sciences
and mechanical engineering. Hence, a correspondingly interdisciplinary team must
be equipped with suitable software tools to allow it to handle the complexity of a
multimodal and multi-device user interface development approach. An abstract,
model-based development approach seems to be adequate for handling this com-
plexity. This approach comprises different levels of abstraction requiring adequate
tool support. Thus, in this chapter, we present the current state of our model-based
software tool chain. We introduce the use model as the core model of our model-
based process, transformation processes, and a model-based architecture, and we
present different software tools that provide support for creating and maintaining
the models or performing the necessary model transformations.
1 Introduction
Considering the interaction with technical devices such as a computer or a ma-
chine control panel, the users actually interact with a subset of these hardware and
software components, which, in their entirety, make up the user interface [1]. Un-
fortunately, today’s developers often disregard the most important component of
Gerrit Meixner
German Research Center for Artificial Intelligence (DFKI), Trippstadter Str. 122, 67663,
Kaiserslautern, Germany
e-mail: [email protected]
Marc Seissler
University of Kaiserslautern, Center for Human-Machine-Interaction, Gottlieb-Daimler
Str. 42, 67663, Kaiserslautern, Germany
e-mail: [email protected]
Kai Breiner
University of Kaiserslautern, Software Engineering Research Group, Gottlieb-Daimler
Str. 42, 67663, Kaiserslautern, Germany
e-mail: [email protected]
H. Hussmann et al. (Eds.): MDD of Advanced User Interfaces, SCI 340, pp. 1–26.
springerlink.com © Springer-Verlag Berlin Heidelberg 2011