Table Of ContentLecture Notes in Computer Science 5826
CommencedPublicationin1973
FoundingandFormerSeriesEditors:
GerhardGoos,JurisHartmanis,andJanvanLeeuwen
EditorialBoard
DavidHutchison
LancasterUniversity,UK
TakeoKanade
CarnegieMellonUniversity,Pittsburgh,PA,USA
JosefKittler
UniversityofSurrey,Guildford,UK
JonM.Kleinberg
CornellUniversity,Ithaca,NY,USA
AlfredKobsa
UniversityofCalifornia,Irvine,CA,USA
FriedemannMattern
ETHZurich,Switzerland
JohnC.Mitchell
StanfordUniversity,CA,USA
MoniNaor
WeizmannInstituteofScience,Rehovot,Israel
OscarNierstrasz
UniversityofBern,Switzerland
C.PanduRangan
IndianInstituteofTechnology,Madras,India
BernhardSteffen
UniversityofDortmund,Germany
MadhuSudan
MicrosoftResearch,Cambridge,MA,USA
DemetriTerzopoulos
UniversityofCalifornia,LosAngeles,CA,USA
DougTygar
UniversityofCalifornia,Berkeley,CA,USA
GerhardWeikum
Max-PlanckInstituteofComputerScience,Saarbruecken,Germany
Manuel Núñez Paul Baker
Mercedes G. Merayo (Eds.)
Testing of Software
and Communication
Systems
21stIFIPWG6.1InternationalConference,TESTCOM2009
9th InternationalWorkshop, FATES 2009
Eindhoven, The Netherlands, November 2-4, 2009
Proceedings
1 3
VolumeEditors
ManuelNúñez
MercedesG.Merayo
UniversidadComplutensedeMadrid
FacultaddeInformática
28040Madrid,Spain
E-mail:[email protected],[email protected]
PaulBaker
Motorola’sCorporateSoftwareExcellenceTeam
Basingstoke,Hampshire,RG224PD,UK
E-mail:[email protected]
LibraryofCongressControlNumber:2009936418
CRSubjectClassification(1998):D.2.5,D.4.8,I.6,D.2,D.3,F.3,D.2.4
LNCSSublibrary:SL5–ComputerCommunicationNetworks
andTelecommunications
ISSN 0302-9743
ISBN-10 3-642-05030-1SpringerBerlinHeidelbergNewYork
ISBN-13 978-3-642-05030-5SpringerBerlinHeidelbergNewYork
Thisworkissubjecttocopyright.Allrightsarereserved,whetherthewholeorpartofthematerialis
concerned,specificallytherightsoftranslation,reprinting,re-useofillustrations,recitation,broadcasting,
reproductiononmicrofilmsorinanyotherway,andstorageindatabanks.Duplicationofthispublication
orpartsthereofispermittedonlyundertheprovisionsoftheGermanCopyrightLawofSeptember9,1965,
initscurrentversion,andpermissionforusemustalwaysbeobtainedfromSpringer.Violationsareliable
toprosecutionundertheGermanCopyrightLaw.
springer.com
©IFIPInternationalFederationforInformationProcessing2009
PrintedinGermany
Typesetting:Camera-readybyauthor,dataconversionbyScientificPublishingServices,Chennai,India
Printedonacid-freepaper SPIN:12772223 06/3180 543210
Preface
This volume contains the proceedings of TESTCOM/FATES 2009, a Joint
Conference of the 21st IFIP International Conference on Testing of Commu-
nicating Systems (TESTCOM) and the 9th International Workshop on Formal
ApproachestoTestingofSoftware(FATES).TESTCOM/FATES2009washeld
in Eindhoven, The Netherlands, during November 2–4, 2009. In this edition,
TESTCOM/FATES was part of the first Formal Methods Week (FMweek).
TESTCOM/FATES aims at being a forum for researchers, developers, and
testers to review, discuss, and learn about new approaches, concepts, theories,
methodologies, tools, and experiences in the field of testing of communicating
systemsandsoftware.TESTCOMhasalonghistory.PreviouslyitwascalledIn-
ternationalWorkshoponProtocolTestSystems(IWPTS)andchangeditsname
latertoInternationalWorkshoponTestingofCommunicatingSystem(IWTCS).
The previous events were held in Vancouver, Canada (1988); Berlin, Germany
(1989);McLean,USA(1990);Leidschendam,TheNetherlands(1991);Montreal,
Canada (1992); Pau, France (1993); Tokyo, Japan (1994); Evry, France (1995);
Darmstadt,Germany(1996);ChejuIsland,Korea(1997);Tomsk,Russia(1998);
Budapest, Hungary (1999); Ottawa, Canada (2000); Berlin, Germany (2002);
Sophia Antipolis, France (2003); Oxford, UK (2004); Montr´eal, Canada (2005)
andNewYork,USA(2006).FATESalsohasitshistory.Thepreviousworkshops
wereheld in Aalborg,Denmark (2001);Brno,CzechRepublic (2002);Montr´eal,
Canada (2003); Linz, Austria (2004); Edinburgh, UK (2005) and Seattle, USA
(2006). TESTCOM and FATES became a joint conference in 2007: It has been
held in Tallinn, Estonia (2007) and Tokyo, Japan (2008).
We received 37 submissions. After a careful reviewing process, the Program
Committeeaccepted13papers.Therefore,theacceptancerateofthe conference
stayed close to 33%. In addition to regular papers, the Program Committee
accepted six short papers. The conference program also contained an invited
presentationbyWolfgangGrieskamp(MicrosoftResearch,USA)on“Microsoft’s
Protocol Documentation Quality Assurance Program.”
Several people contributed to the success of TESTCOM/FATES 2009. We
are grateful to the Steering Committee, the ProgramCommittee, and the addi-
tional reviewers for their work on selecting the papers. We would like to thank
Microsoft Research for its financial support and Springer for publishing the
proceedings. The selection of papers and compilation of the proceedings was
performed through easychair,which strongly facilitated the management of the
submissions.Finally,wewouldliketothanktheTESTCOM/FATES2009Orga-
nization Committee and the FMWeek Coordinators for their help and support.
November 2009 Manuel Nu´n˜ez
Paul Baker
Mercedes G. Merayo
Organization
Chairs of TESTCOM/FATES 2009
Manuel Nu´n˜ez (ProgramCommittee Chair)
Paul Baker (Industrial Track Chair)
Mercedes G. Merayo (Organization Chair)
Steering Committee of TESTCOM/FATES
Ana R. Cavalli Telecom SudParis, France
John Derrick University of Sheffield, UK (Chair)
Wolfgang Grieskamp Microsoft Research, USA
Roland Groz Grenoble Institute of Technology, France
Toru Hasegawa KDDI R&D Labs., Japan
Alexandre Petrenko CRIM, Canada
Jan Tretmans Embedded Systems Institute,
The Netherlands
Andreas Ulrich Siemens AG, Germany
Margus Veanes Microsoft Research, USA
Program Committee
Paul Baker Motorola,UK (Industrial Track Chair)
Antonia Bertolino ISTI-CNR, Italy
Gregor v. Bochmann University of Ottawa, Canada
Richard Castanet LABRI, France
Ana R. Cavalli Telecom SudParis, France
John Derrick University of Sheffield, UK
Sarolta Dibuz Ericsson, Hungary
Rachida Dssouli Concordia University, Canada
Khaled El-Fakih American University of Sharjah, UAE
Gordon Fraser T.U. Graz, Austria
Jens Grabowski University of G¨ottingen, Germany
Roland Groz Grenoble Institute of Technology, France
Toru Hasegawa KDDI R&D Labs., Japan
Rob Hierons Brunel University, UK
Teruo Higashino Osaka University, Japan
Dieter Hogrefe University of G¨ottingen, Germany
Thierry J´eron IRISA Rennes, France
Ferhat Khendek Concordia University, Canada
Myungchul Kim ICU, Korea
VIII Organization
David King Praxis, UK
Hartmut Ko¨nig BTU Cottbus, Germany
Victor V. Kuliamin ISP RAS, Russia
David Lee Ohio State University, USA
Bruno Legeard Leirios, France
Giulio Maggiore Telecom Italia Mobile, Italy
Jos´e Carlos Maldonado University of San Carlos, Brazil
Mercedes G. Merayo University Complutense of Madrid, Spain
Brian Nielsen University of Aalborg, Denmark
Manuel Nu´n˜ez University Complutense of Madrid, Spain
(PC Chair)
Doron Peled University of Bar-Ilan, Israel
Alexandre Petrenko CRIM, Canada
Ismael Rodr´ıguez University Complutense of Madrid, Spain
Ina Schieferdecker Fraunhofer FOKUS, Germany
Adenilso da Silva Simao University of San Carlos, Brazil
Kenji Suzuki University of Electro-Communications,Japan
Jan Tretmans Embedded Systems Institute,
The Netherlands
Andreas Ulrich Siemens AG, Germany
Hasan Ural University of Ottawa, Canada
Mark Utting University of Waikato, New Zealand
M. U¨mit Uyar City University of New York, USA
Margus Veanes Microsoft Research, USA
C´esar Viho IRISA Rennes, France
Carsten Weise RWTH Aachen, Germany
Burkhart Wolff University of Paris-Sud, France
Nina Yevtushenko Tomsk State University, Russia
Fatiha Za¨ıdi University of Paris-Sud, France
Hong Zhu Oxford Brookes University, UK
Additional Reviewers
Lydie du Bousquet Jos´e Pablo Escobedo Fabiano Cutigi Ferrari
Hesham Hallal Steffen Herbold Willy Jim´enez
Guy Vincent Jourdan Sungwon Kang Nicolas Kicillof
Shuhao Li Ilaria Matteucci Tomohiko Ogishi
Jiri Srba Benjamin Zeiss
Organizing Committee
C´esar Andr´es University Complutense of Madrid, Spain
Alberto de la Encina University Complutense of Madrid, Spain
Jasen Markovski T.U. Eindhoven, The Netherlands
Organization IX
Mercedes G. Merayo University Complutense of Madrid, Spain
(Organization Chair)
Carlos Molinero University Complutense of Madrid, Spain
Luis Llana University Complutense of Madrid, Spain
(Publicity Chair)
Michiel van Osch T.U. Eindhoven, The Netherlands
(Local Organization Chair)
Ismael Rodr´ıguez University Complutense of Madrid, Spain
Table of Contents
Regular Papers
Testing Real-Time Systems Using TINA ............................ 1
Noureddine Adjir, Pierre De Saqui-Sannes, and
Kamel Mustapha Rahmouni
A Formal Framework for Service Orchestration Testing Based on
Symbolic Transition Systems ...................................... 16
Lina Bentakouk, Pascal Poizat, and Fatiha Za¨ıdi
Testing k-Safe Petri Nets.......................................... 33
Gregor von Bochmann and Guy-Vincent Jourdan
Implementing MSC Tests with Quiescence Observation ............... 49
Sergiy Boroday, Alexandre Petrenko, and Andreas Ulrich
Testing Timed Finite State Machines with Guaranteed Fault
Coverage........................................................ 66
Khaled El-Fakih, Nina Yevtushenko, and Hacene Fouchal
Applying Testability Transformations to Achieve Structural Coverage
of Erlang Programs .............................................. 81
Qiang Guo, John Derrick, and Neil Walkinshaw
Interaction Coverage Meets Path Coverage by SMT Constraint
Solving ......................................................... 97
Wolfgang Grieskamp, Xiao Qu, Xiangjun Wei, Nicolas Kicillof, and
Myra B. Cohen
Automatic Testing of Access Control for Security Properties........... 113
Herv´e Marchand, J´er´emy Dubreil, and Thierry J´eron
Generating Reduced Tests for FSMs with Extra States................ 129
Adenilso Sima˜o, Alexandre Petrenko, and Nina Yevtushenko
An Approach for Test Selection for EFSMs Using a Theorem Prover.... 146
Mahadevan Subramaniam, Ling Xiao, Bo Guo, and Zoltan Pap
TTCN-3 Based Conformance Testing of Mobile Broadcast Business
Management System in 3G Networks ............................... 163
Zhiliang Wang, Xia Yin, Yang Xiang, Ruiping Zhu, Shirui Gao,
Xin Wu, Shijian Liu, Song Gao, Li Zhou, and Peng Li
XII Table of Contents
Applying Model Checking to Generate Model-Based Integration Tests
from Choreography Models........................................ 179
Sebastian Wieczorek, Vitaly Kozyura, Andreas Roth,
Michael Leuschel, Jens Bendisposto, Daniel Plagge, and
Ina Schieferdecker
Analyzing Response Inconsistencies in Test Suites.................... 195
Benjamin Zeiss and Jens Grabowski
Short Papers
Model-Based Testing of Web Applications Using NModel ............. 211
Juhan Ernits, Rivo Roo, Jonathan Jacky, and Margus Veanes
Observability and Controllability Issues in Conformance Testing of
Web Service Compositions ........................................ 217
Jose Pablo Escobedo, Christophe Gaston, Pascale Le Gall, and
Ana Cavalli
Towards Automatic Generation of a Coherent TTCN-3 Template
Framework...................................................... 223
Roland Gecse
OConGraX – Automatically Generating Data-Flow Test Cases for
Fault-Tolerant Systems ........................................... 229
Paulo R.F. Nunes, Simone Hanazumi, and Ana C.V. de Melo
Debugging into Examples: Leveraging Tests for Program
Comprehension .................................................. 235
Bastian Steinert, Michael Perscheid, Martin Beck, Jens Lincke, and
Robert Hirschfeld
Structural Analysis of Large TTCN-3 Projects....................... 241
Kristo´f Szabados
Author Index.................................................. 247
Testing Real-Time Systems Using TINA
Noureddine Adjir1, Pierre De Saqui-Sannes2, and Kamel Mustapha Rahmouni3
1 University of Saida, BP 138 - 20001 Ennasr Saida, Algeria
2 University of Toulouse ISAE, 31 Avenue Edouard Belin, BP 44032 - 31055, cedex 4 France
3 University of Oran, BP 1524 - El mnaouar 31000 Oran, Algeria
[email protected], [email protected], [email protected]
Abstract. The paper presents a technique for model-based black-box confor-
mance testing of real-time systems using the Time Petri Net Analyzer TINA.
Such test suites are derived from a prioritized time Petri net composed of two
concurrent sub-nets specifying respectively the expected behaviour of the
system under test and its environment.We describe how the toolbox TINA has
been extended to support automatic generation of time-optimal test suites. The
result is optimal in the sense that the set of test cases in the test suite have the
shortest possible accumulated time to be executed. Input/output conformance
serves as the notion of implementation correctness, essentially timed trace
inclusion taking environment assumptions into account. Test cases selection is
based either on using manually formulated test purposes or automatically from
various coverage criteria specifying structural criteria of the model to be
fulfilled by the test suite. We discuss how test purposes and coverage criterion
are specified in the linear temporal logic SE-LTL, derive test sequences, and
assign verdicts.
Keywords: Real-time system, Prioritized Time Petri Nets, conformance testing,
time optimal test cases.
1 Introduction
Real-Time systems are characterized by their capacity to interact with their surround-
ing environment and to provide the latter the expected output at the right date i.e. the
timely reaction is just as important as the kind of reaction. Testing real-time systems
is even more challenging than testing untimed reactive systems, because the tester
must consider when to stimulate system, when to expect responses, and how to assign
verdicts to the observed timed event sequence. Further, the test cases must be exe-
cuted in real-time, i.e., the test execution system itself becomes a real-time system.
Model-based testing has been proposed as a technique to automatically verify that
a system conforms to its specification. In this technique, test cases are derived from a
formal model that specifies the expected behaviour of a system. In this paper, we
propose a technique for automatically generating test cases and test suites for embed-
ded real time systems based on Prioritized Time Petri Nets.
We focus on conformance testing i.e. checking by means of execution whether the
behaviour of some black-box system, or a system part, called SUT (system under
test), conforms to its specification. This is typically done in a controlled environment
M. Núñez et al. (Eds.): TESTCOM/FATES 2009, LNCS 5826, pp. 1–15, 2009.
© IFIP International Federation for Information Processing 2009
