Table Of Content• AUTHOR: ABHINAV VAID IN ALL THINGS BE MEN
Building Automated Test Systems
Microsoft Windows version 2.0
Power consists in one’s capacity to link his will with the purpose of others, to lead by reason
and a gift of cooperation. Woodrow Wilson
Bringing Intelligence Into Test Automation
[email protected]
Author’s Name: Abhinav Vaid
Free Software Foundation (FSF)
www.indyacellular.in
BBuuiillddiinngg AAuuttoommaatteedd TTeesstt SSyysstteemmss ––MMiiccrroossoofftt WWiinnddoowwss VVeerrssiioonn 22..00 PPaaggee nnuummbbeerrss
PAGE NUMBERS
•
Copyright (C) <2005> <Abhinav Vaid>
This program is free software; you can redistribute it and/or modify it under the terms of the
GNU General Public License as published by the Free Software Foundation; either version 2 of
the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY;
without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR
PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along with this program;
if not, write to the Free Software Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA
02111-13 USA
Abhinav Vaid
This General Public License does not permit incorporating your program into proprietary
programs. If your program is a subroutine library, you may consider it more useful to permit
linking proprietary applications with the library. If this is what you want to do, use the GNU
Library General Public License instead of this License.
Copyright © 2005 by the Open Source Initiative.
Technical questions about the website go to Steve M.: Webmaster at opensource.org / Policy
questions about open source go to the Board of Directors.
The contents of this website are licensed under the Open Software License 2.1 or Academic
Free License 2.1
OSI is a registered non-profit with 501(c) (3) status.
BBuuiillddiinngg AAuuttoommaatteedd TTeesstt SSyysstteemmss ––MMiiccrroossoofftt WWiinnddoowwss VVeerrssiioonn 22..00 PPaaggee nnuummbbeerrss
• AUTHOR: ABHINAV VAID IN ALL THINGS BE MEN
DECLARATION OF NON-DISCLOSURE OF COMPANY CONFIDENTIAL INFORMATION
This is to declare that whatever has been produced in the book has entirely been my own
effort and research.1 And there has been no disclosure of Confidential Information from my
present/previous employers.
BBuuiillddiinngg AAuuttoommaatteedd TTeesstt SSyysstteemmss ––MMiiccrroossoofftt WWiinnddoowwss VVeerrssiioonn 22..00 PPaaggee nnuummbbeerrss
PAGE NUMBERS
•
Dedication:
Parents, who made me competent enough to reach this stage.
Raadhu, Meenakshi whose innocence keeps strengthening me to bounce back irrespective of
blows/crisis.
Vipul Kocher, who stands with me today to make this happen.
BBuuiillddiinngg AAuuttoommaatteedd TTeesstt SSyysstteemmss ––MMiiccrroossoofftt WWiinnddoowwss VVeerrssiioonn 22..00 PPaaggee nnuummbbeerrss
• AUTHOR: ABHINAV VAID IN ALL THINGS BE MEN
Foreword:
The topic has a vast coverage on Test Automation, taking up real code examples, so that the
engineer/tester himself has a privilege to decide as to what is good and makes sense as per
his/her Test Development/Automation requirements. Test Automation in itself is extremely
vast field, and Abhinav in has book has made a serious attempt to touch each and every
aspect and has succeeded.
Abhinav Vaid is professionally as well as personally known to me and has good command over
the subject. He was involved extensively in Test Automation related activities when we
worked together for a couple of years as a part of Motorola India Design Center.
Rajesh Tibrewala
Technology Lead, .Net, Microsoft India
[email protected]
Abhinav Vaid is professionally known to me, and we have worked together in the past with a
Semiconductor R & D Engineering Center, where Abhinav was heading QA and Product
Release activities. He has an excellent command over the subject.
Dr Vivek Mudgil
Senior Product Manager, [email protected]
Alcatel India
About the Author:
Its been almost 12 years since the time I got associated to IT and I have been doing
documentation/ testing/ product release/ dev(mostly scripting related). I have been leading
Release and Test teams from past 5 years. I have worked with RiverRun Software/Motorola
India/McAfee India. Some of the key projects that I have tested and released:
Arm architecture based wireless chipsets with various OS/Interface flavors targeted for
Client(embedded, mobile, & handset) and Gateway markets
· CodeWarrior IDE Pro 6 development Tools for X86
· CodeWarrior IDE Pro 8 development Tools for X86
· CodeWarrior IDE development Tools for ARM based Architectures
· CodeWarrior IDE for eLinux
5 BBuuiillddiinngg AAuuttoommaatteedd TTeesstt SSyysstteemmss ––MMiiccrroossoofftt WWiinnddoowwss VVeerrssiioonn 22..00 PPaaggee nnuummbbeerrss
PAGE NUMBERS
•
· BSP's for ARM 9 Line of processors on all the embedded OS'es SP, WinCE, Symbian 7 to
8.0b
· Middleware Apps for ARM line of processors (include video and audio codecs)
· McAfee GroupShield 5.0
· McAfee GroupShield 5.2
· McAfee GroupShield 6.0 followed by patch release
· CDMA Based Wireless PCO Terminal, first live implementation in India
Technical Background:
B.Tech. in Electronics and Communications
Microsoft Certified Professional (MCP)
Microsoft Internet Specialist
Microsoft Certified Software Engineer
Certified Software Test Engineer
ISTQB Certified Test Engineer—Foundation level
BBuuiillddiinngg AAuuttoommaatteedd TTeesstt SSyysstteemmss ––MMiiccrroossoofftt WWiinnddoowwss VVeerrssiioonn 22..00 PPaaggee nnuummbbeerrss
• AUTHOR: ABHINAV VAID IN ALL THINGS BE MEN
Assumptions:
I have assumed that the end user (a Test Engineer or an Automation Engineer) has some
level of OS knowledge and has done some programming/testing in the past.
1. Target Audiences:
This book is not for:
· Teaching Programming/Scripting
This book is for:
1. Test Engineers
2. Engineers, who aspire to build Automated Test Systems. Irrespective of whether they
are Dev engineers/or Test engineers.
3. Intermediate to Advanced Software Engineers/Testers.
This book can be used by:
1. Beginners: who aspire to take up Software Testing/Software Test Automation as a
career path.
2. Developers: who aspire to get into Test Automation or know the insights of the
domain.
Feedback and Support:
Although I have tried my level best to cover the subject and tried to trim down to as short as
possible to have a focused approach. as much as I possibly could and have tried to make it as
generic as possible. I would like to hear as to what you liked and what is it you did not like
(all the more important).
Any questions/feedback etc is more than welcome. I will address all the queries, it might take
some time to reply but I will definitely reply.
Contact me: [email protected]
BBuuiillddiinngg AAuuttoommaatteedd TTeesstt SSyysstteemmss ––MMiiccrroossoofftt WWiinnddoowwss VVeerrssiioonn 22..00 PPaaggee nnuummbbeerrss
PAGE NUMBERS
•
Building Automated Test Systems -- Microsoft Windows version 2.0:
CChhaannggeess IInnccoorrppoorraatteedd iinn VVeerrssiioonn 22..00
1. There were bugs in code as well as language, which have been fixed in this version.
2. There were various suggestions, inputs from various sources which I have tried to
incorporate (which made sense to me and gave me time to do so). Most of it is the latest
Windows Flavors in the market today.
Summary Snapshot of the Book: Building Automated Test Systems-- Microsoft
Windows starts with giving a background on Test Automation. Technical as well as process
perspective.
Briefs about the Technical background required to build Test Automated Systems and
recommended automation methodologies.
The book has taken some of most popular 3rd Party Test Automation Tools available in the
market, practically implemented/automated a test suite/plan using all the tools, one by one.
The Test Application/Plan picked up to automate is one of the most common among
computing guys( for easier understanding) and has taken Test Plan of 1 particular
Functionality, and the Automation is done using them.
Using some of the most popular Test Automation Tools, and why do they fail,?
Misleading promises by the Tool Vendors have always costed a lot to the
Organizations, and still does not deliver what it is supposed to. Why do
Organizations buy the expensive test automation tools and later regret,when
they are not been able to justify the ROI.
The Book has gone into Operating System Internals(only from the Testing and Automation
perspective), and the inherent engines that support Test Automation. Explains the
background insights as to what happens when you automate an application, how do the test
automation tools handle it and what is the suggested workarounds to make them generic
enough so that it works across across platforms removing the dependencies.
BBuuiillddiinngg AAuuttoommaatteedd TTeesstt SSyysstteemmss ––MMiiccrroossoofftt WWiinnddoowwss VVeerrssiioonn 22..00 PPaaggee nnuummbbeerrss
• AUTHOR: ABHINAV VAID IN ALL THINGS BE MEN
The book has taken a couple of scripting tools\languages most of them under open source
licensing and automated the same Test Suite(which we did using Test Automation tools using
10 different technologies\languages etc using OS internals which even Test Automation Tools
also use.
CCoonnvveennttiioonnss UUsseedd iinn tthhee BBooookk::
There are a couple of conventions that I have tried to use to have a better clarity in terms of
the important points and their associated interpretations. The same could be used as a handy
Reference.
Conventions Used Intended Interpretations
R & D Related Stuff, and tips/scope to dig
Food For Thought
further if you look forward towards to dig
further
Tips Important tips for successful and handy
Reference
Beware about Running the Tests as there
Precautions and Suggested
could be side effects to the Lets say for
workarounds
Example being quoted, tips to take
precautions, and suggested workarounds in
case it happens.
Tools which are around for a while and have
Tools and Associated Support
penetrated into the space to the extent of
contributions to the Test Engineering
Automation
The highest level aspiration every good tester
Bringing Intelligence in Test
looks forward to; to be a perfectionist.
Automation
BBuuiillddiinngg AAuuttoommaatteedd TTeesstt SSyysstteemmss ––MMiiccrroossoofftt WWiinnddoowwss VVeerrssiioonn 22..00 PPaaggee nnuummbbeerrss
PAGE NUMBERS
•
TTaabbllee ooff CCoonntteennttss
CChhaapptteerr11:: TThhee EEvvoolluuttiioonn ooff SSooffttwwaarree TTeessttiinngg ttoo TTeesstt AAuuttoommaattiioonn............................................................................1144
PPrreeffaaccee aanndd IInnttrroodduuccttiioonn....................................................................................................................................................................................1144
SSeettttiinngg uupp tthhee SSttaaggee ffoorr TTeesstt AAuuttoommaattiioonn..............................................................................................................................1144
TTeesstt AAuuttoommaattiioonn iinn EEmmbbeeddddeedd SSyysstteemmss....................................................................................................................................1177
TTeesstt AAuuttoommaattiioonn LLiinnuuxx..................................................................................................................................................................................1188
OOrrggaanniizziinngg tthhee GGrreeyy MMaatttteerr 1188
SSoommee HHiigghheerr LLeevveell aabbssttrraaccttss oonn TTeesstt AAuuttoommaattiioonn TToooollss...................................................................................... 1199
GGeettttiinngg iinnttoo IInnssiigghhttss ooff TTeesstt AAuuttoommaattiioonn................................................................................................................................ 2200
CChhaapptteerr 22 :: UUssiinngg 33rrdd PPaarrttyy TToooollss ffoorr TTeesstt AAuuttoommaattiioonn........................................................................................................2200
UUssiinngg WWiinnrruunnnneerr ffoorr TTeesstt AAuuttoommaattiioonn............................................................................................................................................2200
UUssiinngg LLooaaddRRuunnnneerr ffoorr TTeesstt AAuuttoommaattiioonn...................................................................................................................................... 3333
UUssiinngg QQuuiicckkMMaaccrrooss ffoorr TTeesstt AAuuttoommaattiioonn......................................................................................................................................3388
IImmpplleemmeennttaattiioonn uussiinngg QQuuiicckkMMaaccrrooss................................................................................................................................................ 4488
HHooww QQuuiicckk MMaaccrrooss WWoorrkkss:: IInnssiigghhttss................................................................................................................................................ 5577
UUssiinngg QQuuiicckk TTeesstt PPrrooffeessssiioonnaall ((QQTTPP)) ffoorr TTeesstt AAuuttoommaattiioonn......................................................................................6677
CChhaapptteerr 33:: TToouucchhiinngg tthhee OOSS IInntteerrnnaallss,, iinnssiigghhttss ttoo mmaakkee aa TTeesstt AAuuttoommaattiioonn PPrroojjeecctt aa SSuucccceessss....
7766
AArrcchhiitteeccttuurree OOff MMiiccrroossoofftt WWiinnddoowwss........................................................................................................................................................ 7777
BBrriiddggeeiinngg TThhee LLooggiiccaall DDiivviiddee:: TTeesstt AAuuttoommaattiioonn CChheecckkss && mmaappppiinngg//iinntteerrpprreettaattiioonn ttoo tthhee
CCoonnvveennttiioonnaall MMiiccrroossoofftt WWiinnddoowwss iinnssiigghhttss.. ..............................................................................................................................7799
MMiiccrroossoofftt WWiinnddoowwss KKeerrnneell -- AA BBrriieeff PPrriimmeerr............................................................................................................................ 8800
TThhee CChhaannggiinngg TTrreennddss ooff PPaarrttiittiioonniinngg iinn WWiinnddoowwss::..........................................................................................................8822
WWhhaatt iiss CCOOMM:: AAnndd hhooww iiss iitt aassssoocciiaatteedd wwiitthh TTeesstt AAuuttoommaattiioonn ...................................................................... 9922
CChhaapptteerr 44:: MMaakkiinngg aa BBuussiinneessss CCaassee ttoo BBuuiilldd TTeesstt AAuuttoommaattiioonn SSuuiitteess//FFrraammeewwoorrkkss:: UUssiinngg 1100
ddiiffffeerreenntt tteecchhnnoollooggiieess//llaanngguuaaggeess ttoo ddoo tthhee ssaammee TTeesstt AAuuttoommaattiioonn ddoonnee uussiinngg CCoommmmeerrcciiaall
TTeesstt TToooollss............................................................................................................................................................................................................................9944
WWhhaatt aarree OObbjjeecctt MMooddeellss:: ...................................................................................................................................................................... 110055
CCaappttuurriinngg aanndd UUssiinngg OObbjjeeccttss::.................................................................................................................................................................. 110066
AAuuttoommaattiinngg OOffffiiccee AApppplliiccaattiioonnss ........................................................................................................................................................111155
UUssiinngg WWSSHH ffoorr TTeesstt AAuuttoommaattiioonn........................................................................................................................................................111199
10 BBuuiillddiinngg AAuuttoommaatteedd TTeesstt SSyysstteemmss ––MMiiccrroossoofftt WWiinnddoowwss VVeerrssiioonn 22..00 PPaaggee nnuummbbeerrss
Description:Building Automated Test Systems Microsoft Windows version 2.0 Power consists in one’s capacity to link his will with the purpose of others, to lead by reason
