Open Source

Solex http://solex.sourgeforge.net
Watir http://wtr.rubyforge.org/
Jameleon http://jameleon.sourceforge.net/index.html
Web Tst http://webtst.assisrosa.com/
XML Test Suite http://xmltestsuite.sourceforge.net/
Bugslayer
MS-WAS

Commercial
TestSmith
e-Tester
AdventNet Qengine
PHANTOM Test Driver v1.1
Tasker
Name of the Tool BadBoy

Version number of Tool version 1.5-beta-3

Name of the Vendor Badboy Software

c/o Simon Sadedin
7/27 Glen St
Number of years in business Not available
Hawthorn
VIC 3122
AUSTRALIA
Customer references Not available

Cost Individual license: USD $40;

Volume Discount? 10 license pack: USD $250

Issues with international sales? No

Platforms Supported IE on Windows 2000

Windows XP
Windows 98 R2
Windows NT4.0
Test Management Capabilities None

Record once, play anywhere Supports

Scripting, script editing, language Can add variables,
assertions, datasource,

Ability to select subset of tests to Tests can be divided into

run steps and steps can be
played selectively
What reporting options are Logs can be created from the
provided script

Is an evaluation version available? Available.

Website http://www.badboy.com.au/

Acceptable?
Additional Comments

Workflow A: Goal – does it work?

login, run an analysis, logout

Workflow B: Goal – does scripting

work?

login, add user, capture user name

in variable, logout, login as that
user, select a dataset, change
preferences, logout

Workflow C: goal – does report

navigation work?

login, run a record listing, view

next page, view last page, logout
e-Tester [e-Test Suite] Trecorder AutoIt

e-Test Suite 8.0 Version 1.2 Version 3

Empirix Corporate Offices cyamon software Hidden Soft

Corporate Headquarters Couronne 3 support@hiddensoft com
20 Crosby Drive 1040 Echallens
Founded in September
Bedford, MA 01730 USA2000, Not Available
Switzerland Not Available
Empirix combines
Phone: (781) the award-
266-3200
winning Web
Fax: (781) test and monitoring
266-3201 info@cyamon.com
solutions
Ford of RSW
Motor*, Software
Wal-Mart (est.
Stores*, Not Available Not Available
1997)
HP with the industry-leading
Compaq
voice
KPMG and network Lucent,
Consulting, test solutions
Nokia,
of Hammer Technologies
Nortel Networks (est.
1990).
Not Available
Siemens, Sun Microsystems, Freeware Freeware
Verizon, Cisco Systems
China Netcom, Exxon Mobil*,
Not Available NA
General Electric*
Not Available NA NA
General Motors*, Wal-Mart
Stores*,
Windows AirTours, Ltd. Not Documented Windows
American Airlines, AT&T, BBC
Online
*Fortune 5 Global Leaders
Test management and No Not Documented
integration with defect tracking
make e-Tester the centerpiece
of a total quality solution.
Supports Record & Playback
e-Tester
Visual scriptstechnology
Script™ integrate No AutoIt is a freeware Windows
seamlessly with Empirix
provides the fastest and easiest automation language. It can
scalability, monitoring,
way to create test scripts, testwith be used to script most simple
management, and defect
no programming required. Windows-based tasks (great
tracking components
Extending to provide
Visual Scripts with for PC rollouts or home
a comprehensive
Visual enterprise and
Basic for Applications No automation).
Not Documented
application
other performance
standard programming
solution. allows you to handle a
languages
wide array Visual
e-Tester's of testing challenges.
Scripts allow Not documented Not Documented
The to
you Data Bankand
quickly Wizard™
easily create
simplifies
scripts creation
that test all of data-driven
the objects
tests.
on each page and indicate errors
with color-coded flags.

Available Available Available

http://www.empirix.com http://www.cyamon.com/trecorder.htm
http://www.autoitscript.com/autoit3/
Awards & Recognition:
Frost & Sullivan
Market Leadership Award, 2004

Call Center Magazine

2005 Product of the Year:
OneSight for Contact Centers

TMC Labs
Innovation Award 2004

ICCM/CRM 2002
Best of Show Customer Interface
Hammer On-Call

and many others

TestSmith AdventNet QEngine

QEngine 4.1.3
Available since 18-Feb-2005
Quality Forge Headquarters:
AdventNet, Inc.
sales@qualityforge 5645 Gibraltar Drive, Pleasanton,
Not Available Founded
CA 94588, in USA
1996
Phone: +1-925-924-9500
Fax: +1-925-924-9600
Not Available sales@adventnet.com
Motorola, Acme Packet, Inc.,
Toll Free:
Redline +1 888 720 9500
Communications, Openwave,
Parama Networks, Computer Process
Controls (CPC),
Single Machine License* Node Locked License FeeAperto
KEYMILE/Datentechnik,
Intended for use within an organization US License Networks, Fee - US$ 995
$500.00
Not Available Annual
Allied M & Snot
Telesyn
Information Fee - $199 Thomson
Networks,
available
Not Documented Corporation,
For more information need to contact.
Domain-wide License Infinera, ECS, Inc, Veraz Networks,
Can be used on up to 10 machines within
Windows Fortinet,
Windows, Linux, and Solaris
the specified domain US $1,000.00 Mitel Networks, ASAP Software,
Tollgrade,
Organization-wide License Webrizon, Com Dev Broadbrand, ITCS
Can be used on up to 20 machines within
Not Documented Automated Filing of failure reports into
the organization US $2,000.00
Bug Tracking System.
E-mail Alert provides notification via
There is a surcharge of US $100.00 for
Record & Playback SMTP
Recordfor & test case failures.
Playback
payments made in non US currency.
By default, TestSmith tests are recorded Application interoperability with
using the proprietory Smith script multiple databases.
language. Categorized Executive Summary
TestSmith can be configured to record reports based on Test Properties.
tests in Java, C++ or C++/MFC.
Smith scripts can be played back
Not Documented
immediately (without compiling) from the
TestSmith GUI.
All Testsmith
TestSmith tests can
produces beplain
both edited during
text and a Validation Reports generated on
recording,
html as well as
reports/logs. afterwards,
Seven levels ofbut only completion of tests indicate the status
logging
Smith
are scripts can
provided, eachbeone
reopened in
independent of the of executed test cases. They give both
TestSmith;
others. scripts in other languages a summary and a detailed view of the
should be managed in an appropriate IDE test results.
for the language.
Reports contain precise timing information Consolidated Summary Report
Data
for eachDriven
command as well as command ids consolidates the reports obtained
HTML/DOM
and detailed - information
Aware of any across
90 days evaluation available 15 daysa evaluation
network system and
pack available
Synchronized
discrepancies and errors. generates the summary.
Multi-threaded
The final run time for each execution of a
http://qualityforge.com/testsmith/index.html http://www.adventnet.com/products/qengine/index.html
script is also saved to a timing log (a *.csv
file), which can be viewed in a spreadsheet
application.
An extensive, platform independent
Test Automation tool used for Web
Functionality, Web Performance, Java
Application Functionality, Java API,
SOAP, Regression, and Java
Application Performance testing.
Supports testing of applications
developed using HTML, JSP, ASP,
.NET, PHP, JavaScript/VBScript, XML,
SOAP, WSDL, e-commerce, traditional
client/server etc. Tool is developed
using Java which facilitates portability
and multiple platform support
(Windows, Linux, and Solaris).
Phantom Silk Test

PHANTOM Test Driver v1.1 version 7.0

Phantom Automated Solutions Corporate Headquarters

Segue Software, Inc.
201 Spring St
Phantom Automated Solutions was founded 17 years MA 02421
Lexington,
in 2000 with the goal of providing quality USA
automation software at an affordable price. t: 800.287.1329
(5 years)
Not available t:
NA781.402.1000
f: 781.402.1099

Single-User License : $40.00 Need to Contact to aquire

5-License Package : $190.00 this information
25-License Package : $900.00
No information
Site
No License : $4000.00

Windows 95-based and Windows NT 4.0

based systems and higher

None Yes

Supports
Designed primarily as a application test Supports
platform, testcases can be created and
organized into suites. Suites can be
executed in whole or in part, depending on
what functionality is to be tested. The built
in is
It script recorder
possible allows selected
to execute for easy script
test cases in
creation and color-coded text makes script
suite
editing a breeze.
Automatic results comparison and error
logging prove a quick and easy method for
test analysis

Available Available

http://www.phantomtest.com/ http://www.segue.com/
The Phantom scripting language is a powerful
Windows automation language that allows
you to take control of windows and perform
functions automatically. Simulate any
combination of key strokes and mouse clicks,
as well as many built in functions for edits,
buttons, menus, lists, and more!
yes

It will capture co ordinates of mouse clicks

and repeats in playback. It support editing of
scripts.

Yes

1. Check point are not there.

2. Auto Synchronization is not there.
3. Not supporting view state.( not capturing
status of buttons)
4. It is not supporting global variables
5. No Built in functions in Phantom to interact
with a database
6. It will not record Menu Items.( but
support’s short cut keys)
QARun AutoTester for Windows

Current Release 4.9.1 Version 4.0

Compuware AutoTester Inc.

One Campus Martius 10300 N Central Expwy., Suite 550
Detroit, MI 48226 Dallas, TX 75231-8600
Founded
USA in 1973, Compuware serves the 20 years
USA
world's leading IT organizations, including
Phone: 800-COMPUWARE Phone: (800) 328-1196
more than 90 percent of the Fortune 100
Fax: 313-227-9901 Fax: (214) 750-9668
companies.
automated-testing@compuware.com
No details available info@autotester.com
Over 1600 customers Representing every
http://www.compuware.com/ http://www.autotester.com/
industry segment
3Com, Aegon USA, Air Canada, Allfirst Bank,
AT&T,
No details available Need to contact
Banc Tec, forAmerica,
Bank of more information
Mitsubishi, Moen,
Motorola,
No details available New York Life Insurance, Proctor & Gamble,
Programart Corporation, Prudential Insurance,
Reebok International, Revenue Canada
All Windows and character based platforms Windows 3.X, Windows 95, Windows NT

Integrated Test Management

AutoTester ONE's integrated test management
tool, Test Organizer, manages the quality
assurance process of all your mission critical
Sophisticated error recovery through event software Scripting
Powerful projects throughout
Language their entire
logic. Decisions based on the error are lifecycle.
The AutoTester ONE Scriptingthrough
From requirements Language is a
required during testing. QARun uses a production,
powerful commandTest Organizer provides
set which is usedatocentral
simple event-driven logic to build repository for organizing and managing
supplement your captured tests or to develop your
intelligence into test scripts. Test reliability business
tests requirements,
before tests code
your application and associated
is
is
Noincreased by enabling the test script to
details given files, and test
completed. Theresults.
command set is presented
make decisions about the flow of the with simple menus that step users through
automation process development with on-line help and familiar
QARun creates a log file each time a test is controls. Developers
Automated can use
Documentation theReporting
and scripting
run. It contains all the commands and test capabilities ONE
AutoTester to incorporate conditional
automatically documents
data sent by scripts to the target branching,
every step oflooping,
every and
test external test in
you perform case data
plain
application, along with color-coded results into their tests.
English. Tests are easily identified by test case
of all the checks made. If a check fails, the numbers and test requirement identifiers, that
expected and the actual responses are include detailed descriptions for reference
written to the log for comparison. purposes. After test execution, detailed results
Available are available on-line or in report format for
immediate review and analysis.

http://www.compuware.com/products/ View summary and detail results of each test

http://www.autotester.com/
run on-line, in a customizable format, with the
Results Viewer.
Review complete test results with the Test Log
which details each test step performed and
whether it passed or failed.
Track application errors with the Error Log that
documents the details of each failed test.
Monitor system performance of host and
server-based applications through response
times.
You can test web, Java, ERP/CRM, AutoTester for Windows is an automated
character-based wireless and PDA testing solution designed for the creation,
applications as well as traditional execution and documentation of automated
client/server and emulator-based tests for Windows 3.x. NT, and 95 applications
applications.
QARun is certified by the SAP
Complementary Software Program (CSP)
to provide a seamless link to SAP R/3
Release 3 and 4 solutions.
In addition, QARun is now certified by
Oracle to provide a comprehensive
automated software quality testing
solution for Oracle 11i eBusiness Suite
implementations.
Support for web technologies includes
ActiveX, HTML, DHTML, XML, Java beans,
and more. Execute web tests independent
of the web browser using QARun.
QARun supports applications developed
from the leading Java development
environments:
JVMs: IBM, Sun, Microsoft
Java Class Libraries: AWT, Swing, Borland
JBuilder, Infragistic Jsuite, IBM Visual
Café, Visual Age
e-Monitor WinFeedback

NA WinFeedback 4.0

NA NorhStar Solutions
Thomas Borjeson, Skonaren 1:3:3,
SE-444 30 Stenungsund, Sweden.
NA Not available
E-mail:
postmaster@winfeedback.com
Phone +46 303 72 67 00 Fax +46
NA 303 72 66 07
Not available

NA $65 for one company license.

NA WinFeedback may be downloaded

NA for free tryout. It is distributed as a
Windows Installer Package (MSI):
NA Windows 9X/NT/2000/XP

NA WinFeedback 4.0 is a Windows

Scripting extension for testing,
monitoring and automation
NA purposes
Record & Playback
NA The WinFeedback engine is an
ActiveX DLL that is developed in
Visual Basic 6.0. WinFeedback
objects are used as scripting
components in VbScript. The library
NA contains
NA more than 100 methods
and properties and its primarily
object is called TScript for Testing
NA Script.
WinFeedback includes a
ResponseTimer object that is used
to create result reports in HTML
format. All captured performance
data may be saved to tab-separated
log files and further analyzed in
Microsoft Excel.
NA Available
WinFeedback 4.3.0

NA http://www.winfeedback.com
Details no more
available at URL:
http://www.empirix.
com
Tasker

VistaTask Pro Version 4.1

Vista Software, Inc.

PO Box 93055
Phoenix, AZ 85070
Not availabbe
USA
Phone: 213-300-1331
steve@vista-software.com
http://www.vista-software.com/
Not availabbe

$129

10 licenses at $89.95 each

Windows 95/98/ME/NT 4.0/2000/XP

No enough details

Recording & Playback

Checkpoints, Loops, and Jumps
User-defined Variables
Conditional Logic, Math Calculations
Data-driven Scripts and Web Automation
Create Standalone .EXE Programs
(which are freely
No enough detailsdistributable)

No enough details

30 days trial

http://www.vista-software.com/
The main goal of VistaTask Pro has always
been simplicity. Current software
automation tools are too complex, and
definitely too expensive. It shouldn't be
necessary to learn a new programming
language to test software or automate a
basic task. In this role, VistaTask Pro excels
through its clean, standard Windows
interface, while providing all the power you
would expect from professional automation
software.

There is zero code to write in VistaTask Pro

- just click to add new commands. Since no
programming is required, anyone can create
powerful automation tasks. Although it uses
no code, VistaTask Pro still allows you to
control all aspects for each action in its
feature-rich interface.
SNo Tool Name Versi License URL Features
on

Open-Source
1 Test Maker License www.pushtotest.com Record and playback

A scripting tool and language for

General testing web applications that use
2 Doit public lisence http://doit.sourceforge.net/ forms
1) Set of java tools for functional
test of J2EE web applications
2) Tests can be
automated for web front end and
3 Bugkilla GPL http://bugkilla.sourceforge.net/ business logic

1) Automated testing tool for web

applcation and services
2) HTTPs & SSL protocols
are supported 3)
General Cookies are supported
4 WebInject public lisence http://www.webinject.org/ 4) State management is possible

1) S.A.M. for I.E. is a Perl module

(SAM.pm) that allows a user to run
automated tests for their browser
applications 2) Can
write or modify code
5 Samie http://samie.sourceforge.net/ 3 ) DOM model is created

1)Pounder is a utility for testing

Java GUIs.
2) It allows developers
to dynamically load components,
record scripts, and then use those
6 Pounder http://pounder.sourceforge.net/scripts in JUnit.
 1) Record / Playback tool
Capture andassertion,
2) Has play back Extraction
for java
7 Jacareto http://www.ph-ludwigsburg.de/mathematik/personal/spannagel/jacareto/
applications.
and Parameterisation
3) Acts as web proxy
4) Recorded
sessions saves as xml file and
reopened later
5) Requests can be
filtered(Unwanted things can be
removed) 6)
Can reply request by request or all
Solex requests at once
8 Solex 0.5.0 http://solex.sourgeforge.net

9 Web Tst Open-Source http://webtst.assisrosa.com/ 1. Capture of recordings via easy

License web browsing
2. Management of recordings via
easy web forms
3. Support for folders for recording
management
4. Support for custom built testing
5. Support for sequence of tests
calling
6. Support for sub test calling
7. Support for variety of simulated
user agents
10 XML Test Open-Source http://xmltestsuite.sourceforge.net/
1.
8. Check
Supportsite
forstructure:
command line
Suite License HTML pages are well formed and
execution of tests
links are valid
9. Support for building and
2. Check the content
maintenance of pages
of test suites (smoke
Use Javascript variables, XPath
and regression)
expressions, database queries
3. Check the way the site works:
Run test scanarios, written in XML
Comments

TestNetwork is available right now, is licensed

under a simple commercial software license,
and costs from $10,000 US for a 2 node license
(discounts available.)

Not userfriendly

Can support only J2EE

1)Uses Perl language and not userfriendly

2)Cant test GUI thrugh web browser

1) Has lience of 11$

2) Has limited features

1)Largely used for Unit testing

2)Points may not recorded precisely. There may
be a rounding issue.
3)Mouse motion related events do not
always playback correctly
4)Popup menu events are not
cross-platform
 1)If you want to replay mouse events, capture
"mouse pressed"- and "mouse released"-
events. Just capturing "mouse click"-events
will not work. (The same for "key pressed"-
and "key released"-events, contrary to "key-
typed"-events). 2)When capturing key-
typed events, backspaces will not be
recognized.
3)When you are not capturing
mouse events, and when you choose a
position in a text area with the mouse and
then type a text during the capture process,
the typed text wil display at a wrong position
during the replay process.

Not montioned about view state

1. Not montioned about view state 2.

Not mensioned regarding Dot Net support 3.
Not mensioned about pop up window handling

1. Testing is only through scripting no record

and play back 2.
Not mentioned regarding Dot Net support 3.
Not mentioned about pop up window handling
4.Not mentioned
about view state