QA Tools Comparison Matrix

This section will try to keep an as objecive as possible list of interesting tools available on the marketplace. If you observe broken links/errors or have some suggestions of tools to add to the list please send us a message.



 
In the following, support will be represented by color:

Legend:
Req Requirements management
Spec Specifications management
Plan Testplans generation/export
Report Test campaign report
Bug Integrated bug-tracking system
Manual Manual testing
Auto Automated testing drivers
Unit Unit testing
Func functional testing
Load Load testing
Stress Stress testing
  

Test Tools





QA Test Tools Comparison Matrix
Test Management Automated Test
R
e
q		 S
p
e
c		 P
l
a
n		 R
e
p
o
r
t		 B
u
g		 M
a
n
u
a
l		 A
u
t
o		 U
n
i
t		 F
u
n
c		 L
o
a
d		 P
e
r
f
Free
XQual XQual Yes Yes Yes Yes Yes Yes Yes        
Testopia Testopia ? ? Yes Yes Yes Yes          
QaTraq QaTraq Open Source Yes       Yes ? ?        
TestLink TestLink Yes Yes Yes Yes   Yes Yes        
TestMaster TestMaster     Yes Yes              
Rth Rth Yes   Yes Yes Yes            
Concordion Concordion   Yes         Yes        
STAF STAFF             Yes   Yes    
JUnit JUnit               Yes (Java)      
CUnit CUnit               Yes (C)      
CppUnit CppUnit               Yes (C++)      
PhpUnit PhpUnit               Yes (PHP)      
HTMLUnit HTMLUnit               Yes (HTML)      
XHTMLUnit XHTMLUnit               Yes (XHTML)      
HTTPUnit HTTPUnit               Yes (HTTP)      
Google WebDriver               Yes (JavaScript)      
JWebUnit JWebUnit               Yes (Web)      
Fitnesse FitNesse               Yes (Web)      
JFunc JFunc                 Yes (Java)    
Testing Anywhere Testing Anywhere                 Yes (Web, Silverlight, AWT/Swing, WPF and .NET) Yes (Web, Silverlight, AWT/Swing, WPF and .NET) Yes (Web, Silverlight, AWT/Swing, WPF and .NET)
The Grinder The Grinder                   Yes (Java) Yes (Java)
OpenWebLoad OpenWebLoad                   Yes (Java) Yes (Java)
FWPTT FWPTT                   Yes (Java) Yes (Java)
OpenSTA OpenSTA                   Yes (Java) Yes (Java)
Curl Loader Curl Loader                   Yes (Java) Yes (Java)
AutoIt AutoIt                 Yes (Win32 applications and IE)    
AutoHotkey AutoHotkey                 Yes (Win32 applications)    
Java.net Jemmy                 Yes (Awt and Swing)    
Abbot Abbot                 Yes (Awt and Swing)    
GUITAR Abbot                 Yes (Awt and Swing)    
QAliber QAliber                 Yes (Windows applications)    
Sikuli Sikuli Script                 Yes    
VNCRobot VNCRobot                 Yes (Swing through VNC)    
Fitnium FitNium       Yes   Yes          
WatiN WatiN                 Yes (Web (C#))    
Watir Watir                 Yes (Web (Ruby))    
CubicTest CubicTest                 Yes (Selenium)    
Telerik WebAii Framework             Yes Yes Yes    
JBehave JBehave             Yes        
TextTest TextTest                 Yes (Text-based)    
Cucumber Cucumber Yes           Yes        
SpecFlow SpecFlow Yes           Yes        
Twist Twist Yes           Yes   Yes (Selenium (web) & Frankenstein (swing))    
Gauge Twist Yes           Yes   Yes    
Sahi Sahi                 Yes (Web (JavaScript))    
Hammerhead Hammerhead2                   Yes Yes
The Grinder Grinder                   Yes Yes
Pylot Pylot                   Yes Yes
OpenSTA OpenSTA                   Yes Yes
OpenLoad OpenWebLoad                   Yes Yes
WebLoad WebLoad                   Yes Yes
JCrawler JCrawler                   Yes Yes
Hammerora Hammerora                   Yes Yes
DieselTest DieselTest                   Yes Yes
CLIF CLIF                   Yes Yes
JMeter JMeter                   Yes Yes
SIPr SIPr                 Yes (SIP, HTTP)    
SIPp SIPp                 Yes (SIP)    
PJSIP pjsua                 Yes (SIP)    
Playwright Playwright (Microsoft)       Yes     Yes   Yes    
Cypress Cypress       Yes     Yes   Yes    
Robot Framework Robot Framework     Yes Yes   Yes Yes Yes Yes    
Appium Appium (Mobile)             Yes   Yes    
TestNG TestNG (Java)       Yes     Yes Yes Yes    
NUnit NUnit (.NET)       Yes     Yes Yes Yes    
MSTest MSTest (Microsoft .NET)       Yes     Yes Yes Yes    
pytest pytest (Python)       Yes     Yes Yes Yes    
Jest Jest (JavaScript)       Yes     Yes Yes Yes    
Vitest Vitest       Yes     Yes Yes Yes    
Postman Postman       Yes     Yes   Yes    
Insomnia Insomnia (Kong)             Yes   Yes    
Karate Karate DSL       Yes     Yes Yes Yes    
REST Assured REST Assured (Java)             Yes Yes Yes    
k6 k6 (Grafana Labs)       Yes     Yes   Yes Yes Yes
Gatling Gatling       Yes     Yes     Yes Yes
Locust Locust (Python)       Yes     Yes     Yes Yes
Artillery Artillery       Yes     Yes   Yes Yes Yes
Allure Allure Report       Yes              
Commercial
XQual XQual Yes Yes Yes Yes Yes Yes Yes        
Borland (Segue) SilkCentral Test Manager Yes   ? Yes ? ? Yes (SilkTest, SilkPerformer, JUnit and NUnit)        
SilkTest (QAPartner)                 Yes (UI (through 4Test proprietary language))    
SilkPerformer (WebPartner)                   Yes Yes
OpenText (formerly MicroFocus, HP, Mercury) Quality Center (formerly TestDirector) Yes   Yes Yes Yes Yes Yes        
ALM Yes   Yes Yes Yes Yes Yes        
Octane / Software Delivery Management Yes   Yes Yes Yes Yes Yes        
QuickTestPro / UFT             Yes   Yes    
WinRunner (deprecated)r)             Yes   Yes (GUI)    
LoadRunner                   Yes Yes
OpenText QADirector Yes   ? Yes Yes ? Yes        
TestPartner                 Yes (Web, .Net, Java, SAP, Oracle and Win32 applications)    
QALoad                   Yes Yes
IBM (Rational) Rational TestManager ? ? Yes Yes Yes Yes Yes        
Rational Manual Tester           Yes          
Rational Functional Tester                 Yes (Web, .Net, Java, Thick clients, VB, C/C++, Oracle, PowerBuilder and Delphi)    
Rational Robot                 Yes (VB, C/C++, Oracle, PowerBuilder and Delphi)    
Rational Performance Tester                   Yes Yes
Empirix e-Manager enterprise Yes   Yes Yes Yes Yes Yes        
e-Tester                 Yes (Web)    
e-Load                   Yes Yes
TestPad TestPad     Yes Yes   Yes          
Microsoft TFS Test Manager (now Azure DevOps) ?   Yes Yes   ? ?        
UTest UTest                 Yes Yes Yes
Parasoft JTest                 Yes (Java)    
C++Test                 Yes (C++)    
WebKing                 Yes (Web)    
T-Plan T-Plan Professional Yes   Yes Yes   ? ?        
Perforce TestTrack TCM     Yes Yes   Yes Yes        
TestTrack Studio     Yes Yes Yes Yes Yes        
QA Wizard Pro                 Yes (Web, C#, VB.Net, C++, Win32 applications, Qt, AJAX, ActiveX, Javascript and HTML)    
APTest APTestManager Yes Yes Yes Yes   Yes          
QaTraq QaTraq Pro Yes   Yes Yes Yes ? ?        
PassMark Software TestLog     Yes Yes   Yes          
Conformiq Qtronic SG             Yes   Yes    
Qtronic GP Yes     Yes              
OptimalTest OT-Mgr ? ? ? Yes Yes ? ?        
Original Software Qualify Yes   Yes Yes   Yes          
TestBench               Yes Yes    
TestDrive                 Yes    
TestDrive Assist           Yes          
Keysight EggPlant Functional             Yes   Yes    
EggPlant Performance                   Yes Yes
EggPlant Manager     Yes Yes   Yes Yes        
Zephyr Zephyr Yes   Yes Yes Yes Yes Yes (Command line third-party tools)        
Inflectra SpiraTest Yes     Yes Yes Yes          
Tricentis TOSCA Testsuite Yes   Yes Yes   Yes Yes Yes Yes    
JadeLiquid Software LiquidTest       Yes     Yes Yes Yes (Web)    
SmarteSoft SmartQM Yes     Yes Yes   Yes        
SmartScript                 Yes    
SmartLoad                   Yes Yes
TestOptimal TestOptimal       Yes   Yes Yes   Yes (Web) Yes  
LordUI LordUI                   Yes  
Objentis QAS.TCS       Yes   Yes Yes        
mjtnet Macro Scheduler                 Yes (Win32 applications)    
TechExcel DevTest       Yes Yes ?          
InformUP TestUP       Yes   Yes          
ID Consultants DuxQA Yes   ? Yes Yes Yes          
Testuff Testuff Yes   Yes Yes Yes Yes Yes (API to external automation tools)        
CatchLimited Enterprise Tester Yes Yes (Sparx Systems Enterprise Architect) Yes Yes Yes Yes          
PractiTest PractiTest     Yes Yes Yes Yes          
QMetry QMetry Yes Yes Yes Yes Yes Yes          
Polarion Polarion Yes                    
DevExpress TestCafe       Yes     Yes   Yes (Web)    
TestWave TestWave Yes   Yes Yes Yes Yes          
OpenGroup TET             Yes        
FrogLogic Squish       Yes         Yes (Qt, Java, Web and Tk)    
Ranorex Ranorex                 Yes (C++, C# and Python)    
soapUI soapUI                 Yes (Web services)    
InCisif.net InCisif.net                 Yes (Web)    
Minq Software PureTest                 Yes (Web)    
PureLoad                   Yes Yes
PureAgent                     Yes
Quotium QTest                   Yes Yes
AutomatedQA TestComplete           Yes   Yes Yes Yes Yes
Elvior MessageMagic               Yes Yes (TTCN3)    
XML-simulator               Yes Yes (XML messaging protocols)    
Software Research Inc TestWorks                 tools    
Wintask Wintask             Yes   Yes (Win32 applications, IE)    
Origsoft Testdrive Gold       Yes     Yes   Yes (Web, GUI)    
Testdrive Assist       Yes   Yes          
ITKO LISA                 Yes (Web, Java, .Net) Yes Yes
Microsoft VisualStudio 2008       Yes     Yes   Yes    
Orcanos QPack Yes Yes Yes Yes Yes Yes          
SoftLogica WAPT                   Yes Yes
RapidRep RapidRep                 Yes    
MSys Mobitaz               Yes Yes    
PurpleStrike RT                   Yes Yes
Exept Software AG Expecco     Yes Yes       Yes Yes Yes Yes
Telerik WebUI Test Studio       Yes   Yes Yes Yes Yes    
SmartBear QAComplete Yes   Yes Yes Yes Yes Yes        
DevComplete Yes Yes                  
Zeta Test Zeta Test     Yes Yes   Yes          
S3 Stormtest       Yes     Yes (IPTV, Set-Top boxes)   Yes (IPTV, Set-Top boxes)    
LoadTracer LoadTracer                   Yes  
Vornex TimeShiftX               Yes Yes    
Jira Xray Jira Xray (Xpand IT) Yes Yes Yes Yes Yes Yes Yes   Yes    
Zephyr Scale Zephyr Scale (SmartBear) Yes Yes Yes Yes Yes Yes Yes   Yes    
Azure DevOps Test Plans Yes Yes Yes Yes Yes Yes Yes Yes Yes    
Testmo Testmo Yes Yes Yes Yes   Yes Yes   Yes    
Qase Qase Yes Yes Yes Yes Yes Yes Yes   Yes    
Allure TestOps Allure TestOps Yes Yes Yes Yes   Yes Yes   Yes    
Katalon Katalon (Smartbear) Yes Yes Yes Yes Yes Yes Yes   Yes    
AI-Powered Test Automation
Mabl Mabl       Yes     Yes   Yes    
Testim Testim (Tricentis)       Yes     Yes   Yes    
Applitools Applitools Eyes       Yes     Yes   Yes    
Cloud Testing Infrastructure
BrowserStack BrowserStack       Yes     Yes Yes Yes    
Sauce Labs Sauce Labs       Yes     Yes   Yes Yes Yes
LambdaTest LambdaTest       Yes     Yes   Yes    




Bug-tracking Systems

Bug-Tracking Systems Comparison Matrix
Free
XQual XQual
Bugzilla Bugzilla
Mantis Mantis
Trac Trac
Redmine Redmine
JTrac JTrac
Best Practical Request Tracker
Project Dune Project Dune
GNU GNATS
GitHub Issues GitHub Issues
GitLab Issues GitLab Issues
Linear Linear
Plane Plane (Open Source)
Commercial
Atlassian Software Systems Jira
JetBrains YouTrack
IBM (Segue) Rational ClearQuest
TrackStudio TrackStudio
Seapine TestTrack Pro
Fog Greek Software FogBugz
Track+ Track+
CounterSoft Gemini
Inflectra SpiraTest
yKAP yKAP
VisionProject VisionProject
Serena Issue & Defect Management
Rally Software Rally
TechExcel DevTrack
Telerik TeamPulse
ClickUp ClickUp
Azure DevOps Boards Azure DevOps Boards (Microsoft)




Others

Other QA and Testing Utilities
CPU Limiter
OCCT OCCT
Mersenne Prime 95
Bandwidth Limiter
NetLimiter NetLimiter
Network Sniffer
Wireshark Wireshark
Telerik Fiddler
Miscellaneous
CruiseControl Cruise Control
phpUnderControl phpUnderControl
Digital.ai (VersionOne, CollabNet...) VersionOne (now Digital.ai)
Pivotal Tracker Pivotal Tracker