Test automation companies, ranked by their published case studies
For engineering leaders choosing an automation partner for Playwright, Cypress, Selenium, Appium, k6, JMeter and the rest of the stack.
No vendor paid to be listed, graded or ranked, and no vendor can edit its entry or its case files.
Methodology locked 2026-11-11, scores computed 2026-11-12
Ranking
| Rank | Vendor | Overall | Cases A / B / C | Frameworks with A or B cases | Not ideal for | ||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | DeviQALeader | 83.5 | A 15 / B 36 / C 1 | Postman and NewmanAppiumApache JMeterCucumber, SpecFlow, BehaveWebdriverIO+7 | Buyers who need team size and duration on every case | ||||||||||||||||||||||||||||||||
Eight dimension scores for DeviQA
| |||||||||||||||||||||||||||||||||||||
| 2 | Codoid | 65.0 | A 0 / B 10 / C 30 | Cucumber, SpecFlow, BehaveSelenium WebDriverApache JMeterAppiumCypress+3 | Framework migration projects | ||||||||||||||||||||||||||||||||
Eight dimension scores for Codoid
| |||||||||||||||||||||||||||||||||||||
| 3 | a1qa | 60.0 | A 0 / B 14 / C 47 | Postman and NewmanSelenium WebDriverCucumber, SpecFlow, BehaveApache JMeterREST Assured+3 | Buyers who need baselined, measured outcomes | ||||||||||||||||||||||||||||||||
Eight dimension scores for a1qa
| |||||||||||||||||||||||||||||||||||||
| 4 | ThinkSys | 60.0 | A 2 / B 7 / C 0 | PlaywrightCucumber, SpecFlow, BehaveApache JMeterSelenium WebDriver | Mobile automation shortlists | ||||||||||||||||||||||||||||||||
Eight dimension scores for ThinkSys
| |||||||||||||||||||||||||||||||||||||
| 5 | TestFort | 53.0 | A 0 / B 6 / C 24 | Selenium WebDriverApache JMeterGrafana k6Postman and NewmanREST Assured | Framework migration projects | ||||||||||||||||||||||||||||||||
Eight dimension scores for TestFort
| |||||||||||||||||||||||||||||||||||||
| 6 | Abstracta | 50.5 | A 0 / B 7 / C 0 | AppiumApache JMeterSelenium WebDriverGatlingPlaywright+1 | API test automation shortlists | ||||||||||||||||||||||||||||||||
Eight dimension scores for Abstracta
| |||||||||||||||||||||||||||||||||||||
| 7 | QAwerk | 50.5 | A 1 / B 7 / C 0 | PlaywrightPostman and NewmanAppiumCucumber, SpecFlow, BehaveCypress+3 | Buyers who need proof of engagements over 12 months | ||||||||||||||||||||||||||||||||
Eight dimension scores for QAwerk
| |||||||||||||||||||||||||||||||||||||
| 8 | Qualitest | 44.0 | A 0 / B 3 / C 9 | Selenium WebDriverCucumber, SpecFlow, BehaveRobot Framework | Buyers who need proof of engagements over 12 months | ||||||||||||||||||||||||||||||||
Eight dimension scores for Qualitest
| |||||||||||||||||||||||||||||||||||||
| 9 | Testrig Technologies | 42.0 | A 0 / B 1 / C 7 | Selenium WebDriver | Buyers who need a named reference client | ||||||||||||||||||||||||||||||||
Eight dimension scores for Testrig Technologies
| |||||||||||||||||||||||||||||||||||||
| 10 | Zuci Systems | 38.0 | A 0 / B 2 / C 6 | Selenium WebDriverCucumber, SpecFlow, Behave | Performance and load testing shortlists | ||||||||||||||||||||||||||||||||
Eight dimension scores for Zuci Systems
| |||||||||||||||||||||||||||||||||||||
| 11 | QA Wolf | 36.0 | A 0 / B 2 / C 0 | PlaywrightCypress | Mobile automation shortlists | ||||||||||||||||||||||||||||||||
Eight dimension scores for QA Wolf
| |||||||||||||||||||||||||||||||||||||
| 12 | TestDevLab | 35.0 | A 0 / B 4 / C 0 | Cucumber, SpecFlow, BehaveAppiumSelenium WebDriverCypressPlaywright+1 | Performance and load testing shortlists | ||||||||||||||||||||||||||||||||
Eight dimension scores for TestDevLab
| |||||||||||||||||||||||||||||||||||||
Overall score out of 100, one decimal. Ties break on outcome verifiability, then case volume. Open a row for its eight dimension scores.
Frameworks
Cases by grade
263 verified cases in total. Grade A and B cases have a case file with a claim ledger; a ledger row counts as evidence of an outcome only with a stated baseline and method.
- baseline:
- The measured value before the work started, against which a later value is compared. source
How scores work
| # | Dimension | Weight |
|---|---|---|
| 1 | Case volume and specificity | 20 |
| 2 | Framework breadth | 10 |
| 3 | Framework depth | 15 |
| 4 | Migration evidence | 10 |
| 5 | Outcome verifiability | 15 |
| 6 | Third-party review signal | 10 |
| 7 | Public engineering output | 10 |
| 8 | Transparency | 10 |
Each dimension scores 0 to 10 by fixed bands. The overall score is the weighted sum, out of 100.
Who is not here and why
5 candidates of 22 failed the scope gate. 5 vendors passed the gate but fall outside the cap of 12. Frameworks and migration flows below threshold are listed with the measured count.
From the blog
- Appium: what the published cases showframework-note data as of 2026-11-12
47 verified cases from 10 vendors name Appium: grades, client types, metric kinds, stacks and the fields vendors leave out.
- CI tools named in automation casespattern data as of 2026-11-12
127 verified automation cases name a CI tool. Counts per tool and per vendor.
- Coverage claims in automation cases: how many define the denominatorpattern data as of 2026-11-12
88 coverage claims from verified automation cases, sorted by whether the quote says what the figure is a share of.
- Cucumber, SpecFlow, Behave: what the published cases showframework-note data as of 2026-11-12
53 verified cases from 9 vendors name Cucumber, SpecFlow, Behave: grades, client types, metric kinds, stacks and the fields vendors leave out.
- Cypress: what the published cases showframework-note data as of 2026-11-12
25 verified cases from 10 vendors name Cypress: grades, client types, metric kinds, stacks and the fields vendors leave out.
- Device and browser clouds named in cases, and what that implies for your billbuyer data as of 2026-11-12
79 verified automation cases name a device or browser cloud.
Questions
How are test automation companies ranked on this site?
Each vendor gets eight dimension scores from its verified case studies, reviews and public pages. The weights are 20, 10, 15, 10, 15, 10, 10, 10 and sum to 100. The methodology was hashed on 2026-11-11 before data collection.
What do grades A, B and C mean on a case study?
A: named client and a metric with a stated baseline and method. B: named client without such a metric, or an anonymous client with a baselined metric. C: anonymous client and no baselined metric. X cases are removed.
Why is a vendor missing from the ranking?
5 candidates failed a gate condition, most often fewer than 2 verified cases naming a listed framework. 5 passed the gate but fall outside the cap of 12. Each one is listed with its reason on the not-published page.
Does a score measure service quality?
No. A score describes published evidence as of its verifiedOn date: cases, grades, reviews that name frameworks, staff posts and disclosed facts. It does not rate delivery, price or staff.
Can a vendor pay to be listed or edit its entry?
No vendor paid to be listed, graded or ranked, and no vendor can edit its entry or its case files.
Which frameworks have their own vendor pages?
9 of 18 frameworks pass the threshold of 3 ranked vendors with a grade A or B case. The framework index lists all 18 with counts.
How often is the data refreshed?
A refresh re-verifies cases older than 18 months and evidence older than 12 months, regrades and recomputes. Each change is logged in the changelog.
Related pages
Scores and grades describe published evidence as of the verifiedOn date on each item. They do not measure service quality. Verify with the vendor before contracting.