Test Automation Vendors: blog Posts computed from graded test automation case studies. https://testautomationvendors.com/blog/ 2026-11-12T00:00:00Z Research desk, testautomationvendors.com Playwright: what the published cases show https://testautomationvendors.com/blog/playwright-what-the-cases-show/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 48 verified cases from 14 vendors name Playwright: grades, client types, metric kinds, stacks and the fields vendors leave out. Cypress: what the published cases show https://testautomationvendors.com/blog/cypress-what-the-cases-show/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 25 verified cases from 10 vendors name Cypress: grades, client types, metric kinds, stacks and the fields vendors leave out. Selenium WebDriver: what the published cases show https://testautomationvendors.com/blog/selenium-what-the-cases-show/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 88 verified cases from 13 vendors name Selenium WebDriver: grades, client types, metric kinds, stacks and the fields vendors leave out. WebdriverIO: what the published cases show https://testautomationvendors.com/blog/webdriverio-what-the-cases-show/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 16 verified cases from 6 vendors name WebdriverIO: grades, client types, metric kinds, stacks and the fields vendors leave out. Appium: what the published cases show https://testautomationvendors.com/blog/appium-what-the-cases-show/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 47 verified cases from 10 vendors name Appium: grades, client types, metric kinds, stacks and the fields vendors leave out. REST Assured: what the published cases show https://testautomationvendors.com/blog/rest-assured-what-the-cases-show/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 12 verified cases from 7 vendors name REST Assured: grades, client types, metric kinds, stacks and the fields vendors leave out. Postman and Newman: what the published cases show https://testautomationvendors.com/blog/postman-what-the-cases-show/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 98 verified cases from 9 vendors name Postman and Newman: grades, client types, metric kinds, stacks and the fields vendors leave out. Apache JMeter: what the published cases show https://testautomationvendors.com/blog/jmeter-what-the-cases-show/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 63 verified cases from 12 vendors name Apache JMeter: grades, client types, metric kinds, stacks and the fields vendors leave out. Cucumber, SpecFlow, Behave: what the published cases show https://testautomationvendors.com/blog/cucumber-bdd-what-the-cases-show/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 53 verified cases from 9 vendors name Cucumber, SpecFlow, Behave: grades, client types, metric kinds, stacks and the fields vendors leave out. How often published automation case studies state a baseline https://testautomationvendors.com/blog/how-often-automation-case-studies-state-a-baseline/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z Of 263 verified automation cases, 75 state a before value for at least one metric. Counts by vendor and metric kind. Execution time claims across published cases: with and without baselines https://testautomationvendors.com/blog/execution-time-claims-with-and-without-baselines/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 120 execution time claims from verified automation cases, split by whether the vendor states the before value. Named versus anonymous clients in automation case studies, by vendor https://testautomationvendors.com/blog/named-versus-anonymous-clients-by-vendor/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 91 of 263 verified automation cases name the client. Counts per vendor. Team sizes vendors disclose in automation engagements https://testautomationvendors.com/blog/team-sizes-in-automation-engagements/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 149 of 263 verified automation cases state a team size. The distribution and the cases. Engagement lengths disclosed in automation cases https://testautomationvendors.com/blog/engagement-lengths-in-automation-cases/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 109 of 263 verified automation cases state the engagement length. Distribution and cases. What migrations vendors publish: from and to, counted https://testautomationvendors.com/blog/what-migrations-vendors-publish/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 11 verified automation cases describe moving a test suite between frameworks. Flows counted. Coverage claims in automation cases: how many define the denominator https://testautomationvendors.com/blog/coverage-claims-and-their-denominators/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 88 coverage claims from verified automation cases, sorted by whether the quote says what the figure is a share of. Languages paired with each web framework in published cases https://testautomationvendors.com/blog/languages-paired-with-web-frameworks/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 139 verified cases name a programming language. Pairings with each web UI framework, counted. CI tools named in automation cases https://testautomationvendors.com/blog/ci-tools-named-in-automation-cases/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 127 verified automation cases name a CI tool. Counts per tool and per vendor. Industries that appear in automation case studies https://testautomationvendors.com/blog/industries-in-automation-case-studies/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z Industries stated across 263 verified automation cases, counted. How to read a test automation case study: the fields that are usually missing https://testautomationvendors.com/blog/how-to-read-a-test-automation-case-study/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z Field by field, how often 263 verified automation cases leave out team size, duration, baseline, client name and CI. Why a percentage without a baseline is a claim, not a result https://testautomationvendors.com/blog/percentage-without-baseline-is-a-claim/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 246 percentage claims in verified automation cases, and how many state the starting value. What an automation coverage figure can mean: the denominators seen in published cases https://testautomationvendors.com/blog/what-an-automation-coverage-figure-can-mean/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 88 coverage claims sorted by what they measure: test cases, regression effort, features or code. Questions to ask a vendor about a migration case before you rely on it https://testautomationvendors.com/blog/questions-to-ask-about-a-migration-case/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z What 11 published migration cases disclose and leave out, turned into questions for the vendor. RFP questions per framework layer, derived from what cases disclose https://testautomationvendors.com/blog/rfp-questions-per-framework-layer/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z Request-for-proposal questions for web UI, mobile, API and performance automation, each tied to a disclosure gap counted in published cases. Flakiness claims: how cases describe them and what to ask for https://testautomationvendors.com/blog/flakiness-claims-in-automation-cases/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 4 metrics in verified automation cases mention flaky or unstable tests. Team size and ramp-up: what disclosed cases show https://testautomationvendors.com/blog/team-size-and-ramp-up-in-disclosed-cases/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 149 verified automation cases state a team size; what they say about ramp-up. Device and browser clouds named in cases, and what that implies for your bill https://testautomationvendors.com/blog/device-and-browser-clouds-named-in-cases/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z 79 verified automation cases name a device or browser cloud. How this ranking grades a case: A, B, C and X with real examples https://testautomationvendors.com/blog/how-this-ranking-grades-a-case/ 2026-11-12T00:00:00Z 2026-11-11T00:00:00Z Grade rules with examples from 263 verified cases: A 18, B 108, C 137; 0 removed as X. What this ranking cannot tell you, and where to get it https://testautomationvendors.com/blog/what-this-ranking-cannot-tell-you/ 2026-11-12T00:00:00Z 2026-11-11T00:00:00Z Service quality, current staff and pricing are outside the data; where to look instead. Reading a Clutch review for framework evidence https://testautomationvendors.com/blog/reading-a-clutch-review-for-framework-evidence/ 2026-11-12T00:00:00Z 2026-11-12T00:00:00Z Collectors kept only verified third-party reviews whose text names a listed framework: 17 across 6 of 17 vendors. How to request a correction and what gets logged https://testautomationvendors.com/blog/how-to-request-a-correction/ 2026-11-12T00:00:00Z 2026-11-11T00:00:00Z The correction process for vendors and readers, and what the changelog records.