Framework note
Playwright: what the published cases show
Research desk, testautomationvendors.com · published 2026-11-12 · data as of 2026-11-12 · 48 records
- 48
- verified cases
- 14
- vendors
- 21 of 48
- name the client
- 55 of 145
- metrics with a baseline
48 verified cases in this dataset name Playwright, published by 14 vendors. Grades: A 6, B 22, C 20. 21 of 48 name the client, and 55 of 145 published metrics state a baseline.
What stands out
- 01a1qa publishes 9 of the 48 Playwright cases; the three vendors with the most publish 25, so a reader is looking at a concentrated set of sources.
- 0255 of 145 metrics in these cases state a before value; across all 639 metrics in the dataset the count is 209.
- 036 of 48 reach grade A, which needs a named client and one metric with both a before value and a stated method.
- 04The field left out most often is start year: 41 of 48 cases do not state it.
Counts come from verified records. A baseline is the before value a vendor states for a metric; quoted claims carry their grade and baseline flag.
- baseline:
- The measured value before the work started, against which a later value is compared. source
01Cases, vendors and grades
The count covers every verified case whose text names Playwright, including vendors outside the ranked 12.
Vendors with cases: a1qa (9), Abstracta (1), Codoid (6), DeviQA (9), QA Madness (1), QA Wolf (2), QAwerk (4), QualityLogic (1), TestDevLab (1), TestFort (1), TestingXperts (3), Testrig Technologies (2), ThinkSys (7) and Zuci Systems (1).
Table view
| Item | Count |
|---|---|
| Grade A | 6 |
| Grade B | 22 |
| Grade C | 20 |
| Total | 48 |
02Clients and industries
Named clients appear in 21 cases; 27 keep the client anonymous.
Industries stated: Cryptocurrency wallet (2), AI interpretation platform / communication software (1), AI meeting notes software (1), AI software for CAD/CAE engineering workflows (1), Architecture and construction technology (1), B2B SaaS (1), Banking (digital bank) (1) and Client onboarding and workflow management software (1).
Client types stated: enterprise (3) and startup (1).
03Metric kinds and baselines
The Playwright cases publish 145 metrics. 55 state a baseline and 17 state both a baseline and a method.
- “cut release decision time from about two working weeks to under one”before about two working weeks after under one working week a1qa a1qa-2 grade B, partial baseline yes method yes
- “65% of a critical scope automated in 10 weeks”before no automated suite after 65% of the prioritized critical scope a1qa a1qa-3 grade B, partial baseline yes method yes
- “2x release cadence increase per month after the selected scope became repeatable”before 2 releases per month after not stated a1qa a1qa-3 grade B, partial baseline yes method yes
- “Cut combined mobile + web regression execution to ~35 minutes (from multi-day cycles)”before multi-day cycles after ~35 minutes Abstracta abstracta-2 grade B, partial baseline yes method no
- “Regression window cut from 5 days → 4 hours”before 5 days after 4 hours Codoid codoid-19 grade B, partial baseline yes method no
- “CI/CD in Azure DevOps cut execution time from 9 hours to 40 minutes.”before 9 hours after 40 minutes Codoid codoid-19 grade B, partial baseline yes method no
| Metric kind | Metrics | With baseline |
|---|---|---|
| other | 38 | 12 |
| suite-size | 31 | 14 |
| coverage | 27 | 13 |
| execution-time | 27 | 13 |
| defects | 14 | 1 |
| release-frequency | 5 | 2 |
| cost | 3 | 0 |
04Languages, CI tools and clouds named alongside
Languages: TypeScript (21), Python (7), C# (4), Java (4), JavaScript (4), Golang (1) and Kotlin (1).
CI tools: GitHub Actions (12), Azure DevOps (6), Jenkins (6), Azure Pipelines (2), CircleCI (2), Argo CD (1) and Azure DevOps Pipelines (1).
Device or browser clouds: BrowserStack (7), AWS (3), LambdaTest (2), AWS Device Farm (1) and Azure (1).
05Migration flows
8 cases move a suite to Playwright and 0 cases move a suite away from it.
Flows: Cypress to Playwright (3), Selenium WebDriver to Playwright (2), Protractor to Playwright (1), Spectron to Playwright (1) and WebdriverIO to Playwright (1).
06The evidence ladder
Each row counts the Playwright cases that make that disclosure; the rows are separate counts, ordered from the most basic disclosure to grade A. Of 48 Playwright cases, 6 reach grade A, and the rarest disclosure below it is "reach grade a" (6 cases).
The right-hand column gives the same steps for all 263 verified cases, so a reader can set this subset against the whole dataset.
Table view
| Item | Count |
|---|---|
| Name a listed framework | 48 |
| Name the client | 21 |
| Publish at least one metric | 40 |
| State a baseline for a metric | 18 |
| State baseline and method for one metric | 9 |
| Reach grade A | 6 |
| Total | 142 |
| Step | Playwright cases | All verified cases |
|---|---|---|
| Name a listed framework | 48 of 48 | 263 of 263 |
| Name the client | 21 of 48 | 91 of 263 |
| Publish at least one metric | 40 of 48 | 210 of 263 |
| State a baseline for a metric | 18 of 48 | 75 of 263 |
| State baseline and method for one metric | 9 of 48 | 35 of 263 |
| Reach grade A | 6 of 48 | 18 of 263 |
07Frameworks named alongside Playwright
22 of 48 cases name at least one other listed framework. The pairing shows which stacks vendors describe together, not which combination works.
Table view
| Item | Count |
|---|---|
| Postman and Newman | 10 |
| Appium | 7 |
| Apache JMeter | 5 |
| Cucumber, SpecFlow, Behave | 3 |
| Cypress | 2 |
| Selenium WebDriver | 2 |
| WebdriverIO | 2 |
| Grafana k6 | 1 |
| Total | 32 |
08Where the cases come from
a1qa (9), DeviQA (9) and ThinkSys (7) publish the most Playwright cases. A vendor with many cases here shows breadth of published work; the grade columns show how much of it can be checked.
| Vendor | Cases | Grade A or B | With a baselined metric |
|---|---|---|---|
| a1qa | 9 | 2 | 2 |
| DeviQA | 9 | 9 | 9 |
| ThinkSys | 7 | 7 | 4 |
| Codoid | 6 | 1 | 1 |
| QAwerk | 4 | 4 | 0 |
| TestingXperts | 3 | 1 | 1 |
| QA Wolf | 2 | 2 | 0 |
| Testrig Technologies | 2 | 0 | 0 |
| Abstracta | 1 | 1 | 1 |
| QA Madness | 1 | 0 | 0 |
| QualityLogic | 1 | 0 | 0 |
| TestDevLab | 1 | 1 | 0 |
| TestFort | 1 | 0 | 0 |
| Zuci Systems | 1 | 0 | 0 |
09What vendors leave out
27 of 48 cases do not state a team size and 36 do not state a duration.
3 of 145 metrics are cost figures and 3 mention flakiness, so maintenance cost and flaky test rates are rarely published.
10Questions for a Playwright proposal
Ask for suite size and run time before and after the work: 34 of 48 cases give no before value for either.
Ask for the flaky test rate over a stated number of runs: 3 of 145 metrics mention flakiness at all.
Ask who owns maintenance after hand-over and what it costs per month: 3 of 145 metrics are cost figures.
Ask for a reference client you can call: 27 of 48 cases keep the client anonymous.
Questions
How many vendors have published Playwright cases?
14 vendors in this dataset, with 48 verified cases between them, as of the dataAsOf date on this page.
How many Playwright cases name the client?
21 of 48. A named client is required for grade A.
Do Playwright case studies publish baselines?
55 of 145 metrics state a before value.
Does this page rank Playwright against other frameworks?
No. The site counts which vendors have evidence on a framework and never compares frameworks.
Records used
This post reads 48 records; the newest verifiedOn date among them sets the data-as-of date.
Show record ids
a1qa-2, a1qa-3, a1qa-10, a1qa-19, a1qa-40, a1qa-62, a1qa-71, a1qa-75, a1qa-76, abstracta-2, codoid-7, codoid-12, codoid-16, codoid-17, codoid-18, codoid-19, deviqa-1, deviqa-2, deviqa-3, deviqa-7, deviqa-8, deviqa-21, deviqa-33, deviqa-46, deviqa-52, qa-madness-2, qa-wolf-1, qa-wolf-2, qawerk-1, qawerk-4, qawerk-6, qawerk-7, qualitylogic-1, testdevlab-2, testfort-7, testingxperts-3, testingxperts-9, testingxperts-10, testrig-1, testrig-3, thinksys-1, thinksys-2, thinksys-3, thinksys-4, thinksys-5, thinksys-6, thinksys-7, zuci-systems-3
More from the blog
Framework note
Cypress: what the published cases show
25verified cases
25 verified cases from 10 vendors name Cypress: grades, client types, metric kinds, stacks and the fields vendors leave out.
data as of 2026-11-12 · 25 records
Framework note
Selenium WebDriver: what the published cases show
88verified cases
88 verified cases from 13 vendors name Selenium WebDriver: grades, client types, metric kinds, stacks and the fields vendors leave out.
data as of 2026-11-12 · 88 records
Framework note
WebdriverIO: what the published cases show
16verified cases
16 verified cases from 6 vendors name WebdriverIO: grades, client types, metric kinds, stacks and the fields vendors leave out.
data as of 2026-11-12 · 16 records
Related pages
Scores and grades describe published evidence as of the verifiedOn date on each item. They do not measure service quality. Verify with the vendor before contracting.