Cross-case count
CI tools named in automation cases
Research desk, testautomationvendors.com · published 2026-11-12 · data as of 2026-11-12 · 127 records
- 127
- cases name a CI tool
- 22
- distinct tools
- 65
- cases name Jenkins
127 of 263 verified cases name at least one CI tool, 22 distinct tools in all. A case naming two tools counts under both.
What stands out
- 01a1qa publishes 35 of the 127 cases naming a CI tool; the three vendors with the most publish 91, so a reader is looking at a concentrated set of sources.
- 02156 of 360 metrics in these cases state a before value; across all 639 metrics in the dataset the count is 209.
Counts come from verified records. A baseline is the before value a vendor states for a metric; quoted claims carry their grade and baseline flag.
- baseline:
- The measured value before the work started, against which a later value is compared. source
Tools
Names are kept as written in the case.
Table view
| Item | Count |
|---|---|
| Jenkins | 65 |
| GitHub Actions | 23 |
| Azure DevOps | 22 |
| CircleCI | 9 |
| Bamboo | 5 |
| GitLab | 4 |
| TeamCity | 4 |
| Azure Pipelines | 2 |
| Bitbucket Pipelines | 2 |
| Argo CD | 1 |
| AWS CodeCommit | 1 |
| AWS CodePipeline | 1 |
| Total | 139 |
CI tool by framework layer
Counts of cases naming both the CI tool and a framework from the layer.
| Layer | Jenkins | GitHub Actions | Azure DevOps | CircleCI | Bamboo | GitLab |
|---|---|---|---|---|---|---|
| web UI | 46 | 21 | 15 | 8 | 3 | 4 |
| mobile | 19 | 7 | 2 | 5 | 2 | 1 |
| API | 23 | 9 | 10 | 7 | 2 | 3 |
| performance | 16 | 5 | 5 | 3 | 2 | 0 |
| BDD | 24 | 4 | 9 | 2 | 2 | 0 |
Vendors
Vendors naming a CI tool in at least one case: a1qa, Abstracta, BugRaptors, Codoid, DeviQA, QA Madness, QAwerk, Qualitest, TestDevLab, TestFort, TestingXperts, Testrig Technologies, ThinkSys and Zuci Systems.
Questions
How many cases name a CI tool?
127 of 263.
Is a CI gate described in these cases?
Some cases say tests run on each pull request or block a release; the case files quote them where they publish a metric.
Are CI tools scored?
No.
Does a count rank the tools?
No. Counts describe what cases name.
Records used
This post reads 127 records; the newest verifiedOn date among them sets the data-as-of date.
Show record ids
a1qa-1, a1qa-2, a1qa-3, a1qa-4, a1qa-5, a1qa-8, a1qa-9, a1qa-13, a1qa-16, a1qa-17, a1qa-19, a1qa-20, a1qa-21, a1qa-23, a1qa-24, a1qa-29, a1qa-30, a1qa-31, a1qa-32, a1qa-33, a1qa-34, a1qa-38, a1qa-41, a1qa-42, a1qa-60, a1qa-62, a1qa-63, a1qa-65, a1qa-66, a1qa-67, a1qa-70, a1qa-71, a1qa-73, a1qa-75, a1qa-77, abstracta-2, abstracta-3, abstracta-5, bugraptors-4, bugraptors-6, codoid-1, codoid-5, codoid-6, codoid-8, codoid-9, codoid-10, codoid-11, codoid-12, codoid-13, codoid-15, codoid-19, codoid-20, codoid-21, codoid-23, codoid-24, codoid-25, codoid-26, codoid-27, codoid-30, codoid-31, codoid-39, deviqa-1, deviqa-2, deviqa-3, deviqa-4, deviqa-6, deviqa-7, deviqa-8, deviqa-9, deviqa-10, deviqa-11, deviqa-12, deviqa-14, deviqa-15, deviqa-16, deviqa-17, deviqa-18, deviqa-19, deviqa-20, deviqa-21, deviqa-24, deviqa-25, deviqa-27, deviqa-28, deviqa-30, deviqa-33, deviqa-34, deviqa-35, deviqa-37, deviqa-38, deviqa-41, deviqa-43, deviqa-44, deviqa-46, deviqa-47, deviqa-51, qa-madness-2, qawerk-5, qawerk-6, qawerk-8, qualitest-10, qualitest-12, testdevlab-1, testdevlab-2, testdevlab-3, testfort-1, testfort-6, testfort-8, testfort-12, testfort-16, testfort-17, testingxperts-3, testingxperts-7, testingxperts-8, testrig-1, testrig-3, testrig-6, testrig-8, testrig-10, thinksys-4, thinksys-6, zuci-systems-1, zuci-systems-2, zuci-systems-3, zuci-systems-4, zuci-systems-6, zuci-systems-8
More from the blog
Cross-case count
How often published automation case studies state a baseline
75 of 263cases state a baseline
Of 263 verified automation cases, 75 state a before value for at least one metric. Counts by vendor and metric kind.
data as of 2026-11-12 · 263 records
Cross-case count
Execution time claims across published cases: with and without baselines
120execution time claims
120 execution time claims from verified automation cases, split by whether the vendor states the before value.
data as of 2026-11-12 · 86 records
Cross-case count
Named versus anonymous clients in automation case studies, by vendor
91 of 263cases name the client
91 of 263 verified automation cases name the client. Counts per vendor.
data as of 2026-11-12 · 263 records
Related pages
Scores and grades describe published evidence as of the verifiedOn date on each item. They do not measure service quality. Verify with the vendor before contracting.