How Matchbook moved all of its QA onto Qodex and cut the QA team by 80%
- 80% smallerThe QA team, six months in
- 5 days → half a dayThe pre-release QA, 12 people to 2
- TeamQA and engineering
- StackAPIs, web UI
- What runsAPI testing, UI testing, security scans, PR review
- RegionIndia
Given the critical nature of our enterprise stack, QA is an essential part of our delivery cycle. We have invested considerable money in QA and also worked with and tested multiple QA automation tools and vendors. None quite filled the gap as elegantly as Qodex for API testing. Recently, with the newer UI testing, security scans and PR review added to the platform, we are moving all of our QA over to Qodex across all our products. My CTO told me that our pace of delivery would have been less than half without Qodex.
Background
An enterprise data platform with QA and engineering in India.
Matchbook AI masters, matches and cleans enterprise data for large companies. Google unified 120 million customer records on it at over 90% match precision in eight weeks, and Johnson & Johnson runs its enterprise vendor master on it. The products run on a set of APIs, and every release used to go through a manual QA cycle before it shipped.
The problem
Twelve people, five days, before every release.
A twelve-person QA team ran a five-day QA sprint before each release. Matchbook had spent real money on QA and tried several automation tools and vendors. None covered API testing well enough to replace the sprint.
The switch
All of QA onto Qodex in six months.
API testing came first: about 200 test scenarios were running within 48 hours of the first import, and Qodex took over the complex API and API security scenarios that filled the sprint. In the last six months, as UI testing, security scans and PR review came to the platform, Matchbook moved all of its QA across all of its products onto Qodex.
Results
An 80% smaller QA team, and a faster release.
The QA team is 80% smaller. Two people finish the pre-release check in half a day. Matchbook's CTO puts the pace of delivery at more than double what it would have been without Qodex.
| What | Before | After |
|---|---|---|
| QA team | 12 people | 80% smaller |
| Pre-release QA | 5 days | Half a day |
| People on the pre-release check | 12 | 2 |
| First 200 API test scenarios | Not tracked | 48 hours |
What runs today
API testing, UI testing, security scans and PR review, on every product.
Qodex runs Matchbook's full QA: the API suite, UI tests, security scans on every change and review on every pull request.
- Nothing to install in your app.
- No agent in your CI.
- No test rewrite.
Stop merging on faith.
Install the GitHub app, point Qodex at your staging URL, and the next pull request gets tested before it merges.