Sep 01, 2023
No image
Service categories
Service Lines
QA and Testing
Domain focus
Business Services
Challenge
Before improvement:
- Every time a developer triggered the tests, it was by hand in a terminal
- The team had a big and complicated file with the results
- Tests took more than 20 hours for completion
- The history of the test runs was unavailable
- The test suite architecture was unscalable
- UI tests were absent
- All test results were missed if some tests failed due to technical reason
Before improvement:
- Every time a developer triggered the tests, it was by hand in a terminal
- The team had a big and complicated file with the results
- Tests took more than 20 hours for completion
- The history of the test runs was unavailable
- The test suite architecture was unscalable
- UI tests were absent
- All test results were missed if some tests failed due to technical reason
Solution
After improvement:
- We reduced the build time by a factor of 10
- Configured how to run tests in simple way without the involvement of a tech person
- Created a reporting system that allowed the team to view clean reports even if the results contained 10k rows
- Configured file processing selection on the number machines (Azure Cloud, Google Cloud).
- Autotests for uploading files were running in parallel on 30 different machines, with 10 threads on each machine.
- Test cases covered 80% of the application
- We added UI tests that were triggered automatically after each deploy
- We stored the main test result file and also stored results for each machine simultaneously
After improvement:
- We reduced the build time by a factor of 10
- Configured how to run tests in simple way without the involvement of a tech person
- Created a reporting system that allowed the team to view clean reports even if the results contained 10k rows
- Configured file processing selection on the number machines (Azure Cloud, Google Cloud).
- Autotests for uploading files were running in parallel on 30 different machines, with 10 threads on each machine.
- Test cases covered 80% of the application
- We added UI tests that were triggered automatically after each deploy
- We stored the main test result file and also stored results for each machine simultaneously
Results
Test Automation, Web App Testing, Performance Testing, QA Consulting.
25,000 Auto Tests Developed
6+ Platforms Were Covered By Auto Tests
10x Faster Testing Time
10 Parallel Threads
500k+ Files Uploaded
30 Machines Used
Test Automation, Web App Testing, Performance Testing, QA Consulting.
25,000 Auto Tests Developed
6+ Platforms Were Covered By Auto Tests
10x Faster Testing Time
10 Parallel Threads
500k+ Files Uploaded
30 Machines Used