Client
Leading travel technology company
Problem Statement
Customer’s existing test automation using selenium was flaky when executed. Test creation and maintenance took team away from feature work. The customer was looking for:
- Stable and reliable test automation.
- Needed to democratize testing across non-technical team to increase test coverage and accelerate CI/CD pipeline.
- Significantly reduced test maintenance across releases and rapid UI changes.
Solution Proposed
For the customer, AdfarTech invested in analysing different automation tools. We proposed an innovative test automation solution, based on cognitive technologies. It leveraged SaaS based test automation platform, mabl. The platform had machine learning (ML) abilities with some unique features:
- Auto-healing: Tests adapt to UI changes automatically and stay up to date even after several successive UI changes. Performance regression
- testing: Machine learning models help differentiate between anomalies and significant slowdowns of test execution and page load times.
- Visual anomalies detection: Detect important visual anomalies in the application.
Solution enabled automating application features in parallel once a scheduled sprint is complete. This increased the velocity of the development team by allowing them to identify complex defects and fix them within the sprint cycle. For implementing Continuous Testing with mabl, AdfarTech implemented four-pronged approach:
- Plan: In this phase, the current regression suite is analysed for, identifying gaps, increasing coverage and creating end-to-end test scenarios. Customer had ~450 regression test cases, which were analysed, and 220 end-to-end regression test cases were finalized, for complete coverage.
- Train: The next step was to train mabl and create journeys for the 220 end-to-end scenarios.
- Test: In this phase the created journeys are executed. In addition to the, functional defects identified by journey execution, the insights provided by mabl’s machine learning model were analysed for auto-healing, performance anomalies, client-side JavaScript errors and visual defects.
- User Training: We created a training plan for the customer’s technical and non-technical staff. We also had a workshop with the customer team on mabl.