As a testing manager in Digité, I am perhaps best placed to share Digité Enterprise’s impact on my and my team’s work.
We used to earlier manager our test inventory in Excel sheets. These were in multiple sheets that were named module-wise. Test results would similarly be tracked on Excel and we would depend on a combination of filter/pivot tables in Excel to help us identify the failures, resubmit them for execution, etc.
From the time we have moved all our Manual Test Inventory from Excel to Digité Enterprise, life has become simpler.
Earlier, for any regressing test cycle, life was difficult for a team lead to consolidate the test status when our test suite was divided within a team of 20 testing members. At the end of the day, she would chase everyone to mail back their testing status, find out how many defects identified, calculate pending test cases and then redistribute the same so as to finish testing as per schedule.
With Test Inventory in Digité Enterprise, she executes a report to gather the status. This report gives her the current testing status, number of pending cases, number of failed cases, number of defects identified in the system, status of those defects and when these are expected in the next development cycle.
Further, we have tracked our automated test case inventory also in Digité Enterprise. As the automation team progress automating more test cases, these test cases get excluded from the manual testing cycle using a simple filter in the product. Earlier, this information was maintained in excel by my team leads, automation and manual testing. Having to maintain this information consistent by checking Excel files manually and then generating reports was a challenge and time consuming. Further, these would never match because they would be done at different points of time and data was dynamic. Now we have ability to get all sorts of reports - modulewise failures / prioritywise failures / testerwise defect identification.
Automation Asset management would have been very difficult without it being online on Digité Enterprise. With 3000 QTP Scripts and around 1500 business functions, we track the 7000 manual test cases (sanity, smoke and detail test case) that get automated. Traceability in Digité Enterprise has helped us build a very good information repository. Product changes and their impact to automation business functions are tracked through CRs in the automation project. We track the product branches on which this change is applicable. With our Subversion integration, every change is directly reviewed in Digité Enterprise. Same is true for defect tracking also.
We plan our Test Automation initiative in monthly sprints. For every sprint, we use package functionality. The team logs effort on tasks split across automation development phases. With activity codes correctly set and few reports, we are able to asses every sprint and put a comparison of maintenance verses new development effort of automation framework.
Automated Regression Inventory runs every night, and results are available for analysis next day. After completing root cause analysis of all failures, product defects are filed in Digité Enterprise. A report gives an assessment of how well the nightly automation ran. A number of metrics are automatically calculated to give the nightly test trends across a month, last run’s defects - product and in automation scripts), script failures (false alarms and genuine), current status of product defects and the number of script failures due to the product defects, modulewise report.
In the last 2 years that we have moved our entire Testing process to Digité Enterprise, our manual testing team has shrunk from 10 to 3, while we have kept our Test Automation team stable. Our test repository has added from 14000 to 19000. That is a huge productivity jump in the last 2 years.
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment