Nightly Build Testing @ Digite

Nightly Build Testing is a fully automated process at Digité office. Digité Enterprise is internally used to track product development lifecycle. It tracks Requirements, Defects, Change Requests and enhancements for various major and minor releases. Test automation framework is developed using keyword driven approach and QuickTest Professional. Various assets related to automation framework, like QTP Scripts, Functions (Keywords), QTP maintenance – Change Requests, Defects, and Development Sprint plans are also tracked in Digité.

Digité Enterprise Product Source code checkins (commits) to SVN are traced to items tracked in Digité production server using the SVN integration feature. Cruise Control builds latest source code from SVN for various product branches and deploys it to test automation servers.

Test automation framework is developed using keyword driven. It is extensively used to test nightly builds across all product branches. A driver program batches QTP Scripts and runs it in parallel on the latest available application under test (AUT) and logs results in a separate database. Digité Enterprise product (AUT) uses its enhanced logging capabilities to log server side exceptions in to database used by automation framework. Both the application log and the QTP test results serves as valuable inputs to automatically generate product defects into Digité Enterprise product server. ‘PD Generator’, is a custom adapter that analyzes logs and traces it to QTP result timestamp to correlate scenarios which caused the failure on the application side. In this way product (AUT) side regression gets automatically tracked into the system leaving aside QTP code side regressions to be manually fixed.

Since the entire test results are logged in database and traced to items tracked in Digité production, various test metrics and trending information are available online for taking release decisions.