Wednesday 13 March 2013

Test Data Life Cycle

In the previous posts, I explained about the various concepts surrounding Test data creation and maintenance, namely Data Subset, Data Masking, Test Data Ageing, Test Data Refresh, Data Archive and Gold Copy.  In this post, I will focus on the life cycle of Test Data.

So what is meant by a life cycle.  Life Cycle is the various stages that a product/service/artifact goes through before attaining its end of life.  So a Test Data Cycle explains the various stages through which the test data goes through in order to reach its end of life or alternatively start a recurring life cycle.

So similar to a test life cycle or a software development life cycle, Test Data goes through the following phases.  They are

Requirement Gathering & Analysis

This is pretty straightforward.  In this phase, the test data requirements pertaining to the test requirements are gathered.  They are categorized into various heads

  • Pain Areas
  • Data Sources
  • Data Security/Masking
  • Data Volume requirements
  • Data Archival requirements
  • Test Data Refresh considerations
  • Gold Copy considerations

This phase is typically carried out in the form of a TDM assessment or Test Data Assessment.  Since that topic requires separate attention, I will dedicate a blog post to it.


Planning & Design

As the name indicates, based on the requirement analysis an appropriate solution is designed to solve the various pain areas in the Test Data.  After looking at the problem scale and the feasible solution, a suitable test data process is suggested and we would need to choose between an In-House solution or a Commercial Product or a combination of both.  Also in this phase, an effort estimate is done for the entire project.  And a test data plan/strategy is also developed that will propose a direction that the project will take and what approaches will be followed to solve the test data problems.  That could be either in the form of process improvements or in the form of an automated solution.

Test Data Creation

In this phase, based on the Test Data Strategy, the solution is developed and test data is created through various techniques depending on the project test data requirements.  It can be a combination of manual and automated techniques.  Automation techniques might include In-house tools or commercial products.  It can be either a refresh from production or generation from scratch or a hybrid approach.  The output at the end of this phase will be the actual test data required for the project.

Test Data Validation

In this phase, the created test data is validated against the business requirements.  This can be done by Business Analysts or using automated tools if the volumes are very high.


Test data maintenance

This is similar to a test maintenance phase, where there might be requests for changes in the test data according to the changes in the tests.  Hence again the entire life cycle is followed for maintenance of the test data.  This might include creation of Gold Copy for future use, Archives for size management, updating of Gold Copy, Restoration of older data for testing, etc.

The following figure depicts the Test Data Life Cycle























Hope you got an idea of how the test data flows through a life cycle.  Hope you found this informative.  Thanks for reading.  Comments are welcome!


About the Author

Rajaraman Raghuraman has nearly 8 years of experience in the Information Technology industry focusing on Product Development, R&D, Test Data Management and Automation Testing.  He has architected a TDM product from scratch and currently leads the TDM Product Development team in Cognizant.  He is passionate about Agile Methodologies and is a huge fan of Agile Development and Agile Testing.  He blogs at Test Data Management Blog & Agile Blog.  Connect with him on Google+





29 comments:

  1. Like your article. I also came across the following that I thought was complimentary.
    http://enov8.com/docs/Holistic-TDM.pdf
    Its based on the philosophy of going beyond data provisioning and extending into broader ares like accessibility.

    ReplyDelete
    Replies
    1. This comment looks like straight spam from the cheap looking company

      Delete
  2. It is really interesting post. I never read such kind of post. It impressed me. Thanks for sharing…

    ReplyDelete
  3. Interesting and helpful post

    ReplyDelete
  4. Thanks to share this awesome blog regarding Data Abstraction Service keep share more an more blog

    ReplyDelete
  5. The blog which you are shared is helpful for us to know about the software testing and its uses......

    selenium training in navalur

    java training in navalur

    ReplyDelete
  6. Thank you so much for this nice information. Hope so many people will get aware of this and useful as well. And please keep update like this.

    Big Data Services

    Data Lake Services

    Full Stack Development Services

    ReplyDelete
  7. I have been through a blog, it was so distinct & I had a chance to collect the information that helps me a lot to improvise myself. I hope this will help many readers who are in need of this vital piece of information. Thanks for sharing & keep your blog updated.Visit my blog
    Data Management Services

    ReplyDelete
  8. I am stunned by the information that you have on this blog. It shows how well you fathom this subject.
    data science course

    ReplyDelete
  9. Are you looking for Synthetic Test Data services in Ojai, CA? so call GenRocket on (805) 836-2879

    ReplyDelete
  10. Thanks for the intersting information about Software Testing Services. I can not wait to read far more from you. This is actually a tremendous site..

    Software Testing Services USA

    ReplyDelete
  11. Four Things to Consider When it Comes to Test
    Data Management

    ReplyDelete
  12. Thank You for this wonderful and much required information Best Custom Application Development in USA

    ReplyDelete
  13. Nice post. I learn some thing tougher on distinct blogs everyday. Most commonly it is stimulating to learn to read content from other writers and exercise a specific thing there. I’d would rather use some together with the content in my weblog no matter whether you don’t mind. Natually I’ll provide you with a link in your web weblog. Many thanks for sharing. programming socks

    ReplyDelete
  14. I have been searching to find a comfort or effective procedure to complete this process and I think this is the most suitable way to do it effectively.
    cyber security course in malaysia

    ReplyDelete
  15. Great Information thank you for sharing this article.
    Best Data Management Company/a>

    ReplyDelete
  16. Great article, thank you for sharing such a valuable information.
    Best Application Development Company/a>

    ReplyDelete
  17. "The test data lifecycle plays a pivotal role in software quality assurance. How Extend Security It encompasses data creation, management, and retirement stages, ensuring that reliable and diverse datasets.

    ReplyDelete