Test Plan #2: Upgrade Testing
This test plan in BI Validator empowers testing teams to compare pre and post upgrade workbooks/views or across environments with ease. This is helpful for out of place upgrades or when folks want to compare QA environments to Product environments or similar use cases.
Test Plan #3: Migration Testing
The magic quadrant has been truly magical over the last few years. Customer preferences have been changing at a rapid pace and so is the landscape. When I saw the above image few weeks back, I was surprised to see that the traditional BI players do not even show up in the map. Many customers have already deployed Tableau at an enterprise scale or atleast in the process of choosing BI platforms such as Tableau/Qlik for the ease of rollouts and other factors.
To aid this migration, BI Validator can come in extremely handy because you can easily compare data of reports generated by OBIEE, Business Objects, Cognos to Tableau. This minimizes the risks associated with large scale migration projects.
Test Plan #4: Performance Testing
Often, it is important to understand how a specific report performs over time. A performance test plan can be defined that will ensure that the report will respond within an acceptable time every time end users try to garner insights from the reports in a production environment.
Test Plan #5: Security Testing
During internal rollouts or upgrades, it is possible that the access levels of Projects, Workbooks & Views may unexpectedly vary and it is important to understand these early in the development life cycle to prevent compliance issues or other operational oversights. This test plan can baseline and compare the access levels of Tableau Users/Groups.
Test Plan #6: Stress Testing
This is an amazing test plan that completely eliminates the need for tools such as JMeter and LoadRunner. No more scripting. You can easily simulate concurrent user load and gather view performance statistics with varying user load; did I say using a simple user interface?
Test Plan #7: End to End Testing
We advice our customers to do end-to-end testing where applicable. Using the Data Compare test plan, you can connect to your database, write a query and then compare the data set to the data in a Tableau View in a matter of minutes. This is truly remarkable.