Monday, 02 January 2017 22:03

7 Incredible Test Automation Plans for Tableau using BI Validator

Written by Narendar Yalamanchilli

It is nice to see Tableau maintain its leadership position in Gartner’s magic quadrant for the 3rd consecutive year.

At Datagaps, this is pretty important for us as the testing automation needs for various BI platforms follow a similar trend. It is interesting that we do not see the traditional BI players in any of the quadrants but this picture is reflective of the number of BI Validator downloads we are seeing on a regular basis. Based on customer demand and experience from supporting other BI platforms, we are currently supporting the following test plans for Tableau.



Test Plan #1: Regression Testing of Workbooks / Views

 Business analysts and testing teams can baseline and compare workbook PDF snapshots to identify data and layout differences. This drastically cuts down the time it takes to test for regression in Tableau workbooks.  Similar to baseline and comparison of workbooks, comparison of PDF snapshots of views is possible as well. This will identify visual as well as data differences with ease.

Wednesday, 03 February 2016 15:53

Testing Automation of OBIEE Subject Areas

Written by

Subject Areas in Oracle OBI are great for business users. They hide the complexity involved in warehousing projects and present an easy to use mechanism to create adhoc analysis based on  the business user's need. 

 

From an IT perspective, testing subject areas is fairly complex. Every Subject Area is really a grouping of Dimension Folders (with attributes) and Measures also known as Facts. The dimension folders may have 100s of attributes and connected to fact tables via foreign keys. Typically, this is referred to as the Star Schema in the industry. Engineers, Business Analysts, Quality Assurance teams struggle to ensure that business users do not encounter unpleasant surprises in the form SQL Errors when they try to create and execute analysis from the subject areas.

 

Every few years the BI vendors have a major release that forces the companies using these products to uptake a complex BI upgrade project. For example OBIEE 11g to 12c upgrade or Business Objects 4.1 to 4.2 upgrade. Testing is an important aspect of these upgrade projects. The blog explains how customers can leverage BI Validator to test the upgrades..

 

1. Upgrade Test Plan: This can be used to compare the reports across the pre and post upgrade environments and ensure that they are as expected. If BI Validator identifies any differences in the data sets, it marks the test plans with a "Warning" status.

Note: Since the UI may look very different (OBIEE 11g & 12c), compare the data in the reports as opposed to the pdf option.

2. As part of the above test plan, BI Validator can also ensure that the reports are found in the post-upgrade environment and that there is no degradation in performance.

3. Stress Test Plan can simulate concurrent loads (e.g 10, 100,500..concurrent users) on the reports and dashboards and ensure that there is no degradation when more users access the BI system.

 

All the above can be achieved with zero programming and just a couple of clicks. Try BI Validator now in few minutes to know how it can help you during the upgrades!

 

As part of the upgrade, if you are upgrading your ETL, then you may want to look at ETL Valdiator as well.

 

Wednesday, 27 January 2016 16:03

Simulating load for BI Stress Testing

Written by

One of our customer is planning to roll out new BI functionality to 2000 additional users. They were concerned whether their current BI infrastructure can support this kind of load. So they asked us to perform stress testing using BI Validator with the following two key objectives

  1. Can their BI system reasonably support a concurrent user load of 200, 400, 600?

  2. What is the number of concurrent users where the performance of their BI System starts going downhill (breaking point)?

As most of us in the BI community are aware, In-Place upgrades are fairly common when clients want to go through minor upgrades (e.g OBIEE 11.1.1.7 to 11.1.1.9 or Business Object 4.1 SP5 to 4.1 SP 7). However, there are a number of risks which need to carefully addressed in such scenarios. Below are few examples of what can potentially go wrong and how you can leverage BI Validator to validate "In-Place" Upgrades.

Thursday, 30 January 2014 17:15

BIWA SIG 2014

Written by

We just came back last night from BIWA SIG (http://www.biwasummit.com), a BI related event that was held in Redwood City, CA. The organizers did a great job of putting together wonderful sessions spanning all areas of Analytics.

Balaji Yelamanchili shared the latest and greatest from Oracle. It was nice to know that Oracle is investing in improving the user experience of the BI Platform & Applications and enhancing support for mobile platform. I saw a demo of Endeca for the first time and I should say that it is pretty cool! Not sure about the underlying algorithms and how well does it interpret unstructured text but the UI is awesome!

On our solution portfolio, we got very positive feedback from few bloggers, potential clients and partners and that is always encouraging.

BIWA SIG is definitely part of our yearly event circuit now. We sponsored the event last year, this year and most likely will do so next year as well. The only thing that disappointed us was the attendance. Other than Oracle folks and partners, there were very few customers. Hopefully next year, we will better collaborate with the organizers and help them spread the work so that more folks can benefit from this extremely focused and well organized event!

 

Next BIWA SIG:

When: January 27th - 29th of 2015. Visit http://www.biwasummit.com for further updates.

Where: Oracle Conference Center, Redwood City, CA

Thursday, 02 May 2013 19:45

OBI Dashboard Regression Testing

Written by

Below is a simple and real example that illustrates how you can leverage BI Validator for regression testing of dashboards.

Assume that you have 250 dashboards which are widely used by your marketing, sales, finance and other divisions within your enterprise. So far, things have been running well but the current version of your ETL Tool will not be supported from the July 1st, 2013, which is 45 days away and there is no option for you but to upgrade from 8.x to 9.x in this timeframe.   Sounds familiar? :)

 

This article walks you through the consistency check warnings found in the BI Apps RPD after running the 11.1.1.7 upgrade assistant on an 10.1.3.4.1 RPD.

1.Warning [39003] – Missing functional dependency association of a column.
Any Logical Table Source that has been unused in 10g is disabled during the upgrade. Cleaning up such tables before the upgrade might help avoid this warning.

Solution: Enable all the Logical Table Sources that are disabled during the upgrade.