Is Microsoft winning the BI race?

I just finished reading an interesting article written by Oudi Antebi of Panorama Software.

In it he states that the Microsoft BI path has been somewhat confusing over the past few years – what with their purchase of Proclarity, and it’s subsequent withdrawal (please bring it back!), it’s development of Performance Point Server, and it’s subsequent integration into Sharepoint. (And possibly PPS revival). This has left consumers and consultancies wondering whether to invest in the Microsoft BI stack at all.

However, Oudi points out that Microsoft may be following the pareto rule of 80/20 and trying to win the hearts of 80% of the BI population by integrating basic BI features into its Office and MOSS products. It is then happy to leave the remaining 20%, otherwise known as the power users, to use software from the likes of Panorama (shameful plug Oudi), Oracle and SAP Business Objects.

Oudi’s article is interesting on several levels.

Many of you will know that I am a fan of several BI applications – Panorama, Tableau and Qlikview. These powerful applications provide the end user with a simple GUI interface and allow you to really dig down into your data and present it in a wide variety of ways. The resulting output, I feel, is at the cutting edge of BI reporting.

Several vendors are looking at offering their wares over data you may (one day?) hold in the ‘cloud’. No doubt the cloud will grow in popularity over time and it removes the cost of purchasing and maintaining hardware on site. Google is not far behind either. It has been working on several initiatives including Google Wave and Google Squared. Google has in fact worked closely with Panorama on several projects involving its Google spreadsheet application. Google also bought the rights to the Gapminder graphical application which allows you to view you data over several dimensions over a moving time period. Fantastic product and demonstrated like no other by Ola Rosling in several conferences. I wrote about a presentation he done at TED which was unbelievable. But I digress.

The fact is that Oubi thinks that this is a race with one winner.

I disagree.

Microsoft, with its current BI stack, will not win the BI race. In fact, I don’t think there will be or can be a winner. BI means different things to different people. BI is vital to all organisations, and will one day be used by every employee at every level. From basic tabular reports, to graphs to dashboards. We are all living in an age where we are confronted by mountains of data. Data storage is growing exponentially. Simply look at the size of your home storage, and the volume of music or photos or files that you may store. How does that compare to your system of 5 years ago? And imagine the data being collected by telecoms companies, retail companies, reward schemes, etc. So any system which can aggregate that data, cleanse it and present it in a form which is accurate, timely and relevant will be of enormous value to an organisation.

There are people who prefer to see tables of data for which Excel is an excellent option. There are others who want to track metrics and KPI’s, and several applications, including Xcelsius allow you to do just that. Other people or power users may want to drill down into the underlying data, to really determine the causes of a strange number – an outlier. Several companies are offering applications on mobile devices such as the iPhone, as discussed here by Timo Elliot. Again, this advance will satisfy a small subset of the BI community.

Price also plays an important part, and this is where Microsoft will win many hearts and minds, and perhaps more importantly, the signature on the purchase order. A number of BI vendor solutions are very expensive indeed. Others are more realistically priced, and several Microsoft solutions may be used at no additional cost depending on the type of licence you hold. With Office being the predominant application on users desktops, embedding simple BI functionality into Excel is a no brainer. Perhaps an organisation is using Sharepoint as an internal document portal. Well, now you can put up some dashboards using PPS functionality.

While I think there is a big place for Microsoft in the BI world, I certainly don’t think it is going to be the ‘winner’. Smaller, more nimble BI software companies, are pushing the boundaries of what can be achieved with BI, offering us with ever more imaginative ways of viewing our data and extracting the key information we need to know. Several of the larger vendors offer organisations a strong case to use use their complete stack, from database, to ETL and data cleansing, to creating cubes/universes, reports and right through to dashboards and KPI’s. A one stop solution from one of the largest BI vendors.

These vendors are focused 100% on BI.

Not Office.

Not Windows.

Not XBox.

Just BI.

And having a laser like focus on BI will give these organisations the edge to develop the very best products on the market.

BusinessObjects v Other BI Tools

So what is the best BI Reporting Tool on the market today?

This is a difficult decision and one which is subject to personal preferences. I’ve worked with a number of BI tools over the years using products such as:

  • Business Objects
  • Cognos
  • ProClarity (now Performance Point Server)
  • Panorama
  • SSRS (SQL Server Reporting Services)
  • Oracle Forms & Reports
  • …a bit of Crystal

So which of these is the best BI reporting tool?

Panorama and ProClarity provide a ‘freshness’ to reporting. Users find their tools easy to use and the type of output these products generate should really make the larger BI vendors sit up and take notice. ProClarity introduced a number of new graphical representations of data which I haven’t seen in other products. I’m not sure why, but once you play around with these charts, you can’t help but be impressed. One of my favorites graphical displays is the heat map. An example of a heat map in action can be found here. This example shows the the NASDAQ-100 in one dimension. ProClarity allows you to add another dimension which will determine the size of boxes depending on a second variable. Nice.

I haven’t used Cognos products for a while, so my opinion may be outdated. However, I didn’t find it’s product suite as integrated as that of BusinessObjects. It does have it’s fan base however, and it’s customer base suggests it is no small player. Recently bought out by IBM, it is going to give BusinessObjects a real fight. I welcome this. You need companies to be competing with each other to push forward innovation.

I found that Oracle Forms/Reports and Crystal Reports good for static reporting – the kind of reports that are not likely to change any time soon. Crystal is an excellent product, especially if you want to embed reports into existing code or applications. It is fairly simple to pick up and I find it quite powerful. One of BusinessObjects’ better purchases I think. To be fair to Oracle, I haven’t used it’s BI product suite. Hyperion, which was bought by Oracle, was a highly regarded BI vendor, so I am sure Oracles BI suite is impressive. Note to self: I should really become familiar with Oracle BI.

And finally, SSRS. To be honest I’m not a massive fan of SSRS. It not really and end user type of product.  However, its low entry price (and often no additional cost as most sites will be using SQL Server) make this a popular choice. However, I don’t think it offers the features of some other products in my list. Things are changing in the Microsoft camp however. Following it’s purchase of ProClarity, it has integrated it’s BI toolset into Performance Point Server. Microsoft has quite a strong BI case now. For sites using SQL Server as it’s database, it now has an attractive stack whereby for a low cost, users can product OLAP cubes, develop powerful reports, and integrate all of this into the well established Office suite of products. At the end of the day, many sites have been using Excel as their ‘reporting tool’. It is going to be difficult to wrestle users away from Excel, and with Microsoft building on that platform, it is making life difficult for the bigger BI players.

So what about BusinessObjects? It is now quite a mature product, and immensely powerful. I dare say that most users merely scratch the surface of what BusinessObjects is capable of. Its products are very well integrated, and it offers a full product stack from the warehouse ETL to dashboards. But that is exactly the point. I find BusinessObjects strong in Query and Analysis and ETL, but weak in Analytics and Dashboards. Yes, BusinessObjects has Xcelcius and Performance Manager, but I do believe that Panorama and Performance Point Server/ProClarity offer a better Analytic/Dashboard tool.

So what do  prefer? Difficult to nail it down, but if I were setting up from scratch:

  1. BusinessObjects Data Integrator for ETL. (I know Informatica is the market leader, but Data Integrator really is a fantastic product and integrates well with the rest of the BusinessObjects stack).
  2. BusinessObjects XIR2 for Query and Analysis (XI 3.0 is not yet established enough)
  3. Panorama or Performance Point Server for Analytics and Dashboards.

It should be interesting over the next few months. XI 3.0 will become more established, PPS should begin to mature and integrate more functionality from it’s ProClarity purchase, and it will be interesting to see how much influence SAP and IBM have on their recent purchases.

I’m keen to hear your views. Feel free to share your views and comments – I’ll add them to the post. It is quite lonely in the blogosphere…

Addendum: SAS are also a strong player in this market space. However, it appears to be somewhat of a closed shop. I have no experience of SAS. Anyone care to add a comment comparing SAS to the other tools I have discussed?

Project Real

It can be quite difficult to get your head around a data warehouse/reporting solution.

But fear not. Microsoft, together with a number of it’s technology partners, has put together a project called Project Real. This consists of a sample implementation based on SQL Server technology and a set of sample data.  This kit consists of the following:

  • A set of instructions for setting up the environment
  • Guidance on how to explore the implementation
  • A sample relational data warehouse database (a subset of the Project REAL data warehouse)
  • A sample source database (from which we pull incremental updates)
  • SSIS packages that implement the ETL operations
  • An SSAS cube definition and scripts for processing the cube from the sample warehouse
  • Sample SSRS reports
  • Sample data mining models for predicting out-of-stock conditions in stores
  • Sample client views in briefing books for the ProClarity and Panorama BI front-end tools

Project Real has been around for quite a while, and I’ve played around with it a few times. For some reason it never occurred to me to blog about it. It is well worth the effort working through this Microsoft kit as it is not often you are given the opportunity to work through a DW/BI implementation from start to finish.

Performance Point Server

I haven’t been posting as much recently as I have been focusing on getting the Microsoft Performance Point Server certification. This is gained by passing exam 70-556, and on passing, awards you with the Microsoft Certified Technology Specialist: Performance Point Server certification.

Performance Point Server is a product based on the Proclarity platform of Business Intelligence products. Proclarity has been developing Business Intelligence products over the Microsoft stack since 1995, and in April 2006, was bought out by Microsoft.

Microsoft has now integrated these applications more closely with its own Business Intelligence tools and has released them under a new application suite called Performance Point Server.

The exam covers a wide range of topics relating to PPS – installation, configuration, configuring dimensions, models, rules and dashboards.

Google working with Panorama?

I stumbled across this article recently which talked of Google partnering with Panorama.

For those that don’t know, Panorama Software produces some great visual software in the area of Online Analytical Processing (OLAP) and Multidimensional Expressions (MDX). In the mid 90’s Microsoft bought Panorama Software’s OLAP server technology, which was subsequently implemented in Microsoft’s SQL Server Analysis/Reporting Services technology.

This is an interesting move. Having sold one of it’s key technologies to Microsoft, and with ProClarity being bought by Microsoft, I was wondering where this left Panorama. It really does produce some great products so it is good to see it is still alive and kicking.

You can actually use this technology now on Google spreadsheets. Here is the link. It’s still early days, but if more of the Panorama technology is implemented, Google spreadsheets could become a big player in the BI market.