Is Microsoft winning the BI race?

I just finished reading an interesting article written by Oudi Antebi of Panorama Software.

In it he states that the Microsoft BI path has been somewhat confusing over the past few years – what with their purchase of Proclarity, and it’s subsequent withdrawal (please bring it back!), it’s development of Performance Point Server, and it’s subsequent integration into Sharepoint. (And possibly PPS revival). This has left consumers and consultancies wondering whether to invest in the Microsoft BI stack at all.

However, Oudi points out that Microsoft may be following the pareto rule of 80/20 and trying to win the hearts of 80% of the BI population by integrating basic BI features into its Office and MOSS products. It is then happy to leave the remaining 20%, otherwise known as the power users, to use software from the likes of Panorama (shameful plug Oudi), Oracle and SAP Business Objects.

Oudi’s article is interesting on several levels.

Many of you will know that I am a fan of several BI applications – Panorama, Tableau and Qlikview. These powerful applications provide the end user with a simple GUI interface and allow you to really dig down into your data and present it in a wide variety of ways. The resulting output, I feel, is at the cutting edge of BI reporting.

Several vendors are looking at offering their wares over data you may (one day?) hold in the ‘cloud’. No doubt the cloud will grow in popularity over time and it removes the cost of purchasing and maintaining hardware on site. Google is not far behind either. It has been working on several initiatives including Google Wave and Google Squared. Google has in fact worked closely with Panorama on several projects involving its Google spreadsheet application. Google also bought the rights to the Gapminder graphical application which allows you to view you data over several dimensions over a moving time period. Fantastic product and demonstrated like no other by Ola Rosling in several conferences. I wrote about a presentation he done at TED which was unbelievable. But I digress.

The fact is that Oubi thinks that this is a race with one winner.

I disagree.

Microsoft, with its current BI stack, will not win the BI race. In fact, I don’t think there will be or can be a winner. BI means different things to different people. BI is vital to all organisations, and will one day be used by every employee at every level. From basic tabular reports, to graphs to dashboards. We are all living in an age where we are confronted by mountains of data. Data storage is growing exponentially. Simply look at the size of your home storage, and the volume of music or photos or files that you may store. How does that compare to your system of 5 years ago? And imagine the data being collected by telecoms companies, retail companies, reward schemes, etc. So any system which can aggregate that data, cleanse it and present it in a form which is accurate, timely and relevant will be of enormous value to an organisation.

There are people who prefer to see tables of data for which Excel is an excellent option. There are others who want to track metrics and KPI’s, and several applications, including Xcelsius allow you to do just that. Other people or power users may want to drill down into the underlying data, to really determine the causes of a strange number – an outlier. Several companies are offering applications on mobile devices such as the iPhone, as discussed here by Timo Elliot. Again, this advance will satisfy a small subset of the BI community.

Price also plays an important part, and this is where Microsoft will win many hearts and minds, and perhaps more importantly, the signature on the purchase order. A number of BI vendor solutions are very expensive indeed. Others are more realistically priced, and several Microsoft solutions may be used at no additional cost depending on the type of licence you hold. With Office being the predominant application on users desktops, embedding simple BI functionality into Excel is a no brainer. Perhaps an organisation is using Sharepoint as an internal document portal. Well, now you can put up some dashboards using PPS functionality.

While I think there is a big place for Microsoft in the BI world, I certainly don’t think it is going to be the ‘winner’. Smaller, more nimble BI software companies, are pushing the boundaries of what can be achieved with BI, offering us with ever more imaginative ways of viewing our data and extracting the key information we need to know. Several of the larger vendors offer organisations a strong case to use use their complete stack, from database, to ETL and data cleansing, to creating cubes/universes, reports and right through to dashboards and KPI’s. A one stop solution from one of the largest BI vendors.

These vendors are focused 100% on BI.

Not Office.

Not Windows.

Not XBox.

Just BI.

And having a laser like focus on BI will give these organisations the edge to develop the very best products on the market.

SAP TechEd 2009

My previous post brought your attention to the SAP World Tour 2009, an event focused on IT directors, managers and executives.

If you are a developer, and feel a bit left out, fear not!

SAP TechEd2009 is being hosted in the following locations:

  • Phoenix October 13-16
  • Vienna October 27-29
  • Shanghai November 11-12
  • Bangalore November 18-20

These events are normally packed with ideas, hints and tips that you can take back with you and implement.

Jon Reed from jonerp.com has written a number of interesting posts about previous TechEd events that are well worth reading.

Registration is still open, and if you apply early enough, there are some early bird conference fee reductions you can benefit from.

SAP World Tour 2009

SAP Business Objects are hosting their World Tour at locations throughout the world over the coming months. Under the banner of the SAP World Tour 2009, the UK presentation will be held at the NEC Centre in Birmingham UK on July 15th.

There are the usual keynote presentations as well as several breakout sessions – one stream focusing solely on Business Intelligence (listed below):

11.30 – 12.15
SAP BusinessObjects: Optimizing Business Performance
Mike Morini, SAP

12.15 – 13.00
A – Z of Business Intelligence
Phil Wood, SAP BusinessObjects

14.00 – 14.45
The Importance of Business Intelligence – During Market Growth & Recession
Richard Neale, SAP BusinessObjects

14.45 – 15.30
Revolutionizing your Business Intelligence (with SAP BusinessObjects Explorer)
Chris Darvill SAP BusinessObjects and Stewart Faith, BI Specialist

16.00 – 16.45
A New Era in Information Management
Richard Neale and Barry Dodds SAP BusinessObjects

16.45 – 17.30
BI for SAP Customers (Designing a BI strategy for your SAP Landscape)
Chris Darvill, SAP BusinessObjects

The tour is mainly focused on executives, IT decision makers and business managers. Registration for the event is free, and registration is still open, so if you are available and want to learn more about SAP and it’s future vision, it is an event well worth attending.

SAP User ID required for exams

I recently booked a Business Objects Data Integrator exam (DMDI201) at the Pearson Vue website.

On this occasion I noticed that the Pearson Vue website now requests that you enter your SAP User ID:

Pearson Vue Screen

Pearson Vue SAP User ID Screen

Submitting my SAP User ID allowed me to continue with booking my exam.

If you don’t have a SAP User ID, how can you book an exam? In the first instance, I suggest you contact your regional SAP Support office. They should be able to set up a SAP User ID for you.

This post on the Business Objects forum suggests that people are able to get their SAP User ID’s by contacting support.

Give them a try.

How to handle object conflicts with the XI 3.0 Import Wizard

The Import Wizard is a useful tool to migrate objects from a Business Objects source system to a new destination system. However, importing objects can potentially present the user with conflicts with existing object names or CUIDs.

To overcome this, the user can instruct the Import Wizard to import based on CUID or by object name. When checking by CUID, the Import Wizard will check the CUID of the source object and see if it exists in the destination system. Alternatively, it can check to see if the source object name and path exists in the destination system.

We are going to use the following scenario to demonstrate both import examples:

Source system

Monthly Store Sales.rep (CUID ID = 123)

Store Managers Report.rep (CUID ID = 456)

Destination system

Monthly Store Sales.rep (CUID ID = 123)

Store Managers Report.rep (CUID = 789)

Importing based on object CUID

If you are importing objects based on the object CUID, you need to let the Import Wizard know what to do if the CUID exists in the destination system already.

Three options are available to you:

  • Update the destination object. If the names differ you rename the object

In this scenario, Monthly Store Sales will copy across with no problem as they share CUID and name. The Store Managers Report shares the same name but different CUID. As the CUID differs, we are going to import the object, keep the CUID but give it a new name – Store Managers Report (2).rep

  • Update the destination object. If the names differ you do not import the object

In this scenario, the Monthly Store Sales will copy across. However, the Store Managers Report has a different CUID, so this will not be imported.

  • Do not import import the object

In this scenario, the CUID for the Monthly Store Sales already exists. The report will not be imported. There is also a CUID conflict with the Store Managers Report, so this also will not be imported.

The three CUID scenarios can be placed into a matrix:

import-wizard-scenarios-xi3-update-by-cuid

import-wizard-scenarios-xi3-update-by-cuid

Importing based on OBJECT NAME

Importing based on object name examines both the source object path and name. Three options are available to you:

  • Keep the destination object and import a renamed copy of the object

In this scenario, Monthly Store Sales will copy across with no problem as they share CUID and name. The Store Managers Report shares the same name but different CUID. Selecting this option creates a new object called Store Managers Report (2).rep with a CUID of 456.

  • Update the destination object

In this scenario, the Monthly Store Sales will copy across. The Store Managers Report has a different CUID. The destination CUID will be kept.

  • Do not import import the object

(In this scenario, the Monthly Store Sales and Store Managers Report already exist in the destination. The reports will not be imported.

The three name scenarios can be placed into a matrix:

import-wizard-scenarios-xi3-update-by-name

import-wizard-scenarios-xi3-update-by-name

So some care and consideration needs to be given when importing objects using the Import Wizard. If you are in doubt, it is always best to select the option that doesn’t overwrite existing objects.

Goodbye Business Objects. Hello SAP Business Objects

Business Objects, an SAP company, is now called SAP Business Objects. This also applies to its products – e.g. SAP Business Objects XI, SAP Business Objects EDGE, etc.

If you try to access the http://www.businessobjects.com website, you now get redirected to http://www.sap.com/solutions/sapbusinessobjects/index.epx.

I actually like the new name.

There is also an article on the intelligent enterprise website which discusses the integration of the Business Objects sales force with the SAP sales force. In my mind that makes perfect sense. Both product suites tend to pitch at the same level in the enterprise, so it makes sense to discuss both SAP and Business Objects solutions in the same conversation.

17 tips to develop your career in Business Objects

1. Learn the basics of data warehouse design.

Start with the excellent book written by Ralph Kimball. Not only will the contents of this book help you understand the underlying data warehouse structures, it will also help you with universe design and report design.

2. Immerse yourself in the technology.

Keep up to date with news, blogs, white papers and articles on the subject. Buy and read books on the subject.

3. Volunteer for Business Objects work.

Show your enthusiasm. Let your managers and peers know that you’d like to work in that area. When they need someone, they may call you.

4. Consider a testing role.

If you are starting out, consider a testing or documentation role. By its very nature, you will become familiar with the various bits of functionality in that application.

5. Work on as many different Business Objects projects as possible.

Working for a consultancy is one way of achieving this. You will always pick up something new on every project.

6. Learn best practices.

Set yourself a high standard and follow it. Pick up best practices from your peers.

7. Get certified.

Becoming certified requires commitment, time and effort. It also helps you stand out from the crowd.

8. Use the software.

If you are learning Crystal, consider buying a personal copy of the Crystal software. Many books
have been written about Crystal. If you are learning Data Integrator or Enterprise, speak to your site manager. Licence issues permitting, you may be able to develop your skills in a development area in your own time. You can’t master Business Objects by reading.

9. Improve your existing setup.

Can current universe and report designs be improved? This may involve improving response times or improving the layout and readability of reports.

10. Specialise.

Become the ‘expert’ in a particular Business Objects niche – Data Integrator, Crystal, Enterprise or Xcelsius. Once you have mastered one area, take on another.

11. Be aware of competing products.

How do Business Objects products compare to products from other software vendors? Being able to discuss the merits of certain products against their competing products earns valuable kudos points.

12. Attend conferences and seminars.

Even better, speak at a conference. If anything will help your Business Objects career, this will.

13. Contribute to forums.

The best Business Objects forum in my opinion is BOB. Get involved. Build a name for yourself.

14. Know BI.

Have an awareness for Business Intelligence in general.

15. Write a blog!

Share your knowledge, expertise, issues and experiences with other people.

16. Keep an open mind.

You don’t know everything. You might think you do, but you don’t. So keep an open mind and keep your eyes and ears open. You might just learn something new.

17. Enjoy your work.

Enthusiasm is infectious and rubs off on other people. They will want you in their team.

XI 3.0 – New features

I recently installed XI 3.0 onto a development server in order to take a look at it’s new features.

The real impact of these new features will be more obvious to those upgrading from v5 and v6 Business Objects software, although there are some subtle changes from XIR2.

For those familiar with XIR2 and the management of the XI servers using the CCM console, this has now changed. Server management has now been moved to the CMC. The CCM is still there however. Two entries are listed in the CCM – Tomcat and Server Intelligence Agent. The latter allows a stop and restart of all the XI servers in one swoop.

Talking about the CMC, this has changed slightly in layout rather functionality from XIR2 to XI3. If you are familiar with the XIR2 CMC, you’ll find there is no major learning curve required there.

For me, one of the most exciting new features of XI3 is the Web Intelligence Rich Client. This appears to be Business Objects’ gentle way of getting you to develop web based reports. Unfortunately the application doesn’t read full client reports (.rep), so this isn’t a report conversion tool…yet(?).

When opening the Webi Rich Client, you are presented with a familiar Deski report interface straight from your desktop. There are subtle differences between Deski and Richi functionality. This isn’t quite a Deski replacement.

You don’t need to connect to the CMS in order to use Richi. If you have previously connected and downloaded a cube of data, you can use this data in offline mode, similar to what was available in Deski. However, select something that wasn’t in your original data cube, and you’ll find that it won’t update your report.

Knowing first hand what a real pain it is to develop webi reports over deski reports, I think I’m going to be using the Webi Rich Client quite a bit. Its a shame it doesn’t open and attempt to convert full client reports. This could have been the tool to migrate users from full client to webi once and for all. (Mental note: Write a blog entry regarding the migration of full client reports into Web Intelligence using the Migration wizard.)

Other XI3 features have been introduced – Cloning and Federation. The first allows you to copy a server to a different location. The agent copies all details of that server to the new server, so make sure you check the details once it has finished. Pay particular attention to the port numbers as these will need to change on the new server.

Federation is a useful ’synchonisation’ feature which allows you to transfer traffic between various sites. This might be useful in a multinational type deployment where you may have servers in say London, Mumbai and New York. Due to network latency issues, you may want to locate servers in each of these locations. Federation allows you to manage most types of content between these sites on a regular scheduled basis. Objects that can be selected include Reports, Universes, Users, Business Views, Calendars, etc. This can be quite handy as it allows you to manage objects and content from a central location and distribute it worldwide in a controlled manner, while allowing the network sites to benefit from increased performance by having that information locally.

Publishing has been approved. Crystal Reports and Web Intelligence documents are now supported. The resulting output can be saved to multiple formats including PDF. Dynamic recipients and delivery rules are also implemented.

Auditing features have been expanded, and a particular bonus for those using auditing on v5 and v6 Web Intelligence, client applications are now audited as well. This is incredibly useful, as a Web Intelligence auditing solution was not much use where your v5/v6 deployment was mainly full client based. Expanding auditing to include full client can now provide you with a far more accurate picture of what is going on.

Content search is a new feature which aims to bring a ‘Google’ like content search facility to your objects. Basically it is a search facility on the objects and data held in your reports. Previously a search was based on the title, description or keywords that you applied to a document or report. Bear in mind however, that the content manager needs to be run on a frequent basis in order to create an index on your underlying content. On large deployments, this may take a LONG TIME. Also bear in mind that this feature is only as good as the last time it was updated, so if you are planning on using this feature, it may be worth scheduling this to run overnight or weekends.

Changes to profiles, access levels and the inclusion of an Instance Manager have also been included in this updated release.

I’ve read about Lifecycle Manager, and have blogged about the beta program in a previous post. As I’ve previously mentioned, this is only available in XI 3.1. So I’ll have to wait a bit longer to get my eyes on it. I haven’t seen many posts from people using this tool. The few I have read offer mixed reviews, so they jury is out on that one for now.

One final thing, keep an eye out on the server processes. It may have just been my development system, but I did find a number of servers shutting down. This may be a timeout issue, but it is annoying to have to go back into the CMS to check and restart individual servers.

Business Objects Lifecycle Manager

It looks like Business Objects may have seen the ‘light’ on version and source control.

As you may be aware, Business Objects has never included version control functionality into its software. The moment you release a report into production, that’s it, no turning back. (Unless of course you done the smart thing and took a backup of the original report or universe). This led to a number of third party software companies to develop Business Objects versioning and migration software. The three third party tools of note are Noad’s EQM, Version Manager from Infosol and Version Manager from ebi experts.

Business Objects has now decided to integrate version control and migration functionality into its new XI 3 software. Currently available as an open beta on the XI 3.1 platform (itself a beta), Business Objects LifeCycle Manager can be downloaded from the following link:

http://beta.businessobjects.com/lcm

This product allows users to manage promotions between environments, version control and rollback functionallity and dependency checking. It also appears that there is a scheduling feature which allows for releases out of hours. To be honest, I think it is safer to release manually to avoid the potential problem of releasing something to production that you shouldn’t have. But then again, some users are bound to find this handy.

This looks like an interesting development from the part of Business Objects. I am looking to download the beta and will feedback my findings.

I’m not sure however, how this sits with the third party developers. Obviously they have filled an obvious gap in the market with their products. I’ve used EQM extensively and find it to be a very good product. However, if the Lifecycle Manager is any good, and if the pricing model for this new product is competitive, or dare I say it, bundled in for FREE, then these third party developers will need to slash their prices or find they no longer have a market for their product.

Addendum – I’ve just read that this product will be part of BOE with no separate license required.

Business Objects News – #1 BI vendor by revenue

BusinessObjects have reported on their website that they are the Number 1 Business Intelligence vendor by revenue.

Analysis by firm IDC states that BusinessObjects has a 19.2% market share and has exceed the $1bn revenue mark – apparently the first BI vendor to do so.

These are still early days following their purchase by SAP. However, this does provide some form of comfort to clients that have invested in the BusinessObjects platform, as well as those developers and consultants who make a living from this working with this software.