We use cookies and other similar technologies (Cookies) to enhance your experience and to provide you with relevant content and ads. By using our website, you are agreeing to the use of Cookies. You can change your settings at any time. Cookie Policy.

Blog: Claudia Imhoff Subscribe to this blog's RSS feed!

Claudia Imhoff

Welcome to my blog.

This is another means for me to communicate, educate and participate within the Business Intelligence industry. It is a perfect forum for airing opinions, thoughts, vendor and client updates, problems and questions. To maximize the blog's value, it must be a participative venue. This means I will look forward to hearing from you often, since your input is vital to the blog's success. All I ask is that you treat me, the blog, and everyone who uses it with respect.

So...check it out every week to see what is new and exciting in our ever changing BI world.

About the author >

A thought leader, visionary, and practitioner, Claudia Imhoff, Ph.D., is an internationally recognized expert on analytics, business intelligence, and the architectures to support these initiatives. Dr. Imhoff has co-authored five books on these subjects and writes articles (totaling more than 150) for technical and business magazines.

She is also the Founder of the Boulder BI Brain Trust, a consortium of independent analysts and consultants (www.BBBT.us). You can follow them on Twitter at #BBBT

Editor's Note:
More articles and resources are available in Claudia's BeyeNETWORK Expert Channel. Be sure to visit today!


Recently I spoke with Doug Laney (formerly an analyst with META Group and now CEO and Chief Research Officer of Evalubase Research) about the results of his company’s latest research results. I found the BI results particularly intriguing.

Evalubase has a very creative and different method for getting technology evaluations. The company surveys a variety of IT professionals throughout our industry continuously about their real-life experiences with solutions. They gather a multitude of hard metrics and several free-form, unstructured comments in each completed evaluation. You, the participant, can choose to evaluate any technology you like whenever you like, and answer any questions you feel qualified to do so.

Since this is an ongoing study of the IT market, you will also find an “aging” algorithm to mitigate the impact of older evaluations. Let’s face it – vendors improve or get worse over time. Therefore, to reduce the undue effects of old evaluations, recent evaluations always count more heavily in the calculation of a metric or rating.

That said – what did they find (as of April 11, 2005)?

1. ERP applications won overall approval in terms of functionality, efficiency and reliability. CRM came in second. BI came in fourth – possibly suffering from vendor hype.

2. For overall ingenuity, Siebel got top honors (though, interestingly, they were last in terms of their credibility…), followed by HP, Microsoft, IBM and Oracle. SAP was ranked last in the line up.

3. In terms of overall key buying criteria for enterprise solutions, buyers were fairly consistent in ranking all criteria fairly equally – ease of integration, product performance, and functionality were slightly ahead of maintainability, cost of ownership, vendor reputation, ease of use and scalability.

4. For data management solutions, buyers are far and above interested in the performance and maintainability of these solutions. For data integration solutions, performance and functionality were top dogs with all others, except ease of use (second), distant thirds.

5. For BI solutions specifically, it seems that ease of integration is the runaway winner. Perhaps this explains the acquisition fever in our field these days with vendors scrambling to make their suite of products eventually fully integrated. Cost of ownership and performance were nearby seconds with ease of use, functionality, maintainability, scalability, and vendor reputation running a distant third.

Interesting, don’t you think? All the noise we hear about BI functionality, maintainability, and even scalability don't appear to be as important to the folks buying these products as the vendors think they are. Looks like Evalubase may serve a very important purpose in getting to the real requirements of our marketplace.

If you are interested in putting your two cents worth into their survey, all you need to do is register at their site.

As always -- Yours in BI success,


Posted April 13, 2005 8:21 AM
Permalink | 1 Comment |

1 Comment

Claudia, Ok, you convinced me to start a blog now! Thanks for the kind words about Evalubase. Looking forward to your continued insights on our "hard data from hardened IT professionals." Cheers, Doug

Leave a comment


Search this blog
Categories ›
Archives ›
Recent Entries ›