We use cookies and other similar technologies (Cookies) to enhance your experience and to provide you with relevant content and ads. By using our website, you are agreeing to the use of Cookies. You can change your settings at any time. Cookie Policy.


Blog: Claudia Imhoff Subscribe to this blog's RSS feed!

Claudia Imhoff

Welcome to my blog.

This is another means for me to communicate, educate and participate within the Business Intelligence industry. It is a perfect forum for airing opinions, thoughts, vendor and client updates, problems and questions. To maximize the blog's value, it must be a participative venue. This means I will look forward to hearing from you often, since your input is vital to the blog's success. All I ask is that you treat me, the blog, and everyone who uses it with respect.

So...check it out every week to see what is new and exciting in our ever changing BI world.

About the author >

A thought leader, visionary, and practitioner, Claudia Imhoff, Ph.D., is an internationally recognized expert on analytics, business intelligence, and the architectures to support these initiatives. Dr. Imhoff has co-authored five books on these subjects and writes articles (totaling more than 150) for technical and business magazines.

She is also the Founder of the Boulder BI Brain Trust, a consortium of independent analysts and consultants (www.BBBT.us). You can follow them on Twitter at #BBBT

Editor's Note:
More articles and resources are available in Claudia's BeyeNETWORK Expert Channel. Be sure to visit today!

I read an interesting article in the Business Intelligence Pipeline Newsletter recently asking which was the more difficult challenge - assuring data quality or integrating data from across your organization. They have a voting booth set up so you can cast your vote for which you believe is the more difficult task. I have my own opinion as well.

I voted for assuring data quality and, at the time of my vote, it appeared that the majority of voters agreed with me. Why? In my opinion, it is because of the assuring part of the task.

Data integration seems to be a much more straightforward task with more mature technologies, methodology, and practical expertise in the data integrators. Even the definition of data integration seems to be cut and dried. (Not always but at least you have a solid standard to go from -- a single version of the truth...)

I think we are still feeling our way through what it means to assure data quality. While there certainly is useful technology to help with data quality, so much of the assurance part is still heavily dependent on the human being (in this case, usually a business person)eyeballing the cleaned up data to verify its "quality". There don't seem to be very clear, standard methodologies or processes to follow either. And what are the metrics of quality? When to we reach a state of "quality"? And what exactly does quality data even mean?

Without answers to these fundamental questions, it seems to me that we will continue to struggle with this challenge more so than with that faced by data integrators.

Your thoughts?

Yours in BI success,

Claudia


Posted April 11, 2005 1:03 PM
Permalink | 2 Comments |

2 Comments

I agree, the quality of the data is where most of my data conversion issue arise from. I can map the data, but when we try to compare results it can be a challenge to work out the minor details.

Data quality, by far, is the more difficult of the two tasks, and the reason is simple: Data quality is a business process oriented concept, defined by each business in situ. This is how it should be and this is how it will continue to be for quite some time at least. Competitive business has the inherent right to find its own place between the poles of incompetence and brilliance. In a data quality perspective, what fits the needs of a given business may seem either too much or too little to another business. This is just the nature of business. The data quality tools that will be the most successful are those that recognize this immutable truth and provide the most flexibility to the end user.

Leave a comment

    
   VISIT MY EXPERT CHANNEL

Search this blog
Categories ›
Archives ›
Recent Entries ›