Business Intelligence Network business intelligence resources

Blog: Krish Krishnan

« A closer look at UnStructured data | Main | Analytic Appliances »

Why Data Management is a problem

Data management and architecture is becoming a nightmare for corporations. While the demand for more volumes of data at a greater detail keeps driving the IT resources, there are several issues that often get put on the shelf since the price point to manage the data and get it through the data warehouse becomes the focus of the implementation.

What can we do about the data management conundrum. Setting up a Data Steward office brings a point owner and a governance body brings the quality, teamwork and the ability to prioritize the data demands. What can you do when you drink from a garden hose which switches to a fire hose?

This is both a business and technology problem. While the business problem needs to be addressed, this blog will overflow if we discuss that aspect alone. A technology solution to the problem is available in the data warehouse appliance platform. User education needs to be a prime goal to help the blackbox become transparent, but once the understanding is there, the solution architecture becomes self evident.

How we can accomplish this and more will be discussed another day.

  Posted by kkrishnan on March 12, 2008 7:45 AM |

Comments

Hi,

I agree, data management is a problem, and data architecture and modeling is the cure. choosing the wrong data architecture for the wrong purpose is a deth knell in the coffin of a Generation 1 data warehouse.

Keep in mind that most appliances these days are "data model/architecture agnostic" like it or not, this is the way they are approaching the market space. This makes them a very short sighted solution.

Not to be brunt, but folks really need to be looking at the Data Vault data model/architectural solution and it's approach. It's being used by Data Warehouses Generation 2 to overcome all the issues you mention.

Cheers,
Dan Linstedt

Posted by: Dan Linstedt | March 16, 2008 7:28 AM

Post a comment

(If you haven't left a comment here before, you may need to be approved by the site owner before your comment will appear. Until then, it won't appear on the entry. Thanks for waiting.)