Blog: Dan E. Linstedt

« Dynamic Data Models - Automorphic Changes | Main | Operational Data Warehousing on the way... »

Unstructured Information Pushes Dynamic Restructuring

I've just completed Bill Inmon's brand new course on Unstructured Data using his new Unstructured Data ETL tool. It's been very eye opening. Every time I meet Bill I'm always learning something new. There was a discussion at the end of the class that asks the question: WHAT do you do if you FIND "structural definition elements" in unstructured data that AREN'T represented in the EDW??

So what is interesting here, is the notion that mining unstructured data gains knowledge or metadata by association that provide definitional elements _about_ the information held within. What we can do, and what we need here is truly Dynamic Data Warehousing - which includes the ability to BRIDGE structures, along with creating new structures.

To get to the unstructured data mart, we should be going throught the Dynamic Data Warehouse. Remember, I'm using the term Dynamic to include STRUCTURAL CHANGE, INDEX CHANGE, etc... So what that means is: that the structure which is discovered through unstructured data surfing is built via nerual networks, then it is subsequently graded on strength and confidence, and finally - optimized and adjusted by the neural net as new unstructured data is fed in.

This is what the Dynamic Data Warehouse looks like to me. The follow on is dynamic cubes, and once the unstructured data reaches the dynamic cubes we (I'm sure) will be surprised at what we find...

Stay tuned for more info later.

Cheers,
Dan L

Share: