|
Blog: Dan E. LinstedtMay 2, 2008Unstructured Information Pushes Dynamic RestructuringI've just completed Bill Inmon's brand new course on Unstructured Data using his new Unstructured Data ETL tool. It's been very eye opening. Every time I meet Bill I'm always learning something new. There was a discussion at the end of the class that asks the question: WHAT do you do if you FIND "structural definition elements" in unstructured data that AREN'T represented in the EDW?? Continue reading "Unstructured Information Pushes Dynamic Restructuring" » April 26, 2008Dynamic Data Models - Automorphic ChangesIt seems people have taken the term "Dynamic Data Warehousing" and abused it. They've made it out to be about "Dynamic Data" and completely ignored "Dynamic Modeling", or dynamic restructuring as the case may be. Automorphic means self-changing, self-adapting. In this entry we'll talk about different capabilities of Dynamic Data Warehousing and the changes to data models as they grow. Continue reading "Dynamic Data Models - Automorphic Changes" » February 25, 2008The new evolution of Data ModelingBill Inmon and I sat down the other day to discuss a system that we are building. We didn't have a good "name" for it, but what it amounts to is: Operational Data Warehousing. If you can believe it, what we've done is taken the Operational specifics of systems capturing data - and placed it on top of the Data Warehouse as a single integrated historical and operational data store. We are currently using the Data Vault model for this componentry. Some folks have called this "Active Data Warehousing" in the past, but we feel that this is one step beyond, in that it actually IS the operational store at the same time as being the Data Warehouse. Convergence has arrived... Continue reading "The new evolution of Data Modeling" » December 23, 2007Automorphic Data ModelsI've recently begun research in to this area, and am calling this "Automorphic data models" rather than dynamic data warehousing, because I think the concept lends itself better to this kind of term. Dynamic Data Warehousing seems to be an overly-used slightly abused term in the industry, and raises quite a few questions as to how, and what it is. Vendors are also using this term to mean different things. We'll let the business and the vendors work out their definition of this term over the next few years. I'm going to write exclusively (for a while - in this section) on Automorphic Data Modeling. These entries are aimed at the researches and the scientific people in the audience. Continue reading "Automorphic Data Models" » October 9, 2007Context and PerspectiveI sat down with my good friend Jeff Jonas yesterday and discussed the nature and notion of contextual processing. Jeff is a phenomenal individual, and much smarter than I ever hope to be, but all that aside, we had a wonderful conversation about the nature of processing streaming data (one piece at a time, or possibly multiple pieces in parallel, but separated) and how to focus the notions of context. How is this related to B.I.? Continue reading "Context and Perspective" » August 3, 2007Dynamic Nature of SystemsI've been out for a while; getting new companies started can be hard to do... But I think we're getting there. Anyhow, as everyone knows - I've got an interest in the real nature of things, how they work, how they change and adapt themselves, and how automated computing facilities can bring these systems closer and closer to the business users. Ultimately we'd like the business users to manage, and suggest change to the back-ends through uncomplicated interfaces. We have a lot of terms popping up on the internet (even just over the past two years) which I'd like to explore, and then we'll dive in to where I think the industry should be going. In particular, one term is driving me to sleepless nights: "Dynamic" Continue reading "Dynamic Nature of Systems" » June 27, 2007DDW - Constantly re-defining the termI've had several good conversations with different folks in the industry lately about this term and what it means. Lou Agosta was nice enough to write a piece on DMReview, as well as have a really neat phone call with me. We both agree that there are more layers to this onion that originally thought. What a surprise!! But like anything, there are also steps, types, and classes of DDW to eventually get us there. In this entry I dive into the topic of "classifications of terms", and levels of DDW, and attempt to put down a rough road-map to get there. Keep in mind the definition is still in flux, and will be for some time to come. Continue reading "DDW - Constantly re-defining the term" » June 7, 2007DDW - Detecting and Securing ChangesThank-you everyone for the great feedback so far. Let's keep going on this track until someone says that it simply isn't possible. Why? Because as many of you know, I like to jump out beyond the horizon to see what might be done "outside the box", and if there is a remote chance that it will take hold (because of what we see happening), then great! If not, let's ditch the ideas in favor of something better... I must invent, but my ideas are based on many other individuals work in the industry. Continue reading "DDW - Detecting and Securing Changes" » June 6, 2007Dynamic Data Warehousing... A new definitionI've been writing (scantily) about DDW in the past, in this entry we will take a look at what the definition appears to be in the industry, and then I will offer my opinion on what I think the definition _should_ be for DDW. If vendors believe that they have a DDW, or a DDW solution, then I open heartedly invite them to contact the COBICC board members, and give us all a demonstration, along with definitions of what they've produced. Continue reading "Dynamic Data Warehousing... A new definition" » June 5, 2007Dynamic Data Warehousing and IBM (a rant)Warning: this is more of a rant, which I usually don't do - my apologies... This came across my desk this morning: IBM announces capabilities to support Dynamic Data Warehousing... It's always interesting when big companies don't give credit where credit is due. Of course, I'm not the first one to discuss DDW, and I certainly won't be the last. On the other hand, IBM is making claims that they came up with the definition... We'll I'll be! I had no idea that anyone was even talking about it. (See my post from 2005, here). Continue reading "Dynamic Data Warehousing and IBM (a rant)" » May 28, 2007Contextual Shifts in Metadata UnderstandingContext fascinates me, not to mention I love a good challenge.... Perhaps it's the fever I have tonight and perhaps it's just a wandering mind. In this entry I'm going to explore a couple of perspectives that I've been creating lately, along with a few theories that I'm proving out - and they have to do with (what else?) The obvious. The fact that metadata drives our data model structures, but rarely are metadata synchronized with definitional context (derived automatically from unstructured data sources), and rarely are they visualized beyond the standard 2 dimensional data models that we are so used to seeing and working with. This entry is a thought experiment that dives into a land of "what-if" analysis, and attaches it to what I call Dynamic Data Warehousing - which also leads to Dynamic Automated Architecture Manageability. The problem is: how can we build a consistent, standardized, and solid foundational data model that will adapt its self going forward as the business changes and the needs change? (All of this of course without loosing sight of all the history that has already been collected). Impossible you say? Not at all... Continue reading "Contextual Shifts in Metadata Understanding" » January 24, 2006Appliances are coming to EDWI've blogged several times about how appliances are arriving on the scene, and how eventually (I believe) will hold a place as an EDW - appliance. Appliances are making forays into many areas of OLTP and data capture which is the first step on this journey to creating an "appliance based warehouse." In one of my posts I went so far as to state that I believe the future of warehousing rests squarely in the appliance hands, and of course - not everyone agrees (which is fine). In this entry I'll take a look at the reasons why I believe appliances will be the EDW of the future, and why they will contain all the software elements we take for granted today. Of course the nature and definition of EDW is shifting as we speak, and tomorrow it won't just be your parents warehouse anymore. Continue reading "Appliances are coming to EDW" » Governance is Muddy Water.I've been doing a lot of research lately on the nature of Governance. There are a lot of misconstrued definitions in the market place, and a lot of vendors throwing around terms that they don't define. It seems like I've found definitions for Corporate Governance, and IT Governance, and even a definition for "Country" Governance, but finding definitions of SOA Governance and Data Governance leads to muddy water. "It's like trying to catch smoke with your bare hands!" (Harry Potter, The Prisoner of Azkaban). Continue reading "Governance is Muddy Water." » December 8, 2005Virtual "Data Tables" for EIIThere is a new concept on the horizon of EII known as Virtual Tables. In other words, structures and temporary data stores that capture data from the sources, and refresh it on request. In this entry we will explore the nature of virtual tables, and temporary data storage - the pros and cons of this mechanism. I'm not sure it belongs in Dynamic Data Warehousing, but it's not your "ordinary" mechanism for data access, therefore it's dynamic in nature - ever changing without management. Without further adieu, let's take a look at this concept. Continue reading "Virtual "Data Tables" for EII" » July 15, 2005Core definitions of Dynamic Data WarehousingIn recent posts I have begun to discuss a notion, or concept regarding something I call Dynamic Data Warehousing. It's real name should be Dynamic Structural Change and Adaptation Data Warehousing - but who would buy that? Not very marketing like if I say so myself. I recently blogged on the war of the appliance vendors, and have written articles in the past on Convergence, and the wave of integration and partnerships sweeping the industry. This is just one of the futuristic items that I believe is completely possible to build with today's technology. Continue reading "Core definitions of Dynamic Data Warehousing" » June 30, 2005What can DDW bring to the table?DDW (Dynamic Data Warehousing) is a couple years off (at least 3 to 5), but I still like to look into the future to find out what kinds of things we might create, and what the value of DDW might be. This entry is an exploratory entry - meant for discussion purposes, so please comment on what you think about DDW, it's feasibility, the timelines and anything else that may come to mind. Continue reading "What can DDW bring to the table?" » May 6, 2005Structural Mining, Dynamic Data Warehousing, Neural NetsI can't decide if this fits under nanotech or if it fits here, but I'll put it in this category, and focus on the business sides of the house. The winds are blowing outside today, as I sit here anxious for a return call. I've contacted a few individuals at a university which is currently studying structural mining techniques, and will hopefully be discussing some of their progress soon. In this entry, we will explore the brave new world of what I like to call: Dynamic Data Warehousing. I'm not referring to Dynamic Data sets, I'm referring to Dynamic Structuring and Restructuring of the information systems as a whole. Continue reading "Structural Mining, Dynamic Data Warehousing, Neural Nets" » |
Comprehensive resources for business intelligence and data warehousing professionals.
NETWORK WEBSITES:
BeyeSEARCH | BeyeBLOGS | BeyeRESEARCH | TDAN.com | BeyeNETWORK
Press Releases | About Us | Contact Us | Site Map | Privacy Policy | Media Kit
Copyright 2004 — 2008. Powell Media LLC. All rights reserved.
Business Intelligence Network™ is a trademark of Powell Media, LLC