We live in a world proliferated with hand-held devices. These devices can watch TV, see streaming movie content, browse the web, and provide interactivity via iconography and touch panels. Yet, we have serious problems with the delivery mechanism of an EDW, and BI on these devices. Yes, we can produce graphs and charts, and web-based reports - but it all appears to be back-ended by large scale systems that must be up all the time, and that we have to be interconnected to the web in order to "work" with our applications.
There are needs out there beyond the connected, that I will explore in this entry.
I've used my daughters Nintendo DS. I've seen my business partners I-Phone look-alike, and of course, I've seen all of this technology out in the field. What I marvel at is the advancement of database appliances in on the server side. I really like the column based database approach to housing data - especially if it's a small data set (less than 100 Terabytes). I'm familiar with Netezza, Dataupia, Vertica, and ParAccel, and a few others.
I've lately been hearing about a few needs from customers:
1) the need to have a centralized management architecture and framework
2) the need to have centralized governance processes
3) the need to have de-centralized data stores for privacy and ethics reasons (again controlled centrally), acting as a local cache of specific segmented data sets
4) the need to be able to access data on-network, and off the network - and when the network appears or is available, the device automatically synchronizes with the master EDW store.
5) the need to have real-time data, and an operational application directly on TOP of the EDW, so that history is available, but operational activities can take place in keeping the data fresh, or applying it to day to day activities (along the Operational Data Warehousing side).
6) the need for the centralized EDW data store keeping all history for compliance and accountability.
Now I think to myself, with all these wonderful advances in high-speed, MPP, and parallel computing we can easily achieve #6 (VLDW, high speed centralized EDW) etc... And with all these wonderful advances in hand-held devices, why can't we take advantage of them?
Well, I said quite a while ago, that I believe individuals in BI will switch their delivery mechanisms to Adobe Flash-Like platforms, we see it now with Microsoft's competing platform: SilverLight, and of course using things like QuickTime and Final Cut Studio. Interactive video, and user-interfaces on "video like" delivery systems will begin to make a difference in how we write our applications, and interface with our data.
BUT: we still need local data stores. We've seen a rise of In-Memory databases, Object Oriented data stores, but where-o-where are the column based databases? I strongly believe that with the massive compression ratio's they get, the high speed access they have, and the ability to load trickle data quickly (not to mention adapting the physical data architecture by adding and removing columns is very easy) - that they would have come to market with a hand-held device.
These are the requirements I think would be awesome to see one of these column based appliance vendors make available.
1) Column based data stores with in-memory pinning, pre-configured on a FLASH drive that can plug & play with an I-Phone like device
2) Application bundle on-top of the column based database for OLTP purposes.
3) partial historical data store acting as a local cache - available from column based data store
4) minimal configuration parameters, such as HTTPS addresses, and FTPS for auto-synchronization of data set changes when the network is available.
5) simple switch "on/off" for to control when synchronization takes place
6) encryption/decryption of the data set both in storage, and in transit - while the device talks to the main EDW mothership.
7) each device data is scrambled by different keys (multiple keys).
8) flash-based, or interactive video based application (still with forms and such) to collect data and feed it via SOAP/XML or web-service protocoll to and from the column based database.
9) additional ability to define application logic with functions embedded in the column based appliance
Now I could be behind the times here - maybe someone out there already has this platform, and if so - I'd really like to hear about it. If not, then I'd like to hear who may be close to this. The point is, I can think of at least a dozen of my large clients who can use this functionality today, and I simply don't have a solution to offer them.
Hope to hear from you soon,
Dan Linstedt, danL@geneseeAcademy.com
Posted January 29, 2009 5:09 AM
Permalink | No Comments |