Blog: Dan E. Linstedt Subscribe to this blog's RSS feed!

Dan Linstedt

Bill Inmon has given me this wonderful opportunity to blog on his behalf. I like to cover everything from DW2.0 to integration to data modeling, including ETL/ELT, SOA, Master Data Management, Unstructured Data, DW and BI. Currently I am working on ways to create dynamic data warehouses, push-button architectures, and automated generation of common data models. You can find me at Denver University where I participate on an academic advisory board for Masters Students in I.T. I can't wait to hear from you in the comments of my blog entries. Thank-you, and all the best; Dan Linstedt http://www.COBICC.com, danL@danLinstedt.com

About the author >

Cofounder of Genesee Academy, RapidACE, and BetterDataModel.com, Daniel Linstedt is an internationally known expert in data warehousing, business intelligence, analytics, very large data warehousing (VLDW), OLTP and performance and tuning. He has been the lead technical architect on enterprise-wide data warehouse projects and refinements for many Fortune 500 companies. Linstedt is an instructor of The Data Warehousing Institute and a featured speaker at industry events. He is a Certified DW2.0 Architect. He has worked with companies including: IBM, Informatica, Ipedo, X-Aware, Netezza, Microsoft, Oracle, Silver Creek Systems, and Teradata.  He is trained in SEI / CMMi Level 5, and is the inventor of The Matrix Methodology, and the Data Vault Data modeling architecture. He has built expert training courses, and trained hundreds of industry professionals, and is the voice of Bill Inmons' Blog on http://www.b-eye-network.com/blogs/linstedt/.

Appliances have a long way to go to mature - this is true. There are still a lot of customers asking for software packages to run on their existing systems. They rightfully want to leverage their existing investment in infrastructure. However, there are companies that are smaller (and some that are larger) that want to become more nimble, lower their maintenance overhead, replace old technologies with new for competitive advantage, and so on. These companies are looking at appliances in the market space. Appliances are growing up - albeit slowly.

What does this have to do with Convergence?
Software vendors are converging and acquiring to compete, they are beginning to see the value of packing incredible power and performance onto pre-configured hardware platforms, and providing web-interfaces for configuration. Software vendors are converging, as are hardware vendors, on to the notion that integration is king.

In previous blog entries I've discussed the notion of convergence, along with the notions of appliances.

War of the appliances and convergence
What will the future integration component have?
Appliances are coming to EDW
Open and Closed Appliances

And on Convergence:
War of the appliances and convergence
ETL, EAI, EII, and EIEIO

oracle buys sunopsis, redhat acquires meta-matrix, and so on.

What's going on out there?
In my humble opinion, I see some major trends. For example, I went to buy network devices for our new offices recently, and what I found confirmed quite a few things. For instance, a DSL modem with built in wireless, wired, and switching capabilities. It combines a web-interface for administration, a fire-wall, updatable firmware components, and wireless routing capabilities. Another new wireless router combined high speed, Draft N specifications, QoS, streaming video, and a few other functions. A print server combined with a wireless router - eliminating the need for a full computer to do the job.

There's no shortage of convergence: home phones are combining, networking, video, computer ready, and information bases. They've had for years, answering machines built in. Hand-held devices are combining computing power, graphics, video, music, networking, email, phone, and so on. Pretty soon, the PDA will include Bio-metric finger printing and an electronic key to open your car, start your car, and maybe even open your house.

What's this have to do with BI?
Convergence is happening in the BI world, convergence of software vendors (as mentioned above), convergence of hardware vendors, and convergence of software and hardware vendors. All of this is affecting the BI market space. If we want to be nimble, we must be enabled to move faster than our competition. We have to be able to do more with less, which means the machines we use have to become smarter, and more specific in their tasks.

Specialized machines can converge functionality of software with speed and ease of maintenance of hardware. Thus making it easier for plug and play devices to appear on the market - as well as making it easier to mass-produce these devices. These devices can enable the operator to "set it and forget it" when it comes to configuration switches, and when a newer version of the device appears, it is easy to upgrade - replace the entire device (because it's so cheap).

Why are we looking at appliances?
Because the nature and notion of appliance is changing to meet the needs of the convergence and standardization. Vendors are finding that in order to meet the demand (do more with less, and make it cost less), they have to go the route of mass-production and specialization; again, convergence of hardware and software. So, the specialized appliance is created.

What's coming in the BI space that will change our market?
A few things are headed our way. For instance why did Red Hat buy Meta Matrix? (the jury is still out on this one) Here's my opinion: they found a need to combine their specialized operating systems with highly complex data integration software in the EII space. What I'm really saying is that by combining their OS, with EII (gutting the EII, and rebuilding the best of breed) they are enabling their software for ready-made components with a web-interface control system, and data integration layers. If they want to take the cake, they can then put this combined set of software (in a couple years from now) on to a hardware platform, specialize the hardware platform to do "Features X, Y, Z" and a different hardware platform to produce features "P, Q, R” and sell them as appliances. In reality, they need to compete with Microsoft, IBM, Oracle, and Teradata.

But where does that leave the rest of the integration space?
You'll begin to see it (already has started happening), IBM has acquired hardware and software vendors over the past several years, Oracle has acquired several large software vendors, HP has acquired consulting services, software vendors and already has the hardware under its belt. Microsoft has acquired software vendors, and has effective hardware partnerships in place. Teradata well - Teradata has continued to improve the quality of their existing solutions. Neteezza has entered the market space as an appliance and has done well; DatAllegro has built their business on the nature and notions of convergence and also has done well.

Where does this leave companies like Informatica, Composite Software, Ab-Initio, Ipedo, Silver Creek, X-Aware, Meta Integration, and others?
Directly in the line of sight either as an acquisition target, or for acquiring other software vendors, and to boot - developing partnerships with hardware companies to produce specialized appliances that cannot be purchased anywhere else.

Why?
SOA will become a specialized appliance driven world. To implement SOA and all that it entails will require the ease of use, plug-and-play appliances that talk to each other through networking. The size and scope of SOA at an enterprise level requires that we do more with less, and that we improve our quality, performance, and lower the maintenance costs. All of this screams Converged Specialized Appliances which operate off of web-interfaces for management.

Quite simply put:
* Cost
* Ease of Use
* Performance
* Flexibility
* Expansion
* Improved Ability to be nimble
* Competitive nature

Data Integration technology will be created on an appliance basis in the future to get it out of the hands of the experts and in to the hands of the mass-population. Commoditization is important to innovation and moving forward. Convergence is one way to get there.

I'd love to hear what you think, please respond with your comments.
Thanks,
Dan Linstedt
http://www.COBICC.org


Posted May 3, 2007 5:58 AM
Permalink | 2 Comments |

2 Comments

This is already happening--there is already a vendor in the SOA / web service appliance space: Cast Iron (http://www.castiron.com/).

Yes, this is happening in many different spaces. I've blogged on Cast Iron appliance in the past. It's important to note that full-functionality in appliances will take time to develop. There are a number of new companies on the horizon, one of which is Dataupia that are tackling this space in a whole new way.

Convergence will happen, comoditization of our environment is on it's way.

Cheers,
Dan Linstedt

Leave a comment

    
Search this blog
Categories ›
Archives ›
Recent Entries ›