So, the FPGA is the magic ingredient. Combine that with a re-architecting of Netezza in TwinFin, released last August, that more effectively layered the disk access and moved to Intel-based CPUs on IBM BladeCenter technology, and you can see why Daniel Abadi came to the very prescient conclusion a month ago that IBM would be a likely suitor to acquire Netezza.
It seems likely that the short-term intent of the acquisition is to boost IBM's presence in the appliance market, competing especially with Oracle Exadata, not to mention EMC Greenplum and Terdata. Of more interest is the medium- and longer-term directions for the combined product line and for data warehousing in general. Curt Monash has already given his well-judged thoughts on the product implications, to which I'd like to add some.
My thoughts relate to the broad parallel between FPGA programming and microcode. You could argue that Netezza's FPGA is basically a microcoded accelerator for analytic access to data on commodity hard drives. As a long-time proponent of microcoded dedicated components and accelerators in its systems, dating all the way back to the System/360, IBM's way of thinking and Netezza's approach align nicely. The question, of course, is how transparently it could be done underneath DB2, and further, the willingness of DB2 for Linux, UNIX and Windows to embrace the use of accelerators as DB2 for z/OS has. The possible application of this approach under the Informix database shouldn't be forgotten either.
The interesting thing here is that the Netezza Fast Engine approach is inherently extensible. The MPP node passes information to the FPGA as to the characteristics of the query, allowing it to perform appropriate preprocessing on the data streaming to or from the disk. In theory, at least, there is no reason why such preprocessing couldn't be applied in situations other than analytic. Using contextual metadata to qualify OLTP records? Preprocessing content to mine implicit metadata? Encryption / decryption? It all lines up well with my contention that we are seeing the beginning of a convergence between the currently separate worlds of operational, informational and collaborative information.
But, what does this acquisition suggest for data warehousing in general? Well, despite my long history with and high regard for IBM, I do fear that this acquisition is part of a trend that is reducing innovation in the industry. The explosion of start-ups in BI over the past few years has resulted in a wonderful blossoming of new ideas, in stark contrast to the previous ten years, when traditional relational databases were the answer; now, what's the question. Big companies find it very difficult to nurture innovation and their acquisitions often end up killing the spark that made the start-up worth acquiring in the first place. IBM is by no means the worst in this regard, but I do hope that the inventions and innovations the characterized Netezza continue to live and thrive in Big Blue... for the good of the data warehousing industry.
Posted September 22, 2010 3:02 PM
Permalink | No Comments |