We use cookies and other similar technologies (Cookies) to enhance your experience and to provide you with relevant content and ads. By using our website, you are agreeing to the use of Cookies. You can change your settings at any time. Cookie Policy.

Blog: Richard Hackathorn Subscribe to this blog's RSS feed!

Richard Hackathorn

Welcome to my blog stream. I am focusing on the business value of low latency data, real-time business intelligence (BI), data warehouse (DW) appliances, use of virtual world technology, ethics of business intelligence and globalization of business intelligence. However, my blog entries may range widely depending on current industry events and personal life changes. So, readers beware!

Please comment on my blogs and share your opinions with the BI/DW community.

About the author >

Dr. Richard Hackathorn is founder and president of Bolder Technology, Inc. He has more than thirty years of experience in the information technology industry as a well-known industry analyst, technology innovator and international educator. He has pioneered many innovations in database management, decision support, client-server computing, database connectivity, associative link analysis, data warehousing, and web farming. Focus areas are: business value of timely data, real-time business intelligence (BI), data warehouse appliances, ethics of business intelligence and globalization of BI.

Richard has published numerous articles in trade and academic publications, presented regularly at leading industry conferences and conducted professional seminars in eighteen countries. He writes regularly for the BeyeNETWORK.com and has a channel for his blog, articles and research studies. He is a member of the IBM Gold Consultants since its inception, the Boulder BI Brain Trust and the Independent Analyst Platform.

Dr. Hackathorn has written three professional texts, entitled Enterprise Database Connectivity, Using the Data Warehouse (with William H. Inmon), and Web Farming for the Data Warehouse.

Editor's Note: More articles and resources are available in Richard's BeyeNETWORK Expert Channel. Be sure to visit today!

tdp logo.pngOliver  Ratzesberger, Senior Director, Architecture and Operations of eBay, started by citing their data volumes: 50 TB/day in new incremental data, processing 50 PB/day, 10s millions of queries/day, 99.98% availability, over 15 PB (petabytes) of online storage, and so on. Those are big numbers!

They are defining the next version of their layered architecture for analytics customers, self-service, analytics as a service. Design for the unknown since 85% of our workload is new and unexpected. Exploration is the core of an analytical company. The metrics you already know are 'cheap'.

td-Oliver.pngBecause of intensive time-to-market pressures on the business, there is a renewed push for departments to have their own data marts. eBay needed to respond to these pressures while avoiding the usual problems with fragmented data and partitioned infrastructure. Oliver asserts that the TCO for the simplest data mart is at least $500K. In other words, a data mart cannot be cheap enough to justify its existence.

The solution is to build the same set of private data marts but as a virtualized system that shares all the data and processing capacity. By scaling across a large number of workload results in a much lower peak loads across the enterprise.

"Analytics as a Service 2.0" is an initiative for: self provisioning in five minutes, templatized marts from common problems for business units. You need: unlimited scalability in data volume, concurrent users, application complexity, queries; workload management, and virtualized support. This package is now offered by Teradata.

The benefits are to be able to react to requests for new analytics with 'agile prototyping. Users can 'fail fast' which allows user to try out new ideas quickly at a low cost.

When asked about the relevance of cloud computing to his initiative, Oliver said that the analytics run on the physical system to avoid massive data movement. However, the results of the analytics could drive applications that may run in cloud environments.

Another question was about maturing successful prototype applications into production status. eBay promotes as new subject areas or extension to existing subject areas.

Posted October 20, 2009 6:53 PM
Permalink | No Comments |

Leave a comment