Blog: Richard Hackathorn http://www.b-eye-network.com/blogs/hackathorn/ Welcome to my blog stream. I am focusing on the business value of low latency data, real-time business intelligence (BI), data warehouse (DW) appliances, use of virtual world technology, ethics of business intelligence and globalization of business intelligence. However, my blog entries may range widely depending on current industry events and personal life changes. So, readers beware! Please comment on my blogs and share your opinions with the BI/DW community. Copyright 2017 Mon, 26 Oct 2009 15:23:05 -0700 http://www.movabletype.org/?v=4.261 http://blogs.law.harvard.edu/tech/rss IBM IOD/Gold Briefing - 4th Day PM ibm-iod logo.pngNice lunch. Getting into the rhythm of these briefings. Looking forward to the analyst dinner tonight to meet several old friends.

ibm-ILT arch.pngIBM InfoSphere Servers by Sriram Padmanabhan, IBM Distinguished Engineer, Architect for InfoSphere. Sriram started with the layered architecture for the Information-Lead Transformation theme. He then went into five major components that comprises the InfoSphere Server. The rest of the briefing was under NDA.

IBM InfoSphere Master Information Hub by Mandy Chessell, IBM Distinguished Engineer and Chief Architect for InfoSphere Tools. The Master Info Hub (MIH) focuses on spots in the enterprise data model for critical entities where data glitches cause major problems for the business. The MIH synchronizes the various copies of master data (for instance, about customer, product and so on). In their press release, IBM is positioning MIH to go beyond pre-packaged entities in traditional MDM products. My interpretation is the MIH is an 'active' MDM service. The rest of the briefing was under NDA.

ibm-InfoSphereTools.pngIBM InfoSphere Foundation Tools and Info Mgt Metadata by Dan Wolfson, IBM Distinguished Engineer and Chief Architect for Info Platform Solutions. Dan started with a good introduction to the problems and value of master data as 'authoritative information'. He weaved us through the various tools for understand-design-govern used by various roles on various systems across various generations of legacy IT. The overall diagram of the project lifecycle is shown at the right; click to enlarge. I have heard this story for many years. Each year the story goes deeper and broader across enterprise IT development/execution requirements. Progress is being made

]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/ibm_iodgold_bri_5.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/ibm_iodgold_bri_5.php 200910 IBM Gold Mon, 26 Oct 2009 15:23:05 -0700
IBM IOD/Gold Briefing - 4th Day AM ibm-iod logo.pngThe day started with the keynote kickoffs on this first day of the IOD conference. And I have been here three days already?

IOD Grand Opening by Ambuj Goyal, General Manager of Business Analytics and Process Optimization. Ambuj started by saying that attendance is up over last year, despite the recession. He remarked that this year's gold sponsor of IOD is Intel and then reflected that the last several years the gold sponsors were acquired and now are part of IBM, such as FileNet and Cognos. Did he suggest that IBM will be acquiring Intel? ibm-arvind.jpgAmbuj introduced Arvind Krishna as the new General Manager of Info Mgt Solutions, as described in a previous blog.

Frank Kern, SVP of Global Business Services, followed by getting an understanding and business justification to "Information-Lead Transformation" theme. What does it take to create deep predictive analytics? ...to reduce uncertainty in our decisions? The dilemma is that we have more information than ever before, but less trusted information is available, and radically less real-time information. Frank shared the example of the NYC Fire Department. They are monitoring conditions in 8,000 buildings. They feel that their mission should be not the fighting of fires, but the elimination of fires totally! By using analytics to predict which buildings have a high probability of a fire, they can take preventive measures. Frank ended with a quote by Robert Kennedy who borrowed from George Bernard Shaw, "Some men see things as they are and say why. I dream things that never and say why not.

Frank then invited a customer panel onto the stage, consisting of Shirley Lady of BlueCross BlueShield Association, Nihad Aytaman of Elie Taharl Ltd, and Debbie Oshman of Chevron. Great discussion but wished they would have gone deeper into the specifics. Nihad made the point the small (SMB) companies can have BI with only one BI person!

IBM Smart Analytics System (ISAS) by Bill O'Connell, IBM Distinguished Engineer of Data Warehousing and CTO. Bill has a tough job of juggling dozens of technologies spread across dozens of products, with new technologies being added monthly through acquisitions. He started with an overview of the recent announced IBM Smart Analytics System (ISAS). From customer forums, Bill remarked that most customers want to build their own systems and avoid packages. In other words, most customers want the ability to customize their solutions, rather than predefined appliances. Hence, ISAS is a highly customizable packaging of a full-stack BI system. We went through the options available. For the smaller predefined packages, IBM has built and inventory those systems to assure two-week delivery. Also, InfoSphere Balanced Warehouse has evolved into ISAS since the former can be obtained by unchecking certain options.  The rest of the briefing was under NDA.

From a discussion of SSD (solid-state disk) implications, an question that I asked was why not just increase main memory. Why continue the traditional distinction between main memory and external storage? Bill reminder me that main memory is good-olde volatile RAM while SSD is slower and cheaper non-volatile flash memory. Hence, the traditional distinction will continue.
]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/ibm_iodgold_bri_1.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/ibm_iodgold_bri_1.php 200910 IBM Gold Mon, 26 Oct 2009 09:18:26 -0700
IBM IOD/Gold Briefing - 3rd Day PM ibm-iod logo.pngibm-gold room.pngNice lunch and good conversation with Richard Winter about various DW appliance products. Back to my warm seat.
 
InfoSphere Discovery by Alex Gorelik, Chief Architect, and Todd Goldman, Program Director. The objective is to accelerate time to deployment by automating data discovery to document the data objects. The use case is data growth, data integration, and data privacy. Components are: Transformation Analyzer and Source Data Discovery and Unified Schema Builder. The demo discovered tables/relationships related to ORDERS among 30+ tables. Several more demos of finding complex business rules buried in the data and sensitive personal data embedded in other files. Impressive! Wished I had this tools years ago!

ibm-cotner.pngTodd drove the key points by doing several magic tricks (smoothly executed) for us. As first-time presenters to the Gold group, they done well...

IBM Integrated Data Mgt by Curt Cotner, IBM Fellow and VP/CTO for Database Servers. Curt is a regular at the Gold group so the conversation goes like, "last year we discussed this but now it is that". Curt gave us a tour through a series of products like: InfoSphere Data Architect, Optim Data Privacy, Optim Database Administrator, Oracle support in Optim Development Studio, pureQuery variations, and Optim Query Tuner.

IBM IMS Update by Betty Patterson. IMS is the top revenue-producing software product, long running over 42 years and going strong! See the Wikipedia entry for IMS's history. Why is IMS still relevant to Enterprise IT? Betty argued that IMS has become an integration points for SOA and a solid performance/reliability/security record. And, IBM has continued to make considerable investments into IMS.

One program is educating the new generation of IT professionals in IMS skills. An academic initiative for System z has involved over 600 schools with 50,000 students, resulting in 30 courses, exams, and Application Programming certificate. Another program is application modernization to increase usability leveraging IMS investments. The third program is a simplification of database administration reducing the skill level for performance tuning, etc.

IMS version 11 is available this month. A list of new functions is here, and fact sheet is available here. Betty continued by covering future directions for IMS, which was under NDA.   
]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/ibm_iodgold_bri_4.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/ibm_iodgold_bri_4.php 200910 IBM Gold Sun, 25 Oct 2009 14:20:57 -0700
IBM IOD/Gold Briefing - 3rd Day AM ibm-iod logo.pngIt is Sunday; must be the third day of Gold briefing... It is going smoothly. Mike and Teressa are doing an excellent job of herding us cats. Last night, we had a wonderful six-course (with wine pairing) dinner at Aureole Swan Court. As shown here, the table was set full with the proper wine glasses. There are real swans, one of whom was quite friendly.

ibm-ecm logo.pngIBM Enterprise Content Mgt by Jim Reimer, IBM Distinguished Engineer. Jim started with a broad overview the entire ECM market. Lots of innovative applications that have fundamental changes in some industries, like insurance. These ECM systems are massive. Jim shared that a customer turned on full-archiving of all corporate email, resulting in several petabytes collected over a year. They estimated that they has rival Google's data sizes, given the requirement for seven years of managed history. ECM has stimulated issues...political, cultural, privacy...across the corporation and globally.

As shown in this figure, the ECM portfolio emphasizes three services: search/discovery, biz process mgt, and collaboration. Regardless of the content repositories or of the client apps, these three services form the various function delivered to the users. A critical part of this portfolio is the Business Process Mgt (BPM) service, which will be part of the new Info Mgt divisions with IBM. There are two parts to BPM, one from ECM and the other from WebSphere.

Another application area is in litigation response by filtering and organizing emails and the like. Jim then described solutions for searching and organizing external web information for use within the firewall as enterprise content. This is similar to my work on Web Farming resulting in the book Web Farming for the Data Warehouse in 1998. 

ibm-potter.pngBI and Performance Mgt by Mike Potter, IBM Distinguished Engineer and Chief Architect of Cognos Products. Mike stated that the objective of Cognos, now as part of IBM, is on improving the performance of the business user within an enterprise context. Using the maturity model from AMR Research, there are four steps to Performance Mgt: Reacting, Anticipating, Collaborating, and Orchestrating. As shown here, the architecture for Cognos Performance Mgt System has several layers, starting with the underlying info infrastructure and ending with various apps in finance, workforce, banking, etc. Mike then took us through the variety of Cognos products, as listed here. This list does not include various applications in financial performance. Directions are toward a simplified and consistent self-service experience by business users with Cognos products. Mike explained the TM1 OLAP engine from Aptix, which seems redundant with other IBM products.

In summary, there is a blizzard of products from Cognos. The good news is that there is maturity and depth with Cognos' functionality. The bad news is that the complexity and inconsistency of this functionality among the broader IBM portfolio is mind-bending! The Hogwarts sorting hat has a challenge here!

Time for lunch! Yea! I don't need the food but do need time to clear the mind...necessary...
]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/ibm_iodgold_bri_3.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/ibm_iodgold_bri_3.php 200910 IBM Gold Sun, 25 Oct 2009 10:32:30 -0700
IBM IOD/Gold Briefing - 2nd Day PM ibm-iod logo.pngStarting the afternoon of second day of IBM Gold briefings.

DB2 for Linux, UNIX, Window by Tim Vincent, IBM Fellow, Chief Architect for DB2 for LUW. Most of this talk was unfortunately confidential. The only section not under NDA was about DB2 pureScale (DB2 for LUW's new OLTP shared disk clustering solution) that allows unlimited scalability. This figure shows almost linear scalability, at least up to 128 nodes. Initially it is available only for AIX servers, but others DB2 servers will be available in the future.

ibm-hamid.pngDB2 for z/OS by John Campbell, IBM Distinguished Engineer, DB2 for z/OS Development. John focused on the customer migration to the latest version DB2 9. This figure shows the recent evolution of the DB2 product. Various problems and hints for DB2 9 were covered, along with possible features in the next version.

eXtreme Analytics Platform by Hamid Pirahesh, IBM Fellow, Senior Manager, Exploratory Database at IBM Research. Hamid delivers the best presentation in these Gold briefings. See my blog from last year about his presentation style and innovative content.

Hadoop evolution as an open-source data engine for BIG applications for Yahoo!, Facebook, Amazon, and AOL. It is using thousands of servers using petabytes of data. Huge appetite for extreme analytics for many large corporations. Need for a eXtreme Analytics Platform (XAP) that takes wide spectrum of unstructured, structured, and semi-structured data from diverse external sources into a MapReduce Hadoop++ data engine. IBM's motivation is to provide corporate IT with a value-enhanced alternative to each user doing their own thing on their own personal data cache from often semi structured and unstructured external sources. To support a Java Analytics Apps Server, IBM has proposed JAQL as an open query language for JSON data model on XAP. To perform for the data analysis, the R statistics language, along with SPSS, will be used. Hamid did a demo of running analytics against CO2 observations (simulating real data from XAP customer engagements) using both R and SPSS. He then explained a case of exposing unusual financial activities for the SEC.
]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/ibm_iodgold_bri_2.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/ibm_iodgold_bri_2.php 200910 IBM Gold Sat, 24 Oct 2009 13:50:34 -0700
IBM IOD/Gold Briefing - 2nd Day AM ibm-iod logo.pngStarting second day of IBM Gold briefings. Doing well, running strong so far...

Business Analytics and Process Optimization.by Ambuj Goyal, General Manager of BA/PO, and Arvind Krishna, General Manager of Info Mgt Software. Ambuj began on the recent history of Information-On-Demand (IOD) theme since 2005. Since then, they have invested in $12 B in technology acquisitions. Next evolution stage for IBM is the "information-lead transformation" of the business. Ambuj asserted that this future market will be "bigger than ERP and CRM combined". 

Ambuj announced that IBM is splitting their organization into two parts: Arvind Krishna is now the new general manager of the Information Management Software group (for the core infrastructure), while Ambuj will focus on this new group for Information-Lead Transformation. The contrast is between technology infrastructure versus business strategy.

Arvind summarized his responsibilities as being "to make the sh$# run faster" and lead us on a rapid survey of various technologies, as shown here. Several tidbits are... Workload optimized systems as a new type of appliance. Smart Analytics System cuts deployment time from 6 months to 12 days for BI applications. DB2 pureScale allows unlimited capacity and incremental additions. I have observed linear scaling to a 128-box configuration, which can process 6,060 M transactions per minute.

An intriguing issue is whether IBM's new thrust is: (a) an incremental step in their traditional role as middleware infrastructure or (b) an radical step into enterprise application solutions. My initial hunch is that the answer will be BOTH.

IBM Cloud (and Data) Perspectives by Anant Jhingran. Anant now gets it about cloud. Cloud is defined as "flexible, resilient and cost-effective delivery platform for IT services. It is quick, simple and highly scalable."  Is it only old wine in new bottle? So what? Is it a disruptive technology? In any data center, management efforts and energy costs dominate.

There are two major factors: infrastructure leverage (virtualization of hardware, utilization) and labor leverage (automation of management, standardization of workloads). Anant continued with an excellent balanced overview of cloud and its business motivations. He suggested a spectrum of cloud deployments: private, yyy, consortium, public.

IBM Information Mgt Strategy by Andy Warzecha, VP of Info Mgt Strategy
. Andy started with a detailed estimate of market sizes compiled from IDC and other analysis firms. The first figure shows market size versus market growth by software category. Note that the growth segment is traditional BI into business analytics. The second figure shows market size versus market growth by industry. Government has moved into a commanding position. Also note the contrast from healthcare and automobile industries. There is a shift to 60% of IT decisions are driven by the business side rather than the IT side. Finally, the gap between current and desired capabilities for data latency stood out for me. Most companies desire data to be real-time but only a small percentage are currently doing real-time...implying a large gap.  

Andy shared a sobering story of a large Canadian company having an urgency to enable new business solutions. A LOB executive asked how to motivate their CIO to this urgency. She confided that the problem will probably be resolved by finding a new CIO or out-sourcing the entire IT group...impacting tens of thousand of employees.

Two hundred and fifty CIOs said that cost reduction (83%) and operation improvements (81%) is the most importance over next years. From IBM New Intelligence Customer Interviews with 104 IT professionals and 107 LOB managers in large enterprises, the top challenges were: integrating data for holistic view, continuous analysis of massive data, and real-time predictive analytics for end-users.

Bottom line is... The direction should not be creating and selling new technology. The direction should be making current technology work better for the business. The shift is to agile infrastructure that integrates information and optimizes processes.
]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/ibm_iodgold_bri.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/ibm_iodgold_bri.php 200910 IBM Gold Sat, 24 Oct 2009 09:05:44 -0700
IBM IOD/Gold Briefing - 1st Day ibm-iod logo.pngWe started 4.5 solid days of briefings. My seat will be quite warm and my rear quite sore this week! The saving grace is that IBM's best and greatest will be in front of our group!

ibm-gold sign.pngIBM Optim by Al Smith, Director of Optim Engineering. Excellent informative update. Understanding the entire data management life cycle from design to create, classify, subset, mask, archive, access, migrate, and finally dispose...across all systems and applications in an enterprise architecture. Optim will be the heterogeneous solution from IBM to support all facets of data life cycle. Discussed future products and direction under NDA. One general (and insightful) diagram is the business value of information across its life cycle, as shown here.

IBM Software Strategy and Architecture by Jim Caldwell, Director of IBM Technical Strategy. Their objective is "to provide next generation open integration platform built on SOA" to "build a smarter planet". Jim focused on how IBM Software group supports industry solutions as a middleware platform vendor (as opposed to an application vendor). IBM refers to their offering as an "industry framework" consisting of data definitions, code for common scenarios, data adapters to move data among components (possibly from other vendors), foundational services like security, auditing, logging. Examples are: Service Provider Delivery Environment for telco, and Solution Architecture Framework for Energy for utilities. Out world is becoming Instrumented; our world is becoming interconnected; and all things becoming intelligent. Diagram shows what it means to be smarter, as shown here.

Nice reception afterward. A chance to renew old friendships...  Thus, ends Day One. Need rest for tomorrow.
]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/ibm_gold_briefi.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/ibm_gold_briefi.php 200910 IBM Gold Fri, 23 Oct 2009 16:40:56 -0700
Teradata Partners: Curtis Kowalski of Xcel on ODS Consolidation tdp logo.pngtd-xcel1.pngCurtis Kowalski, Chief Data Architect at Xcel Energy, talked consolidating multiple operational data systems (ODS) in an EDW.The goal is to retire all departmental ODSs and independent data marts into an EDW using Teradata, in 3NF. Xcel is doing this incrementally over time, starting with a 'lightly integrated' data warehouse. Hopefully this will enable the organization to the business value of integrated data.

Curtis presented a viable approach to move a traditional IT infrastructure into the new world of integrated data warehouse, especially when this integration involved low-latency data in ODS.
]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_30.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_30.php 20091018 TD Partners Wed, 21 Oct 2009 08:57:50 -0700
Teradata Partners: Ben Stein on the World, Economy, Politics and Everything Else tdp logo.pngFun romp through modern times! You had to listening carefully. Blink that you would miss a crucial twist of history. Best way to summarize Stein is with tidbits here and there...

 td-BenStein.png"Credit Default Bond is a cap pistol hooked to a nuclear bomb. We just do not know whether deficit spending, stimulus funding and the like is working. We just don't know... We just don't know... Ben paused to sip Throat Coat from Whole Foods. "What is the world going to be like when Iraq has a nuclear bomb? What is the world like for my son? Is global warming valid? We are not allowed to debate it? A serious serious serious problem in the collapse of education! I have observed the decline in our education. One fourth of high-graduate is able of only 'C' level college math. Let me tell you about a conversation I had with two young folks... about WWII, Germany, Russia, and where big trees grow! Sad! Our top economic advisers did us a huge disservice.

Ben finished with a tribute to our arm forces and police... "Where is salvation coming? The real stars are young people who are putting on body armor... I visit Walter Reed hospital and then national cemetery. A quote that I always remember... We asked God to bless this great country. In this world, God's work has to be our work.

]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_29.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_29.php 20091018 TD Partners Wed, 21 Oct 2009 08:42:04 -0700
Teradata Partners: Michael Whitehead and Mark Budzinski of WhereScape tdp logo.pngtd-wherescape log.pngI had a nice breakfast with the WhereScape folks this morning. The company sells tools to design and build data warehouses. That seems like a function already satisfied by many existing data modeling and ETL products. However, add the business requirement to build a data warehouse is a few days or even a few hours, and you have a different animal. We discussed industry directions and market strategy and did not have the time for a product demo... but will take time to see that demo on the exhibit floor. [will add more here later based on the demo]
]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_28.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_28.php 20091018 TD Partners Wed, 21 Oct 2009 08:15:58 -0700
Teradata Partners: Dan Graham and Todd Papaioannou on Teradata Cloud Computing tdp logo.pngDan Graham and Todd Papaioannou presented Teradata's directions in Cloud Computing to the analyst group. It is interesting to note that Todd recently joined Teradata from Greenplum where he was Chief Architect.

They defined Cloud Computing as: on-demand self-service, with broad network access, with resource pooling, rapid elasticity, and measured service. It can be deployed as a private (behind your firewall), public or a combination. There is a penalty of around 20% to run complex workloads in a cloud environment.

td-ToddP.pngDan sketched the Teradata Agile Analytic Cloud for provisioning of user data marts, with the advantage of self-service, multi-tenant where the premium is on deployment time for that data mart. Use cases are: proof of concept, development, power-user sandbox, testing, and other short-term projects. To create new data marts, business users has several web portlets to define their requirements. The main advantage is the ability to join with data in the EDW in a managed environment.

In addition, Teradata is offering a cloud-like service that is Software-as-a-Service (SaaS) for demand-chain management in the retail industry. The pricing is based on the number of SKU within the database.


]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_27.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_27.php 20091018 TD Partners Tue, 20 Oct 2009 19:21:13 -0700
Teradata Partners: Oliver Ratzesberger on Agile Business Analytics tdp logo.pngOliver  Ratzesberger, Senior Director, Architecture and Operations of eBay, started by citing their data volumes: 50 TB/day in new incremental data, processing 50 PB/day, 10s millions of queries/day, 99.98% availability, over 15 PB (petabytes) of online storage, and so on. Those are big numbers!

They are defining the next version of their layered architecture for analytics customers, self-service, analytics as a service. Design for the unknown since 85% of our workload is new and unexpected. Exploration is the core of an analytical company. The metrics you already know are 'cheap'.

td-Oliver.pngBecause of intensive time-to-market pressures on the business, there is a renewed push for departments to have their own data marts. eBay needed to respond to these pressures while avoiding the usual problems with fragmented data and partitioned infrastructure. Oliver asserts that the TCO for the simplest data mart is at least $500K. In other words, a data mart cannot be cheap enough to justify its existence.

The solution is to build the same set of private data marts but as a virtualized system that shares all the data and processing capacity. By scaling across a large number of workload results in a much lower peak loads across the enterprise.

"Analytics as a Service 2.0" is an initiative for: self provisioning in five minutes, templatized marts from common problems for business units. You need: unlimited scalability in data volume, concurrent users, application complexity, queries; workload management, and virtualized support. This package is now offered by Teradata.

The benefits are to be able to react to requests for new analytics with 'agile prototyping. Users can 'fail fast' which allows user to try out new ideas quickly at a low cost.

When asked about the relevance of cloud computing to his initiative, Oliver said that the analytics run on the physical system to avoid massive data movement. However, the results of the analytics could drive applications that may run in cloud environments.

Another question was about maturing successful prototype applications into production status. eBay promotes as new subject areas or extension to existing subject areas.

]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_26.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_26.php 20091018 TD Partners Tue, 20 Oct 2009 18:53:11 -0700
Teradata Partners: Tom Davenport on Competing with Analytics tdp logo.pngProf. Tom Davenport of Babson College began... We are at a historical inflection point! For 30-40 years of accumulating data that we should be using. Executives wonder whether they actually have better decision making. Why did we make this investment? But the time to realize better decision making has come! There is a shift of the key unit of analysis from transactions to decisions.

td-Tom.pngIs it the golden age of analytics?  Tom recommended Money Ball as an industry (professional sports) that is transformed from the use of analytics. Since 2005, there is now lots of discussion on analytics and its role in corporate IT. He is starting the International Institute of Analytics.

In tough times, analytics should provide precision answers to important questions, such as: prices that should be changed in specific situations, inventory levels that are absolutely essential, marketing promotions that are really working, and so on.

Answers does not come overnight, instead they require passionate advocacy, intuition, and creativity over the long term. Analytics is not sterile rigorous thinking for an elite few. Tom shared a number of corporate examples like Marriott, Royal Bank of Canada, UPS, Harrah's, J.C. Penny, Capital One and Netflix.  He continued with examples of analytics in professional sports He is a Red Sox fan!.
 
How do you compete with business analytics? Tom offered the DELTA model that has five factors: Data, Enterprise, Leadership, Targets and Analysts. Think about the out-of-the-box data that is worth gathering, such as measuring the frequency of smiling for customer service at Harrah's. We need to link the business value of better analytical information. Levels of analytics usage are: Data in Order, Key Targets, Differentiated Action, Predictive Action, Institutional Action, Real-Time Optimization. Analysts need to be Ph.D. with personality! Take the DELTA model and view it across the five stages... which is coming out in Tom's next book "Analytics at Work" in 2010. "If you have a great analytic, don't tell anyone about it because the market will adjust and remove that competitive advantage.." We need to evolve from the 'craft' to 'industrial' style of analytics.

Q&A... How do you train 'normal people' in analytical thinking and management? How do you teach being a good consumer of analytical information? Is 'analytical entrepreneur' an oxymoron?

My Take... Good message. Implications are deep. However, practical results depend on a transformation of thinking among managers and all others who are touched by analytics. And, that is tough!

]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_25.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_25.php 20091018 TD Partners Tue, 20 Oct 2009 08:10:12 -0700
Teradata Partners: SAS In-Database, Targeted Marketing, Cloud Computing tdp logo.pngI hate concurrent sessions! It seems like all the sessions that I really wanted to attend are all scheduled for this time slot. So, this blog is composed of pieces from several...as I skip around rooms.

Dirk Anderson, Architect for the Bank of America, talked on In-Database SAS processing for their anti-money-laundering team. First, various limitations of doing traditional analytics of moving data from DW to SAS, processing in SAS, and moving data back to the DW.

Neil McGowan, CIO for J D Williams, and Chris Brierley, DW Manager, both of J D Williams talked on multi-channel targeted marketing. They experimented with Speed-Trap to capture key/mouse movements when browsing product pages.

Todd Papaioannou, Purveyor of Damn Cool Technologies (no kidding!) at Teradata, talked on how Teradata is using cloud computing. Todd described an elastic mart that uses the Teradata data warehouse. It is self-service by users to create their own private data marts within a managed environment. Todd then showed a 5-minute video of launching a Teradata system in the Amazon Elastic Cloud Environment. The video can be download at the Teradata Developer Exchange.

What are the business benefits? Dynamically provisioning of testing environment under multiple operating systems, porting application, backup of data, expanded market, faster POCs to reduce sales cycle, periodic DW for nightly batch load with report generation, cheaper testing systems, and so on. Impressive list!

What are the drawbacks? Performance cannot be guaranteed, security of trusting your data with someone else, service levels are tough to get, nervous about stability, security, and so on. Todd asserted that all corporations will build a private cloud eventually. Cloud computing is here to stay with some blend of private and public clouds. Virtualization is the mega trend of the next decade. Data is moving into the cloud.  ]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_23.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_23.php 20091018 TD Partners Mon, 19 Oct 2009 21:03:45 -0700
Teradata Partners: Rob Tuttle on Teradata Relationship Manager tdp logo.pngRob Tuttle briefed the analysts on Teradata Relationship Manager (TRM), which is Teradata's CRM application. Rob gave examples of event-based marketing for making relevant and timely messages to customers, along with enterprise offer management for generating the appropriate offers to customers based on specific conditions.

td-tuttle.pngAn insight is that the boundary between marketing and sales becomes blurred with advanced CRM. With multi-stage marketing campaigns, later stages should link/merge into sales and even order-entry systems.

Customers are becoming in control of communications with your company. Rob argued that there are silos between the EDW and web analytics data. A big limitation is the proper tagging of pages so that customer interactions are logged. Teradata Integrated Web Intelligence merges online/offline data into Teradata Relationship Manager. Rob mentioned that we should see the demo of Speed-Trap in the exhibits. It records keystrokes and mouse movements while visiting your company's website.

Todd then described Teradata "River" which starts the conversation among Teradata customers with a collaborative online communities that are highly visual with extensive audio/video. It was organized by John McKean of the Center for Information-Based Competition.
]]>
http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_22.php http://www.b-eye-network.com/blogs/hackathorn/archives/2009/10/teradata_partne_22.php 20091018 TD Partners Mon, 19 Oct 2009 12:21:07 -0700