Business Intelligence Network business intelligence resources

Blog: James Taylor

Main | May 2008 »

April 23, 2008

Here's how to use EDM to support Earth Day

Well today was Earth Day - you knew that, I hope. I knew because last week I was at John Muir’s house with a wonderful group of 4th/5th graders doing a simulation of his period. So, in the spirit of Earth Day, how are Enterprise Decision Management and Smart (enough) Systems “green”?

  • If your marketing systems were smarter, they would only send mail to people who might care (saving trees)
  • If you building’s systems were smarter, they would minimize the power they used to heat or cool the building, reducing emissions
  • If your supply chain was smarter, you would waste fewer parts to obsolescence and mis-classification
  • If your production systems were smarter, you would optimize your use of materials, power and so reduce waste
  • If your vehicle scheduling and routing was smarter you would have shorter routes, fewer vehicles and lower fuel usage
  • If you scheduled your factory “more smarter” you would use less power, less resources to make the goods you sell

You get the picture. If you use Enterprise Decision Management to automate and improve decisions and so built smarter systems, you would have a cleaner conscience come Earth Day.

Last note, if you visit John Muir’s house, say hi to Ranger Tad for me - he was great and the kids really learned a lot from him.

ShareThis

Related Posts

  Posted by ben at 3:21 AM | | Comments (0)


April 22, 2008

Analytics and the Oakland A's (not that kind of analytics)

The Oakland Athletics Score with Mobile Coupons headlined an article about this new approach to delivering coupons. Reading this it seemed to me that this was an opportunity for the Oakland A’s, well known for their use of analytics in player selection, to bring analytics to bear on the marketing operations.

Mobile coupons are constrained in space and time and so must be particularly well targeted. Analytics, both descriptive analytic/data mining and predictive analytics, are well established in the marketing field for targeting, segmentation and offer acceptance prediction. Combining these analytics with rules about specific individuals, what their opt-in status is, what their past buying behavior is and so on enables effective targeting decisions to be made. Perhaps more importantly it allows these decisions to be automated. Instead of the decision to send a particular offer to a group of customers, why not make a decision for each customer as to what offer to send them? Target them directly, personalize the offer, maximize the chance that it is relevant. Why offer a discount on a single game ticket to a season ticket holder, for instance, or a discount to a restaurant that’s the other side of the ballpark from their seats? Personalization of mobile coupons seems to me to be more important than the personalization of more traditional coupons. Let’s hope the A’s are as smart about this kind of analytics as they are about the other kind.

ShareThis

Related Posts

  Posted by ben at 9:48 PM | | Comments (0)


New Expert Channel on B-Eye Network

Well there’s now another place to find our materials - I have opened for business as an expert on the B-Eye Network. Check out my channel Competing on Decisions (thanks to Neil for suggesting the name). This blog will be syndicated there but I will also be writing articles, posting white papers and generally making content available. You can check out my first article, Competing on (Customer) Decisions today. There are two feeds you might like to add to your feed reader:

ShareThis

Related Posts

  Posted by ben at 8:30 PM | | Comments (0)


Some thoughts on Adaptive Decision Management

Paul Haley wrote an interesting piece last week on Adaptive Decision Management. This is a really good piece and I highly recommend it. I do have a couple of things to add, however.

While Paul is correct that Fair Isaac did not talk about “decision management” until after the HNC merger, Fair Isaac had a long history prior to that in doing decision management - combining predictive analytic models and scores with business rules into what they called “strategies”. Post the HNC merger we simply formalized a name to describe what both companies had been doing. Fair Isaac/HNC Products like Falcon, TRIAD and Capstone are not what you might call traditional applications but neither are they tools. They are decision services (wiki) with software for case management, data integration and other related tasks wrapped around them. They plug into backbone applications (core banking systems, Loan Origination Systems) and provide those applications with the critical decisions they need.

But, enough history. Like Paul I think that dashboards, while useful, are not enough (see this post, for instance) and I agree that that neither rules nor predictive analytics alone are enough for true decision management. That’s why decision management also has something we call adaptive control and optimization (wiki). Indeed the book has a whole chapter on it and Paul goes on to discuss it a little - it is often called Champion/Challenger testing or A/B testing. Today, this is largely a manual feedback loop.

Automatically learning analytics are clearly the next step and were one of the future technologies we discussed briefly in the book. There are some challenges - decisions where the consequences take a long time to play out can be challenging and you don’t want models to adapt to changes you caused, for instance. Say you ran a SuperBowl ad and this generated a vast increase in page hits. Well you would hardly want your analytics to start adapting to it as though this were just a random increase. That said, for many problems you can not only automate the adaptive part you can even automate the champion/challenger testing and work to produce algorithms that generate challengers that will teach you something useful is well underway.
Like Paul I think this is an area where there is still much to do but there is plenty of raw technology out there with which to do it.

One last comment, though. If you have not externalized and managed your decisions you will not be able to have them adapt effectively. As one of the founders of Fair Isaac famously said “if you want to improve a decision you have to grab it by the throat and not let go”.

ShareThis

Related Posts

  Posted by ben at 6:09 PM | | Comments (0)


April 21, 2008

First Look - InRule Technology

A couple of weeks ago I got an update from the folks at InRule. InRule was founded in 2002 in Chicago and has 100+ customers. Their focus, like most business rules vendors, is on dynamic decisioning and process agility. They estimate that nearly half their prospective customers are also doing BPM not just rules. InRule is exclusively focused on .NET . While its customers initially cane from financial services and Insurance, their customers now span most industries. They are, as you would expect, an active Microsoft partner and a member of the Microsoft Business Process Alliance (one of several rules vendors).

InRule has three products - the flagship one, InRule for BizTalk Server and InRule for Workflow Foundation. In each case they provide authoring, catalog (repository), SDK, and execution server components. Neither of the rules engines Microsoft has embedded in Biztalk and Workflow Foundation are designed for business users to maintain rules. Adding this capability and extending the base Microsoft platform are where InRule adds value.

Their value proposition is a pretty standard business rules one, focused on quick time to value and the right tools for different users. Microsoft tends to be very focused on developers but InRule adds a focus on business users/analysts and process owners. They have made their product easily embeddable and have garnered lots of ISV interest. They also have some multi-platform customers who have bought another vendor’s Java offering but have chosen InRule over the established vendor’s .Net product.

InRule is focused on decision points in business processes and on delivering dynamic decisioning at this point. For instance, in a Basel II process a company initially had scorecards in Excel, this was replaced by a web application but the business users liked the control they had with Excel and IT’s web application was too hard to change - they rapidly got a backlog - so they adopted rules. Other companies are moving to SOA and have multiple systems with redundant logic and use a decision service to get the shared logic.

The flagship product has a catalog similar to SourceSafe/TeamServer, authoring and verification, an SDK and potential customer authoring. Rules can be stored in the catalog and pushed to the run time engine. Decision tables, constrained rule editing, value lists and easy to build custom applications are supported. The catalog has versioning, check-in/check-out, permissions, promotion, labeling etc

InRule for BizTalk Server is built on the flagship product (includes all its capabilities) and includes a BizTalk adaptor and has static classes added to Biztalk to call the InRule engine. Biztalk’s rule engine has rete-based inferencing and a repository but lacks IF THEN ELSE logic, which makes authoring and maintaining complex logic very difficult, as nested IF statements must be used. The BizTalk rule engine has a very weak user interface for rule editing (Rules Composer).

InRule for WindowsWorkflow Foundation uses the WF rule engine, adding authoring and management capabilities; the product uses their own editing controls and runs as win components. The rule engine in the Workflow Foundation is ruleset-based, compiled into code and handles sequential and some forward chaining. InRule provides verification tools and irDeveloper - a very thin version of their SDK as the Workflow Foundation rue engine only runs against object graphs- no database or XSD support. The catalog is the same as the main InRule product. InRule extends the Workflow Foundation rule engine to handle notifications, complex functions etc - typically those at the Excel/VBA intersection. There is no support for patterns or the XML/SQL stuff from the main engine. It should be noted that all InRule products can be called from WF workflows (or any BPM tool).

ShareThis

Related Posts

  Posted by ben at 8:32 PM | | Comments (0)


A chance to win a camera by talking about rule base development!

Valentin Zacharias is conducting an online survey on the development of rule bases and would really appreciate your opinion! The survey is very short and should only require a few minutes to complete. Any additional feedback or comments are also very welcome. If you answer all questions and enter your email address at the end of the survey, you have a chance to win a Canon SD1100 that will be given to one of the participants.

To participate please go to: surveymonkey.com/s.aspx?sm=sZ1_2fndMD1QnCLgWQfR_2bsBw_3d_3d

The goal of the survey is to give an overview of the kind of methods and tools actually used for the development of rule-based systems (with a focus on verification and validation). It also tries to identify some of the challenges facing rule-base development.

The results of the survey will be publicly available. Drop him a note or enter your email address at the end of the survey to have them sent to you. The results will also be accessible on the website vzach.de/blog/ and I will likely blog about them too.

<Apologies for cross-posting to all 3 blogs>

  Posted by jtaylor at 5:46 PM | | Comments (0)


April 18, 2008

First Look - i-luminate

Neil and I caught up with Joe Foley, Chief Architect and Kirsten Chapman, VP Global Marketing and Alliances from i-lluminate this week. illuminate (www.i-lluminate.com) is a Spanish company that has recently begun to expand in the US.

illuminate is trying to tackle what it sees as the unsolved performance problem of ad-hoc analysis in companies who have made investments in data warehousing and business intelligence. Despite the dramatic price/performance improvements, the illuminate folks think that the limitations of SQL and fixed data structures can cause complex queries to become large IT projects or even complete nightmares. In particular the fact that traditional data analytic infrastructure develops layers of de-normalized data, star schemas and massive parallelism to meet performance needs means that flexibility is lost.

illuminate’s approach is to store everything as values and to store each value only once. This means that all relationships are kept, not just those designed in, and that the database schema is built on the fly as actual data is loaded. While this takes longer that loading a traditional RDBMS, it is comparable to the time it takes to load and index a database while making the generation of extended metadata and incremental addition of new data sources very easy. One consequence of this is that after about 20-50Gb of data loaded the illuminate value pool tends to stabilize at around 6Gb. Adding more data does not increase the size of the value pool. While disk space is cheap, this approach makes it much easier to keep all the critical information in memory.

illuminate likes to talk about the time to understand - the time from the definition of a problem to the understanding of an answer. This time is improved, they say, both by matching the load and index time of a traditional database and by improving dramatically the time to get results, especially results from ad-hoc analysis. The value-based approach also allows any kind of query to be developed and supports navigation by value (regardless of logical tables). Because Illuminate stores values (”London”,” Manager”, etc.) instead of values in records, it is able to provide some interesting discovery capabilities through associative queries. For example, find everything that is associated with the date December 7, 1952. Relationships that weren’t understood before can be mined. A relational database would need to scan every table to get this information. Another associative query could start with a product and find everything that is related to it.

The iLuminate product range includes iCorrelate, a tool for ad-hoc querying that takes advantage of their approach, as well as iAnalyze, a simple dashboard tool (OEM’d from QlikTech). Support for ODBC/JDBC means that analytics tools from SAS to SPSS and Cognos to Business Objects can also use the database.

They made their point with a couple of nice case studies and then talked about their North American FREE product introduction Proof of Concept program. This is designed to prove that their database can do what nothing else can and do it fast. Companies interested in this program can define a high-value information need that users can’t get-or that takes too long to get-that uses up to 25GB of raw data from up to 6 data sources. No schemas are required, just data and there is no charge with full evaluation team participation. You can check out the program at i-lluminate.com/pilot_request.asp or the company at i-lluminate.com.

  Posted by jtaylor at 5:46 PM | | Comments (0)


April 17, 2008

Two Great Decision Management Conferences this year

First up is InterACT, Fair Isaac’s show on decision management and analytics, April 27-30. I will be blogging this event live. Even if you aren’t a Fair Isaac client you should check out this show. It’s at the Palace Hotel in lovely San Francisco and is an opportunity to hear Ian Ayres, author of Super Crunchers and attend one of the best analytic symposiums to hear about some leading edge analytic techniques and approaches. There are lots of sessions for Financial Services companies on how to cope with the current banking crisis - sessions on managing highly indebted consumers, risk management, helping the unbanked, the mortgage crisis, better collections strategy and for Insurance companies who can find a whole track on claims, underwriting, customer service and marketing in the new world of insurance.

John Rymer of Forrester, one of my favorite analysts, is speaking on dynamic business applications, a really interesting area and there are a number of sessions on detecting, managing and controlling fraud from internal and external threats. The growing array of regulations - Basel II and others - are covered so you can grow through your response to regulation not collapse under its weight and scoring, of course, will get a thorough working over so you won’t be confused about the benefits and limitations of scoring.

I will be there blogging and I want to meet you so I am offering a discount for readers - just enter the discount code SFJT when you register and get the unlimited registration for just $1,345. This is a great deal! You can register here and get more information on the event here. I highly recommend the show and I hope to see you there.

EDM SummittThe second show is the all-new Enterprise Decision Management (EDM) Summit of which I am a co-chair (with my business partner and co-author, Neil Raden). This show is running October 26-30 alongside the established Business Rules Forum and will be show casing case studies on using decision management for competitive advantage, how to compete with analytic decision-making, how decision services enhance SOA and much more. Registration is not open yet but you can put yourself on the mailing list here. This is the first large-scale conference with a decision management theme and we are assembling a great set of tutorials (SOA, agile, business rules, data mining, decision management and optimization among others) and speakers. Look for me to blog more about this in the coming months but get on that mailing list now.

  Posted by jtaylor at 4:40 PM | | Comments (0)


April 16, 2008

2008 BPM & Workflow Handbook - 30% Discount

Human-centric business process management (BPM) has become the product and service differentiator. The topic now captures substantial mindshare and market share in the human-centric BPM space as leading vendors have strengthened their human-centric business processes. The BPM and Workflow Handbook spotlight this year examines challenges in human-driven workflow and its integration across the enterprise.

Download the Digital Edition to read immediately (no shipping charges) or order the Print Edition and download four chapters to start reading immediately. Either way you qualify for 30% pre-launch discount.

2008 BPM & Workflow Handbook CoverPay only $66.50 with the Pre-Launch 30% discount. Put 2008 in the discount code box on checkout for either the PRINT or DIGITAL Editions.

Contents here: Easy-to-read chapters on Tips and Pitfalls when implementing your first BPM project and Step by Step SOA. Many case studies with important information directly applicable to your own projects.Order the PRINT Edition and get the link to download FOUR important chapters and start reading immediately.

The 2008 BPM and Workflow Handbook, published by Future Strategies Inc., in collaboration with WfMC will be launched April 21st, 2008 at Architecture & Process in Washington DC.

ISBN: 978-0-9777527-6-8, Quality hardcover. 320 pages. List Price: $95.00

Save 30%

Retail $95.00. Pay only $66.50 with the Pre-Launch 30% discount. Put 2008 in the discount code box on checkout for either or both the PRINT or DIGITAL Editions. Discount is good for multiple orders.

Offer Expires: May 15, 2008

ShareThis

Related Posts

  Posted by jtaylor at 6:22 PM | | Comments (0)


April 15, 2008

First Look - InfoCentricity Xeno

I recently got an overview of InfoCentricity and their analytic product, Xeno. InfoCentricity is an analytic solutions company focused on helping customers find the insights buried in their data. They see a gap between BI-like analytic tools and data mining/analytic tools like SAS or S where you need to be a programmer. Their objective is to provide ease of use (so that programming is not required) but to also deliver analytic power for analysts. The company was founded in 2000 and has a strong historical tie with the retail banking industry and to credit scoring. They offer Xeno and analytic services that are mostly in support of Xeno but they also provide analytic services such as developing custom models.

Xeno is their analytic workbench. It’s a nice product with a thin-client metaphor. There is no software install/maintenance as it is completely web-based and it is designed to build better models, faster by supporting rapid iteration. It is data agnostic and designed to support a collaborative, team-based modeling process. It supports the usual predictive modeling techniques, some unique ones like “multiple outcome optimization”, trees, clustering and reporting/analysis. It is aimed at modelers but they do have some non-modelers using it and they are working on extending it to develop an easy to use tool for non modelers e.g. in retail/catalog. As they add this they plan to continue the collaboration focus so that Xeno supports not just collaboration between modelers but also collaboration between models and non-modelers. The tool is not focused on data preparation – most of their customers use SAS for this I suspect – but is aimed squarely at a collaborative modeling environment.

The product has a nice, web based interface. It provides quick analysis of imported data and a wide array of reports. The interface is very much a point-and-click one with lots of automation including automated classing and binning and predictive ranking. The idea of the automation is to get you most of the way while supporting manual fine tuning. The tool stores versions, shows the steps in the process and manages the development and evolution of models nicely. They have a tree builder and a clustering tool and these tools provide guidance to make sure clusters, for instance, are moving in the right direction. While aimed at modelers, the tool was approachable and open without any of the opaque modeling scripting one sometimes sees.

From a company perspective they think their differentiators are analytic brain power, a commitment to knowledge transfer, innovation, collaboration, data flexibility and ease of use. Their focus areas are risk management (credit, collections) and marketing (response, revenue, churn, segmentation).

ShareThis

Related Posts

  Posted by jtaylor at 4:30 PM | | Comments (0)


April 14, 2008

(Not) Live from IMPACT - a blogger wrap

As I could not attend all of IMPACT 2008 and as there were hundreds of sessions, I thought I would post as complete a set of posts as I could (with help from Dan Zrobok), starting with mine:

ShareThis

Related Posts

  Posted by jtaylor at 9:19 PM | | Comments (0)


April 11, 2008

After EDM - the future of business

The second part of my response to Dave Wright’s comment is about the kind of business one can run after one adopts EDM. To do this, let’s predicate the discussion a company that has adopted Enterprise Decision Management as a core management principle, implemented the technology and development approaches that support it and had long enough doing this to have updated and modernized its application portfolio. Let’s also assume that they have adopted business process management approaches and technologies and a service-oriented architecture to underpin it all (BPM/SOA). How might this look from a business perspective? What might be the characteristics of such an outfit?

  • Negative Response Time
    With a combination of detailed performance management and predictive reporting the company has a pretty good idea of what is about to happen and is able to change the way it responds before the situation to which it is responding occurs. Systems are ready to handle shifts in market dynamics, regulation, company direction before the outside world changes. Increasingly the company’s systems automate this responsiveness with continually adaptive rules and analytics.
  • Simulation
    Everything the company does has been simulated and the likely/possible outcome(s) assessed. Before something is changed it is clear to everyone how that change will affect everything and everyone else. Planning processes include links to simulations so that it is known what changes are required at an operational level to meet planned objectives.
  • Best Next Action
    Every interaction with a customer is made based on a selection of the most effective action to develop and extend (and make more profitable) a customer relationship. Customer support, service, sales and marketing all share a decision making environment that helps ensure the company is essential to its (profitable) customers and irreplaceable.
  • Predictive supply chain
    Decisions about supply and decisions about demand are integrated. Products are ordered, store, shipped and manufactured based on the sales and marketing decisions made or about to be made. The supply chain is tied to accurate predictions or customer demand, based on aggregated micro decisions not averages or estimates.
  • Explicit Decisions
    No decision, no matter how high volume, that affects the companies bottom line is taken accidentally or implicitly. The way a decision is made is known, externalized and managed so it can be measured and improved. This applies to big strategic decisions as well as small operational ones.
  • Event-based and process-centric
    The company combines activities based on its usual business cycle and on defined processes with defined responses to business events both internal and external. Whether something is ad-hoc or repeatable, event-based or process-centric, manual or automated is an explicit and carefully considered decision. The right mix of approaches is used.

What else could this kind of company do? The sky’s the limit I guess but I would love your thoughts.

Next week I will blog a summary of the bloggers who attended IBM’s IMPACT show and talk some more about agility.

ShareThis

Related Posts

  Posted by jtaylor at 11:12 PM | | Comments (0)


Read some of the best blog posts on Intelligent Enterprise

Neil’s two blog posts on BI and technology rated highly again - the second one getting more traffic from Intelligent Enterprise readers than any other posts. Check them out:

ShareThis

Related Posts

  Posted by jtaylor at 3:39 AM | | Comments (0)


April 10, 2008

Howard Dresner recommends the book

Howard Dresner, now independent but previously of Gartner and Hyperion and one of the leading voices in the Business Intelligence and Performance Management space listed Some good sources and included our book and our blogs (this one and Neil’s on Intelligent Enterprise). Thanks Howard.

ShareThis

Related Posts

  Posted by jtaylor at 9:07 PM | | Comments (0)


After EDM - some thoughts on technology

Some time ago a regular reader, Dave Wright, left a comment on a blog post I wrote as a guest. In it he asked “What comes after EDM?”. This, of course, is both an interesting and a difficult question. Thinking about it I decided to split it into two parts - one about technologies that I see coming “after” the current set of technologies used in EDM and one about the kind of business one can run after one adopts EDM. The second one I will post tomorrow and I would love comments on either so let your creativity flow.

Today EDM relies on a number of key technologies:

  • Business rules management
    An ability to express the rules of a business, its business logic, in a friendly and declarative syntax - typically, though not always, through a business rules management system.
  • Data mining ad descriptive analytics
    An ability to mine data and develop insights and business rules based on what has happened in the past
  • Predictive analytics
    An ability to use data about the past to make predictions about the future and represent those predictions as equations that can be executed - turning uncertainty into probability
  • Optimization
    An ability to define the tradeoffs in a problem and mathematically find the optimal solution given the business needs that must be met
  • BPM/SOA/EDA
    An architecture that allows decisions to be extracted and managed as reusable, self-contained decision services and then composited into applications to run the business. This might be process-centric (BPM) or event-centric (EDA) but it is almost certainly built on a service-oriented approach and architecture (SOA).
  • Data and information management
    Everything from data warehouses to high performance databases to performance management and reporting tools to manage, ensure the quality of and understand the information you have.

Adaptive control is missing from the list simply because it is a technique rather than a technology. Several changes in this technology list can be expected:

  • More natural language and domain-specific processing
    Already rules languages are understandable to the business and easy to map to specific domains. Some, like Haley, are already close to natural language. Over the next few years this will increase as business users take more control of the logic in their systems and demand that they can do this using their own words and jargon.
    Ade McCormack had a relevant analogy - think of an ethnic restaurant, he said. In the kitchen you can speak the language of the food, in the dining area you must speak the language of the diners. Increasingly the business diners will expect to express logic in their language to the exclusion of the language of the IT cooks and the software will evolve to make this possible
  • More automation in analytics
    Already analytic tools like those from SAS, SPSS, InfoCentricity and Fair Isaac are automating more and more of the grunt work in the development of analytic models. Folks like KXEN have taken this far enough to allow non-statisticians to develop models. Both trends will continue and accelerate so that professional modelers are more productive and so that business users are able to do more of the modeling they need for themselves. This will mean more models being built, even in areas where the marginal value is small because the cost of building a model is so low.
    The use of genetic algorithms and other evolutionary approaches, combined with every increasing processing power, will also mean that more models are built and compared/combined for existing problems and this should mean ongoing continuous improvement in the quality of models.
  • Automated adaptive control
    One of the consequences of the automation of model development is that there will be more models in production and the value of updating these models will be smaller - the model is not making that much difference so time and money cannot be spent refining it. This, plus the general desire to automate more of this process will lead to automation of the adaptive control process. Automated routines will test new models, even ones that are expected to do poorly but that will shed light on the problem, and collect and use the results. Simple versions of this already exist for models where the results are very immediate (offer accepted or not) but the ability to consider longer-term effects and overall customer profitability in these automated systems will soon come.
  • Broader data sources
    Clearly the addition of unstructured and semi-structured text to decision automation is happening already. Products exist to find insights in text and include that with structured data to make better predictions. Clearly this will continue to evolve as new data sources such as voice and video become well enough understood to be analyzed by readily available computing power.
  • Time-sequenced decision analysis will be automated
    Today most decision analytics are focused around a single decision. Yet each decision is connected to prior and subsequent decisions and, in theory, you are trying to optimized the whole set of decisions over a customer’s lifecycle. When you get a customer to sign up for something this creates new opportunities for subsequent decisions, for instance. Doing analytics across such time-sequenced decisions is still extraordinarily difficult but the math involved is likely to get figured out and factored in to decision making in the next few years.

I am sue there are others but these were the ones that came to mind. Let me know what you think.

Tomorrow, how will adopting EDM change businesses.