Blog: James Taylor« August 2008 | Main | October 2008 » September 30, 2008New Community for Fair Isaac customers and othersCopyright © 2008 James Taylor. Visit the original article at New Community for Fair Isaac customers and others.The folks at Fair Isaac pointed me to a new community they have just released - dmtools.fairisaac.com. I have not had much of a chance to check it out but it looks useful and I look forward to participating. One thing is new - you can download trial versions of Blaze Advisor. Have fun… Repositories, processes, decisions and moreCopyright © 2008 James Taylor. Visit the original article at Repositories, processes, decisions and more.Bruce Silver had an interesting article recently on The Next Innovation in BPMS in which he discusses the need for repository capabilities in BPM. Bruce makes the point that “next generation” repositories for process management must not only support process models, they must also support “decision models”, business object definitions, performance measurement information and service metadata for deployed services. Today most of these things are in separate repositories and, frankly, I am not sure this is going to change. For one thing the challenge of a single repository handling everything is great and past experience with “the big repository in the sky” is that it cannot be made to work. Specialization is just too valuable for some of the pieces/people involved. As such one ends up with a federated repository with multiple specific repositories each able to query and link to others. For this to work I think there are a couple of key features:
September 25, 2008Franchises, localization and decision managementCopyright © 2008 James Taylor. Visit the original article at Franchises, localization and decision management.I live in Palo Alto and a new Mountain Mike’s Pizza has just opened up near us. Much as we like MM pizza we have two problems - we like wholewheat dough and, as several members of my family are lactose/milk intolerant, soy cheese. If you have visited or live in Palo Alto you will be thinking to yourself “typical Palo Alto residents” - this is very much a soy-cheese-and-wholewheat-dough-pizza kind of place. However we cannot get either at our local MM because the parent company does not offer it It is common for folks to criticize global brands and franchising organizations for having this one size fits all approach. Of course the most successful proponent of franchising ever, McDonalds, does tailor its menu to suit local tastes. But what, I hear you ask, does this have to do with decision management? Well my experience with MM is like most customers experience with the companies with whom they do business - one size fits all. Whatever the company things is good is what customers can have. The preferences or desires of each customer, or even of a customer segment, are of little or no importance. Learning not from MM but from McDonalds would push in the opposite direction - companies would think about how they could tailor their products, pricing, offers or marketing to suit. And suit individuals or micro-segments not just regions. Decision management - especially the management of these micro decisions - is key. If I regard the decision “what products should I offer this customer” as a customer-by-customer decision (a micro decision) then I need to manage it much more precisely and at a much more fine-grained level than if I treat it as a “once and done” decision to be applied to everyone. Mountain Mike’s is living in the mass production industrialization of the past. McDonalds is living in the localized industrialization of the present. Decision management is what it will take for most companies to move to the post-industrial mass customization of the future. September 24, 2008Finding hidden decisions in business processesCopyright © 2008 James Taylor. Visit the original article at Finding hidden decisions in business processes.Scott Sehlhorst (with whom I have presented and about whom I have written before) had a great post this week called Hidden Business Rule Example. Scott walks through some analysis of a process and shows how finding hidden decisions within that process can really inform how you think about the systems and processes you need. This is similar to a service that we offer and that Neil and I call the Decision Discovery Process. I liked Scott’s example a lot as the decision to do something 100% (or 0%) of the time is a classic hidden decision - people don’t see it as they always/never do something. I agree with Scott that analysis of the customers who abandon the process would be a great way to find out where to priortize your effort and I would add that if there are multiple ways to make the decision and it is not clear which one will work best then it might be worth using adaptive control to test multiple approaches and track which one is most successful in generating revenue. A great post from Scott and well worth the read. September 23, 2008Collections Best PracticesCopyright © 2008 James Taylor. Visit the original article at Collections Best Practices.Jeff Bernstein of Strategem Portfolio Services gave an overview of the latest developments in collections. Jeff’s company has a product called Strategy Director (about which I blogged before). Jeff does a lot of work with collections groups and all too often sees a failure to implement analytics even where those analytic models are being developed for collections. There is thus a need for both a technology platform for analytics but also an educational one so that models will be used once they are done. Collections has been reshaped by a combination of increased expectations and a globally competitive market in the last decade. Collections has been evolving in multiple dimensions:
Progressive organizations are taking a number of steps:
The end result is true Lifecycle Risk Management in Collections. Using micro-segmentation of early stage accounts and event triggers for rapid response; rules-based processing that use all the available channels; and well designed skills-based performance metrics. Risk-driven, skills-based routing to the right channel, the right approach, dynamically adjusted. From Scores to StrategiesCopyright © 2008 James Taylor. Visit the original article at From Scores to Strategies.The use of analytics in business decisions, presented by one of InfoCentricity’s customers, was next. In many organizations modelers are busy building predictive models that they then throw over the wall to a business analyst. To bridge this gap you need a collaboration platform that allows modelers to do their thing while allowing business analysts to do theirs. Xeno supports this kind of collaboration. In general this collaboration makes a difference in a number of areas:
The customer came next and presented on the specifics of how to review policies analytically to streamline the loan review process in originations. Policies come from bad loan review (what went wrong review that generates rules for next time), history and domain expertise. Modelers, meanwhile, can use standard application data, credit variables and policy variables. They also needed to infer the performance of rejected and unused accounts (reject inference) so that this could be used in the model. They mimiced the application flow as a tree and then got modelers and business people to work very interactively to see what existing policies did, try different scenarios and test other variables to see what might be worth including in policies. This helped them find:
In general this approach led to many small changes that had a sizable impact while also increasing the confidence in the automated decision making. Origination takes more than scores, it takes policy rules too. Reviewing these rules analytically makes for better efficiency and more validated changes. September 22, 2008Putting Analytics to WorkCopyright © 2008 James Taylor. Visit the original article at Putting Analytics to Work.Here’s my presentation from the InfoCentricity User Exchange. Enjoy. Scorecard Development Efficiencies with XenoCopyright © 2008 James Taylor. Visit the original article at Scorecard Development Efficiencies with Xeno.Sue Gonella presented on some efficiencies in building predictive scorecards. In particular she covered the use of sampling data vs using all records into a model development exercise. Rather than using all records she advocated using stratified random sampling where a sample of each group of interest is used to build and validate the models. This works better because turn-around times are better and experimentation easier. She demonstrated that predictive power is comparable if you use 10,000 records or so per performance group so there is no loss of accuracy if this is done right. She walked through an example of this showing that for the same model performance she could save more than 99% of the time involved. This enabled a lot more experimentation as most changes to the model made little or no difference to the time taken when 10,000 sample records are being manipulated (whereas the same changes would have caused the full dataset to run even slower). Similarly demoting predictors that make zero contribution so that they don’t affect subsequent iterations makes for even better performance with little or no impact on predictive power. Clearly taking these steps - stratified random sampling and the elimination of zero-contribution predictors - make for MUCH faster iteration in model development and thus better models. She also pointed out that, even if you are required to use all records in the final model, you can do a lot of the development work with the sample data to improve performance and so allow many more iterations. Marketing and Customer Segmentation with XenoCopyright © 2008 James Taylor. Visit the original article at Marketing and Customer Segmentation with Xeno.Delivering the best value proposition using segmentation is a multi-step journey with 6 main steps and some critical differences from other analytic approaches:
Flora also walked through some case studies. First was a services company offering residential services across multiple brands. Lots of data but challenged to cross-sell and up-sell. Using clustering to find customer segments and developing personas to give color to these segments helps clarify the motivators and potential home service purchases for each. Segments were based on income, home ownership and length of time in residence. Segments included “snug as a bug” families and “old timer” retired couples. A second case study was focused on collections and had segments like “struggling”, “don’t bother me” and “credit users” depending on internal balance, internal risk and external risk. Impact Modeling and Maximizing Marketing ReturnCopyright © 2008 James Taylor. Visit the original article at Impact Modeling and Maximizing Marketing Return.Nina Shikaloff discussed an analytics technique that I had not heard of - Impact Modeling. Impact Modeling is a decision modeling technique. Decisions on acquiring customers - what to offer for instance - managing customers and handling difficult customers are all important and it can be tricky to identify better ones. Impact modeling is about explicitly measuring the incremental financial impact of a strategy - how much more will I make if I do ‘B’ rather than ‘A’ - and then mapping segments of customers to the optimal decision. However you can’t test any particular customer with both strategies to compare results so instead you use adaptive control (A/B testing) to try A on 90% (say) and B on the other 10% while tracking the results. The Impact Modeling algorithm then searches through the results to see which segments respond better to which strategies. Essentially it uses the results to find segments where one particular strategy works better and keeps driving down into the details of these segments to find more and more fine-grained ones where one approach or the other works better. The outcome is a decision tree or a simple ruleset that picks one of the strategies for each segment - very deployable. It is also easy to simulate the impact of the approach allowing you to maximize the financial impact. Impact Modeling can be used when tracking multiple financial objectives and can be constrained by competing objectives (risk v revenue, for instance). It can also be extended to more than 2 choices and can be used on relatively small samples. Nina illustrated the power of Impact Modeling with a couple of case studies. The first was a credit card issuer trying to find the right APR increase that would boost revenue without increasing risk or attrition. They found that half the accounts should get an APR increase (some small, some larger) while the other half should not to maximize results. Each strategy was applied to multiple segments and one of the interesting effects of Impact Modeling is this understanding of the segments. The second was another credit card issuer with a very diverse target group and learning which sub-segments responded to the two offers was very informative. Not only did Impact Modeling get better results, the user learned a lot too. Given the outcome is a decision tree it may seem like Impact Modeling is the same as normal decision tree modeling. Impact Modeling is essentially an analytic technique for finding the right rules because it analytically finds the right tree nodes, considers the impact of prior decisions and allows multiple objectives to be considered. Personally I really like these kinds of analytic techniques as they are so clean to deploy, allowing them to be put into production rapidly. This is something that I will touch one when I speak this afternoon. Live from the InfoCentricity User ExchangeCopyright © 2008 James Taylor. Visit the original article at Live from the InfoCentricity User Exchange.Today and tomorrow I am attending the 4th annual InfoCentricity User Exchange. I got an overview of their Xeno product some time ago (blogged here) and I am looking forward to learning more about what their customers do with the product. All the attendees have our book too so that should be fun. First up is Chris Frothinger, CEO with some opening remarks about the importance of the user exchange to InfoCentricity. He began by saying that InfoCentricity is doing well again this year, despite the tough economic conditions. Chris had a great phrase for the times - “data-driven not deal-driven”. Companies making data-driven decisions will do better in these difficult times and those are the kind of companies who are InfoCentricity customers. Customers attending come from auto finance, retail, marketing, cards and more. September 18, 2008Segmentation and product designCopyright © 2008 James Taylor. Visit the original article at Segmentation and product design.Scott had a great article on segmentation and personas this week that is a nice, quick read. I think the use of analytics in persona design can make a big difference (as I have noted before) and that decision management can use good customer segmentation as a first step towards extreme personalization. If you are not already segmenting and analyzing your customers, you should be. September 16, 2008Making decisions about loyalty programsCopyright © 2008 James Taylor. Visit the original article at Making decisions about loyalty programs.1:1 had a nice piece on the growing role of loyalty programs in retail. This noted the “Growing sophistication in loyalty programs” among retailers and, in particular, the use of loyalty program data not just to calculate lifetime customer value but also to build competitive advantage. This second aspect is the one I always find compelling. If you can use data about the behavior of your customers to see how loyal, profitable, expensive, new, longstanding or other kinds of customers behave then you can build better models and make way better decisions. As a longstanding promoter of intense personalization and consistency across channels I was particularly pleased to see that more than half the responders were using customer loyalty data for “elements that suit specific customer affinity and preference” (53 percent) and “personalized promotions across channels” (52 percent). Besides recommending strong customer ownership, the study suggested two particular areas where retailers should focus. The first is on customer reactivation, the second on multichannel loyalty campaigns. Mapping these to decision management and we get the following advice:
and so on. Two previous posts seem particularly relevant. This one on using decision management to build loyalty and grow and this one on using EDM to keep loyalty where you want it - with the company not an individual employee. More on standards - Rule Interchange FormatCopyright © 2008 James Taylor. Visit the original article at More on standards - Rule Interchange Format.Continuing on the theme of standards, several working drafts specifications have been recently published by Rule Interchange Format (RIF) working group of the W3C for public comment:
The other working drafts that were published for public comment are:
Comments are requested by September 19 in order to consider them for the next set of revisions. Chief Decision Officer?Copyright © 2008 James Taylor. Visit the original article at Chief Decision Officer?.Mitch Betts’ blog brought an interesting article to my attention this week - an interview Accenture chief scientist Kishore Swaminathan in which he argues that CIOs need to move up the value chain and become Chief Intelligence Officers. I kinda like this but I would not equate being a Chief Intelligence Officer with data but with decisions. A CIO should be working to ensure that all the systems in the organization improve decision making. Some will do this by providing the right information and analysis to people to make decisions, some by making better decisions themselves. To get value from its data and organization must make better decisions with it and that should be the role of the CIO. More support for PMMLCopyright © 2008 James Taylor. Visit the original article at More support for PMML.Nice to see support for PMML (Predictive Model Markup Language) continuing to expand with the recent announcement of support from Pentaho. Support for standards like this is important in decision management as a number of products will typically need to be used in combination to build decision management solutions. Wither Analytics: An Homage to Hy MinskyCopyright © 2008 Neil Raden. Visit the original article at Wither Analytics: An Homage to Hy Minsky.When it comes to analytics, Wall Street is clearly the leader. The best of the best head there after school to six-figure starting salaries and some even see seven-figures based on their performance. They are the rara avises, the crème-de-la-crème and whenever we speak about “Competing on Analytics,” it goes without saying that Wall Street analytics represent the exemplar of what is possible for an analytic culture. So why is Wall Street melting down? Clearly, analytics aren’t everything. Our financial system is pretty complicated and subject to abuse and fraud. The current crisis is aligned with the greed of the mortgage brokers and the mortgage bankers, and once in a while the financial press will point the finger at the hedge funds and investment brokers that shoved mortgage-backed securities down the throats of other investors. Hmmm. Wasn’t anyone watching this? After all, interest rates started to creep up a few years ago, the economy started to turn down, default rates started to appear at around the same time. Is it possible that the quant’s were so buried under leveraged layers of derivatives and other exotic instruments that they didn’t see the coming storm? This seems like a pretty big movement to miss. After all, if you’re sitting on top of a few billion in debt that is on the razor’s edge of liquidity, wouldn’t you spend some time looking at it more closely, especially with such broad macroeconomic factors staring you in the face? Maybe the problem was just that – too much attention to the monetary and business-related factors and not enough attention to the movement of markets on a broader scale. In the early 70’s, I had the unique opportunity to take economics classes from the legendary (but until recently, obscure) Hy Minsky. Minsky is known for the “financial instability hypothesis,” which proposes economic expansions become unsustainable booms ending in crisis and economic unraveling. Speculation. Greed. Disaster. I first heard the phrase “Chaos Theory” from Minsky thirty-five years ago. Minsky has suddenly become very popular (unfortunately he passed away in 1996). One of his memorable quotes in class (there were many) was: “All panics, manias and crises of a financial nature, have their roots in an abuse of credit.” He used the Dutch Tulip mania of the 1600’s as an example. He believed that financial systems experience rounds of speculation that, if they are severe, end in crises. Minsky was considered a radical for his stress on their tendency toward excess and upheaval. September 15, 2008First Look - Erudine Behaviour EngineCopyright © 2008 James Taylor. Visit the original article at First Look - Erudine Behaviour Engine.Erudine is a British company a few years old and has released some new technology in a new process context - the Erudine Behaviour Engine (yes, the British spelling). Like many technologies, Erudine is targeting the business-IT divide, focusing on problems like those of translating requirements into systems, integrating the expertise of lots of people (analysts, designers, developers) and communication. Besides the problems these things cause in building a first version, constant change tends to cause functionality to drop behind requirements steadily over time. This is exacerbated by problems of knowledge retention - through the lifetime of a commercial system knowledge is lost (by retirement or resignation but also by the passage of time) and so must be revamped for each new release at an additional cost. At the heart of this problem is the basic fact that there is lots of knowledge that must be extracted and turned into the new system - legacy code, expertise, policies, regulations etc. Their perspective also is that while writing code is quick, checking it and confirming it is complete and correct is much harder and slower especially when one has to consider the implications and consequences of a chance. Erudine focus on tacit knowledge (rather than explicit knowledge) and develop the behavior model of an application by looking at real cases and asking those specifying the system to say what the system should do in that case and then justify it. This is test-driven design on steroids - developing business behavior starting from the answer we want and moving to why that is the answer one functional point at a time. This is a very different approach to the more explicit knowledge approach taken in business rules management systems. Some critical facts about Erudine:
A demonstration of a customs border example showed how some of this worked. The system is designed to help a customs officer decide what action to take in response to a particular person trying to cross a border. In many ways this whole example is a decision service. First design step would be to layout the data flow- specifying how to get data from data sources, take data cleansing, enrichment and integration activities etc. This decision flow, if you will, also handles sequencing of steps and the specification of behavior steps or decisions. The decision node in the example is designed to choose one of four actions - arrest, deny, accept, detain. Before the “rules” can be specified, an ontology must exist. This can be loaded from OWL if you already have it defined and can be completed during development - you could start with a basic one and then refine it as you worked through cases, for instance. Data can be mapped directly from databases (although more complex entities must be mapped in using Java Hibernate classes). So far this seems like development work but we have not got to the clever bit yet. Once you reach this point, the decision node can be specified by non-technical users. Business experts can take a list of situations (prior instances from a legacy application, test cases, formal examples or whatever) and then view each one using the conceptual graph. For each instance the user specifies the decision they would take - what their conclusion would be for this instance - and then explain why. This is done in a point-and-click way using the conceptual graph. For instance they might take a record representing a person in this example and say they are allowed in because they have a visa. This creates what they call cornerstone or unit test. Both the structure of the data and values can be used in these rules. This is a powerful approach because it is often much easier for an expert to explain an example and their reasoning than to specify a general rule or requirement. The expert then goes on to repeat this for subsequent instances. Each subsequent rule must be compliant with all previous cornerstones (unless you wish to change your mind about the rule) - the first case cannot be changed to a different result by the second set of behavior for instance. The editor won’t allow a subsequent condition to contradict a prior one. The ontology comes into play by allowing the user to generalize a reason. For instance, a person might be arrested rather than allowed in. This person might be carrying Cocaine but the expert knows that Cocaine is an illegal cargo (in the ontology) and so specifies that carrying an illegal cargo gets you arrested. Similarly they might specify that it does not matter that this particular case was a truck and that it could be any vehicle. As you watch the tool work it seems pretty clear that common cases would be found quickly - the 80/20 rule would play in your favor - and that you would rapidly get all the basic conditions handled. Using Eurdine to clone and replace a legacy system allows you to compare current definitions to logs or results tables. This shows historical entries with differences between Erudine and the current system allowing specification of clarification rules to eliminate them. The resulting “rules” can be very complex - but specified “by example” remember, so this complexity would not necessarily be visible. Examples of rules might be: If there is a School with a Child over the Age of 8 If there is a network Node under attack The combination of the ontology and the graphical environment for specifying rules by example allows for complex objects to be manipulated using complex rules. The tool had another nice feature allowing you to may these cornerstones or rules to a requirements document defined in the tool. As you create cases you can refine the requirements and link it and you can see requirements without tests and vice versa. This combined with the other features has results in some customers using Erudine purely as a behavior or requirements capture tool or to learn the behavior of an existing system with which they are less familiar than they desire. Erudine behavioral ’services’ are stored in a Knowledge Model (KNM) file that contains all the behavior, ontology and requirements links. Access to resources is through logical links with actual links defined in a config file for deployment. Generally these resources will change through the various staging environments of a project whilst the logical connections do not. This allows the same KNM file to be staged through environments without change. Versioning is usually handled through a standard versioning repository, providing fairly coarse-grained version control (though finer grained control is under development). Debugging is very visual- the path through the data flow model can be examined interactively for a problematic transaction. At each node the behavior rules that fire can be interrogated and even the requirements that the behavior satisfies queried. I found the product very intriguing and I hope to work with it some more. Check it out at www.erudine.com |