New BI Demands Pushing Data Architecture Limits
Originally published August 8, 2012
We all know change is constant, but when we are responding to demands to extract value from new forms of the most important asset in modern competitive business – information – and are busily managing the increased volumes, change is both constant and fast-paced. Don't get left behind: With "big data" increasingly taking hold, the five-year future is going to bring major transformation in the way information systems are built to support business intelligence (BI) and analytics applications.
Developing a More Expansive View of BIEventually, monthly, weekly and even day-after reporting then becomes insufficient, and the valuable information being integrated and analyzed becomes a requirement on an intra-day basis. An organization can then go full circle to doing whatever it can operationally.
With post-operational warehousing systems being bound by the extract, transform and load cycles that need to be performed there, real-time BI brings data analysis directly into operational systems. Business intelligence previously was viewed as “whatever we do to data in the data warehouse,” but now BI is being expanded into the discipline of data usage and exploitation, wherever that data may reside.
For more and more companies, another aspect of BI maturity involves coping with new data types, which usually means harnessing the “big three” forms of unstructured or semi-structured big data: sensor, social media and Web activity data. It can also mean an organization availing itself of the syndicated data marketplace and bringing external information into its BI systems.
Before making big investments, assess your existing information management architecture to determine if it will meet the new BI demands of the enterprise. Suggested questions to ask as part of that assessment include the following:
BI Challenges – And Ways Around ThemMaintaining sufficient performance levels is one of the top challenges in BI today, especially as data volumes grow. Alternative technologies for managing structured data – such as columnar databases, in-memory databases and data warehouse appliances (or a combination of them) – can provide additional performance on specific workloads beyond what conventional relational databases are capable of delivering.
Data integration also remains a major challenge. For many organizations, the answer may be the “perpetual short-term” solution of data virtualization, which can bring together data from separate, technically distinct data stores without requiring the information to be consolidated in a data warehouse.
Interest in the cloud is high as a place to store the data behind BI systems and manage the integration and data access components. Security fears and integration with on-premises data remain big concerns for many prospective users. Nonetheless, cloud and virtual deployments undoubtedly will house upwards of one-third of corporate databases within the next five years.
Centralizing management of master data is potentially valuable to BI initiatives as well because it replaces individual efforts and creates a governed process for master data management (MDM) along with the infrastructure required to support distribution of the master data to different systems. But there are architectural considerations to address when evaluating an MDM program. For example, does each system need to build its own master data? Is one system’s master data worthy of being used more broadly? Are the owners of master data ready for the responsibilities of providing it beyond their individual systems?
While few companies have a budget for “innovation,” the good news is that advanced business intelligence is not really about innovation. It’s about business, and when done well it provides a high return on investment even in the short periods that are demanded of IT investments these days. But there’s the rub – it must be done well.
By asking the following questions before investing in information management technologies to support BI activities, organizations should be well prepared to management their information assets effectively:
Editor's Note: To read the other articles featured with this article in our e-zine, BI Trends + Strategies, click here.
Recent articles by William McKnight
Copyright 2004 — 2019. Powell Media, LLC. All rights reserved.
BeyeNETWORK™ is a trademark of Powell Media, LLC