The Evolving Modern Data Warehouse
Originally published February 18, 2014
As I covered in my previous article, modern enterprise data systems are tasked with responding to evolving business landscape – where customer interactions are extending beyond traditional data collection and sharing mechanisms. With data arriving at a greater speed and in different formats, the role of a data warehouse as a single unified place for enterprise data has to change as well.
The Modern Data WarehouseSo what’s the role of the modern data warehouse and how does it continue to deliver business value? The relational database model is excellent for data that monitors transactions and focuses on data consistency. With corresponding data quality and master reference consolidation capabilities, data warehouses will continue to meet the needs of business domains requiring high data fidelity – as well as facilitating record management regulatory compliance requirements for various industries and disciplines. In fact, data lineage and quality requirements are not going away any time soon. On the contrary, these requirements will be amplified as transactional data volumes continue to grow.
Most of the massively parallel processing data warehouse appliances of today support capabilities that enable bi-directional data movement between their compute nodes and HDFS data nodes. This allows for movement of data that’s persisted in data lakes into the data warehouse for business domain scenarios requiring elevated data consistency as described earlier. Similarly, high-fidelity master reference data sets can be moved into Hadoop metastores to support agile large-scale analysis scenarios. Understanding the roles of different data collection is essential to delivering connected enterprise insights.
In conclusion, data warehouses are here to stay, but their use and role is evolving to meet changing business realities. They are part of an overarching enterprise strategy to help companies deal with large-scale data challenges by combining various data storage and sharing capabilities to deliver agile, fast and accurate insights across the business.
Recent articles by Timur Mehmedbasic
Copyright 2004 — 2020. Powell Media, LLC. All rights reserved.
BeyeNETWORK™ is a trademark of Powell Media, LLC