For years our data management universe has been centered around the enterprise data warehouse (EDW). The EDW has served us well and created a foundation for todays sophisticated analytics. A paradigm shift driven by a maturing user community, new technology, economics and valuable data types is moving us towards a hybrid data ecosystem that strives to match the workload and the data with the best possible platform. Many of us have spent years defending EDW best practices and work process that have taxed our infrastructures to the breaking point. Its time for us to embrace a wider view of our data landscape and strategically integrate these new solutions.
- Maturing User Community – over the past decade the demands of simple reporting have morphed into highly complex analytics. The consumer of business intelligence has changed dramatically from a few highly technical users within a company to democratized culture where more and more employees are gaining access to information and driving the business with it.
- New Technology – Technology advancements are driving the adoption of Hybrid Data Ecosystems. Analytic platforms were the earliest to exist alongside the EDW providing a better platform for analytic analysis. Cloud platforms and Big Data frameworks are the latest to match new workloads and data on the best possible platforms.
- Economics – the overall cost of analytics plays a critical role in the adoption of a Hybrid Data Ecosystem. The lower capital costs associated with Big Data, cloud and analytic platforms have contributed to the enterprise adopting them.
- Valuable Data Types – Until recently the enterprise has primarily focused on structured information best leveraged by SQL and stored in relational databases. The task of analyzing high volume, high velocity multi-structured information has often been too complex or expensive for most companies to address. New technologies have made it possible for us to incorporate new and highly valuable data (social, machine, sensor data) into our analytic processes providing greater real-time insights and predictive outcomes.
Now is the time to examine your data strategy and to investigate how integrating these new technologies can transform your traditional enterprise data warehouse centric landscape into a flexible Hybrid Data Ecosystem that leverages the best platform to match your workload, data and business goals.
I’ll be covering this topic in detail during my keynote at TDWI World Conference in Chicago. May 7th, 2012.