We use cookies and other similar technologies (Cookies) to enhance your experience and to provide you with relevant content and ads. By using our website, you are agreeing to the use of Cookies. You can change your settings at any time. Cookie Policy.

Blog: Krish Krishnan Subscribe to this blog's RSS feed!

Krish Krishnan

"If we knew what it was we were doing, it would not be called research, would it?" - Albert Einstein.

Hello, and welcome to my blog.

I would like to use this blog to have constructive communication and exchanges of ideas in the business intelligence community on topics from data warehousing to SOA to governance, and all the topics in the umbrella of these subjects.

To maximize this blog's value, it must be an interactive venue. This means your input is vital to the blog's success. All that I ask from this audience is to treat everybody in this blog community and the blog itself with respect.

So let's start blogging and share our ideas, opinions, perspectives and keep the creative juices flowing!

About the author >

Krish Krishnan is a worldwide-recognized expert in the strategy, architecture, and implementation of high-performance data warehousing solutions and big data. He is a visionary data warehouse thought leader and is ranked as one of the top data warehouse consultants in the world. As an independent analyst, Krish regularly speaks at leading industry conferences and user groups. He has written prolifically in trade publications and eBooks, contributing over 150 articles, viewpoints, and case studies on big data, business intelligence, data warehousing, data warehouse appliances, and high-performance architectures. He co-authored Building the Unstructured Data Warehouse with Bill Inmon in 2011, and Morgan Kaufmann will publish his first independent writing project, Data Warehousing in the Age of Big Data, in August 2013.

With over 21 years of professional experience, Krish has solved complex solution architecture problems for global Fortune 1000 clients, and has designed and tuned some of the world’s largest data warehouses and business intelligence platforms. He is currently promoting the next generation of data warehousing, focusing on big data, semantic technologies, crowdsourcing, analytics, and platform engineering.

Krish is the president of Sixth Sense Advisors Inc., a Chicago-based company providing independent analyst, management consulting, strategy and innovation advisory and technology consulting services in big data, data warehousing, and business intelligence. He serves as a technology advisor to several companies, and is actively sought after by investors to assess startup companies in data management and associated emerging technology areas. He publishes with the BeyeNETWORK.com where he leads the Data Warehouse Appliances and Architecture Expert Channel.

Editor's Note: More articles and resources are available in Krish's BeyeNETWORK Expert Channel. Be sure to visit today!

December 2010 Archives

There has been a lot of debate recently on - "do we need a database to build a DW?". In my personal opinion, we will continue to need a database to build a DW, whether columnar or traditional or hybrid. The rationale for this build from the fact that we need to persist, prepare and deliver data to Analytical and BI applications, and this data when stored in a database provides multiple benefits than linking and associating multiple files.

The question is "do we need SQL" to use a database or can we live in a world of NoSQL. The answer in this case, is probably minimal to no SQL will be the future EDW world. The reason for this being technologies like Hadoop and MapReduce, which are reducing workload complexity from Applications. These applications are being increasingly built and delivered on the cloud and mobile platforms, which require a very light front-end footprint and heavy back-end processing power.

Another driving trend is the increasing adoption to semantic technologies. The semantic technologies propel another trend "in-memory analytics", whereby SQL overheads are minimized on query performance. Backend systems will be SQL intensive and will use a database

A third trend is to integrate "unstructured" or"semi-structured" data and query that result set, which is largely semantic driven.

In conclusion, we will use the DW  as a backend, number crunching platform, and slowly move away from "SQL" dependency on the front end, for building out Analytical and BI application.

Virtualization and Cloud will definitely be drivers, but I do not see EDW's or even large DW's being run on pureplay Cloud platforms. 

Posted December 25, 2010 3:21 PM
Permalink | 1 Comment |