So I’m standing in the computer books section of a bookstore (sorry Amazon, there are still a few real bookstores left around), and I hear these two gents blowing-and-going about how Hadoop is a flash-in-the-pan, a passing fancy, going the way of the Do-Do bird.
Wrong, according to some just released stats I read from my friends over at IDC.
They say the market for software related to the Hadoop and MapReduce programming frameworks -- used, as we recall, for uber- large-scale data analysis -- will jump from $77 million in 2011 to $812.8 million in 2016, a staggering compound annual growth rate of 60.2%.
As you recall, Hadoop is an open-source implementation of the MapReduce framework, hosted at the Apache Software Foundation. Hadoop splits-up large amounts of data and then processes the hunks of data in parallel across large numbers of nodes. Think: Big Data, Done Fast.
It seems like everyone and his dog is using Hadoop for something these days (or considering it), despite what our two bookstore prognosticators posit.
IDC goes on to say conditions are right for significant growth in the Hadoop "ecosystem," and that, "Leading adopters in the mainstream IT world will move from 'proof of concept' to real value."
One cloud on the matter (pun intended) is that IDC’s report says a lack of qualified talent will limit the technology's rise during the next two to three years. With growth like $77MM to $812MM -- I don’t think the “Help Wanted” sign will be hanging too long.
If you haven’t looked at Hadoop, you probably should – before it swamps the industry.
See you next time.