Big data demands ‘will require multiple technologies’

A growing need among organizations for agility, scalability and speed in their data processing will lead to them seeking out multiple technologies to meet their big data requirements.

Research by International Data Corporation (IDC) revealed that although Hadoop and its related solutions will continue to be the dominant big data analytics technology in 2014, a range of other tools will gain traction as new use cases and emerging solutions become more commonplace.

The company stated that document and table-oriented NoSQL database management systems (DBMS) will begin to gain traction beyond the early adopter phase, with many companies looking to develop these solutions along a parallel track with existing tools – with Hadoop on one hand and relational DBMS on the other.

It added that an increasing unmet need for agile cloud application development, application scalability, broader data collection, extreme transaction processing, and streaming data management are creating a need for this multiple-technology environment.

Businesses will therefore need to carefully consider all big data analytics solutions that are available to them, in order to develop a clear strategy for deployment before committing to a data management technology.

Carl Olofson, research vice-president for database management and data integration software research at IDC, said: "Anyone investigating big data technology for the enterprise must first identify the type of data to be managed and the problems to be addressed."

He added: "Big data technologies offer great benefits to businesses by enabling them to tap the value inherent in various kinds of data that could never be leveraged before in an affordable way." 

IDC's study comes shortly after it was revealed by jobs website Dice that personnel with skills across all aspects of big data will be in high demand in the coming years. The most sought-after individuals are currently those with NoSQL DBMS experts, with openings for individuals with these skills increasing by 54 percent over the last 12 months.

With demand for Hadoop skills also up by 43 percent, this illustrates how organizations are increasingly looking to deploy multiple big data technologies into their operations in order to cope with the new data-driven era.