Scattered silos ‘biggest challenge’ to big data success

Information that is spread all around an organisation in silos that make it hard to easily get a complete picture has been identified as the biggest barrier to successful big data analytics programmes.

This is according to a new survey by Capgemini, which found 79 per cent of companies have not yet fully integrated data sources across the organisation. This means decision-makers do not have a unified view of data when analysing information and determining the future direction of the firm, ZDNet reports.

Other issues related to this include ineffective coordination of data analytics initiatives throughout an enterprise. Capgemini's report said: "A significant number of organisations operate with scattered pockets of analytics resources or with decentralised teams that function without any central planning and oversight."

As a result of this, "best practices from successful implementations are not shared across the organisation, initiatives are not prioritised, and resources are not deployed in the most effective ways", the report continued.

Other issues highlighted by the report that need to be tackled include a lack of strong data management and governance mechanisms, as well as continued dependence on legacy systems for the storage and processing of data.

Some 36 per cent of respondents to the survey said their company uses cloud computing platforms to handle their big data analytics platforms. But while this may seem like a small proportion, ZDNet observed it is actually a "remarkable uptake" considering many analytics vendors have only just begun to embrace the cloud.

The survey also noted there is still a great deal of work to be done if big data analytics are to take their place at the heart of business decision-making. Only 13 per cent of executives polled said they have achieved full-scale production for their activities, with predictive analytics extensively integrated into their business operations.

This is despite the fact that six out of ten professionals believe that big data will disrupt their industry within the next three years.