Blog

SQL ON HADOOP BENCHMARKING

12

Oct
2016
Posted By : admin 1 Comment
kognitio benchmark tests

At the recent Strata conference in New York we received a lot of interest in the informal benchmarking we have been carrying out that compares Kognitio on Hadoop to some other SQL on Hadoop technologies. We have decided to formalise the benchmarking process by producing a paper detailing our testing and results. In the meantime, we will be releasing intermediate results in this blog. Preliminary results show Kognitio comes out top on SQL support and single query performance is significantly faster than Impala. Read on for more details.

It is clear from recent conversations that many organisations have issues using the tools in the standard Hadoop distributions to support enterprise level SQL on data in Hadoop. This is caused by

Read more

Read More

Pushing past pilot stage ‘key challenge’ for big data projects

11

Oct
2016
Posted By : admin Comments are off
111016 - Image credit: iStockphoto/ipopba

Many companies that are embarking on big data analytics projects will find themselves struggling to move beyond the pilot stage and roll out their initiatives on a wider scale, a new survey has found.

Research by Gartner identified this as one of the key challenges facing businesses when they undertake big data projects. It revealed that although nearly three-quarters of organisations are planning to invest in this technology or have already done so, just 15 per cent say they have deployed their big data projects at full production scale.

This is almost unchanged from when the same question was asked last year, when 14 per cent of firms stated they had achieved this.

Nick Heudecker, research director at Gartner, suggested … Read more

Read More

Logistics sector sees high demand for big data

30

Sep
2016
Posted By : admin Comments are off
300916 - Image credit: iStockphoto/Maxiphoto

Demand for big data analytics solutions in the logistics and supply chain sector is growing rapidly, with almost all firms now recognising the need for these solutions.

This is according to a new study conducted by Capgemini Consulting, Penn State University and Penske Logistics, which revealed 98 per cent of third-party logistics companies (98 per cent) agreed that data-driven decision-making will be essential to the future success of supply chain processes. This view was shared by 93 per cent of shippers.

Both of these groups also stated that being able to use big data analytics effectively will become a core competency for their supply chain organisations in the coming years. Some 81 per cent of shipping firms and 86 per … Read more

Read More

IoT projects moving beyond pilot stage, study finds

28

Sep
2016
Posted By : admin Comments are off
280916 - Image credit: iStockphoto/kentoh

More businesses are moving beyond small-scale pilot schemes when it comes to the Internet of Things (IoT), towards full-scale deployments that incorporate big data analytics, cloud computing and security capabilities.

This is according to new research from International Data Corporation (IDC), which revealed that almost a third of firms (31.4 per cent) have already launched solutions that take advantage of this technology, while a further 43 per cent expect to deploy these tools in the next 12 months.

More than half of respondents (55 per cent) also agreed that the technology will be an essential strategic solution that helps their business to compete more effectively. Key benefits of IoT solutions include better productivity, lower costs and the automation of internal … Read more

Read More

Customers ‘unaware’ of how firms use their data

28

Sep
2016
Posted By : admin Comments are off
280916 - Image credit: iStockphoto/BernardaSv

The vast majority of customers have no idea how businesses are using the personal data they possess, while many also do not trust companies to be responsible in their use of this information.

This is according to new research from the Chartered Institute of Marketing (CIM), which revealed nine of of ten customers are in the dark about how their personal data is used. Meanwhile, 57 per cent did not trust companies to take good care of their data, while 51 per cent complained they had been contacted by organisations that misuse their data.

For many businesses, gathering more detailed and personal information on their customers is a vital part of their big data analytics strategy, as it allows them … Read more

Read More

FCA approves use of big data for insurers

23

Sep
2016
Posted By : admin Comments are off
230916 - Image credit: iStockphoto/tonefotografia

The UK's Financial Conduct Authority (FCA) has signalled its approval of the use of big data in the insurance industry, after it revealed it was dropping plans to launch a full inquiry into the use of the technology in the industry.

The regulator announced a review into the sector last year, stating it was aiming to better understand how the use of big data analytics in areas such as calculating premiums impacted consumers, before deciding on the next steps.

It has now stated that in light of the "broadly positive consumer outcomes" that big data can deliver to the sector, it will not be proceeding with a full market study at the present time, which effectively gives the green light … Read more

Read More

New programming language ‘boosts big data speeds fourfold’

22

Sep
2016
Posted By : admin Comments are off
230916 - Image credit: iStockphoto/cifotart

A new programming language developed by researchers at the Massachusetts Institute of Technology (MIT) is claiming to be able to increase the speed of big data processing by up to four times.

Called Milk, the language allows application developers to manage memory more efficiently in programs that deal with scattered data points in large data sets. In tests conducted using several common algorithms, programs written in the new language were shown to be four times as fast as those written in existing languages, but the researchers behind the language believe that further work will result in even larger gains.

Milk is intended to solve one of the biggest barriers to successful implementation of big data analytics processes – how efficiently … Read more

Read More

Hadoop and NoSQL drive big data boom

20

Sep
2016
Posted By : admin Comments are off
200916 - Image credit: iStockphoto/bakhtiar_zein

Investments in technologies such as Hadoop and NoSQL will underpin much of the growth in the big data analytics market in the coming years, with non-relational solutions set to increase at around twice the rate of the sector as a whole.

This is according to a new report from Forrester Research, which found that over the next five years, big data will grow at a rate of around 13 per cent a year. However, NoSQL is set for a compound annual growth rate of 25 per cent over the period between 2016 and 2021, while the projected figure for Hadoop is 32.9 per cent.

It also noted that this year, some 30 per cent of organisations have implemented Hadoop, up … Read more

Read More

How big data helps keep trains running on time

15

Sep
2016
Posted By : admin Comments are off
150916 - Image credit: iStockphoto/ipopba

Siemens – the largest engineering company in Europe – is trying to improve punctuality on Germany’s rail network by utilising big data analysis and predictive maintenance.

The most recent data from the European Commission reveals that just over three-quarters (78.3 per cent) of the country’s long distance trains arrived on time. The report, published in 2014, found that just two other countries racked up worse averages, with Portugal and Lithuania coming in behind.

But it is hoped that the introduction of big data analytics will change this, the Financial Times reports. A group of Siemens employees have fitted hundreds of sensors to the trains, which relay data back to the engineers about the condition of the locomotive’s parts.

By combining … Read more

Read More

Shop Direct highlights big data’s impact as profits rise

13

Sep
2016
Posted By : admin Comments are off
13/09/16 - Image credit: iStockphoto/emyerson

Online retailer Shop Direct has highlighted its investments in big data and machine learning as among the reasons for its recent success, as it unveiled revenue of £1.86 billion for the first full year since the implementation of these technologies.

Computing magazine reports that the company, which runs brands including Littlewoods.com and Very.co.uk, reported profits of £150.4 million for the period, an increase of 43 per cent year-on-year.

Chief executive of the group Alex Baldock said this success has been down to a greater focus on new technology, and this is something that the firm will continue with in the coming years.

“This was the year our investments in technology really started to pay off," he said. "We've made big … Read more

Read More

Facebook

Twitter

LinkedId