The Strata Data Conference was held at the ExCeL in London this week. Sessions that were of interest to me included: What Kaggle has learned from almost a million data scientists (Anthony Goldbloom, Kaggle) This was part of the keynote on the first day. Kaggle is a platform for data science competitions, and have had…
They also live across the river and there’s no bridge…so we’ll just make our own! Amazon’s S3 is a popular and convenient storage solution which many, especially those with big data, tend to utilise, and the challenge can be connecting to this large store that has been building up over days/weeks/months/years. There are many ways…
In my last blog post, I introduced Kognitio’s ability to flatten complex JSON objects for loading into a table. Today we’ll look at another example using real-world Ordnance Survey data. We’ll also look at what you can do if the JSON files you need to load are in HDFS. We’ll use these techniques to solve…
Here we go again! Suddenly the industry seems to have turned on Hadoop. Headlines saying “it’s hit the wall” and “it’s failed” have recently appeared and some are suggesting that organisations look at alternative solutions. Granted, Hadoop has its limitations and has not lived up to the massive hype that surrounded it a year or…