In my last blog post, I introduced Kognitio’s ability to flatten complex JSON objects for loading into a table. Today we’ll look at another example using real-world Ordnance Survey data. We’ll also look at what you can do if the JSON files you need to load are in HDFS. We’ll use these techniques to solve…
Here we go again! Suddenly the industry seems to have turned on Hadoop. Headlines saying “it’s hit the wall” and “it’s failed” have recently appeared and some are suggesting that organisations look at alternative solutions. Granted, Hadoop has its limitations and has not lived up to the massive hype that surrounded it a year or…
Introduction Kognitio has two mechanisms for external programs to provide or operate on data during an SQL query: external tables and external scripts. These can be written in the user’s preferred language, for example R, Python, shell or even C. External tables are used like normal tables in SQL queries but the rows are supplied…
Introduction Hadoop was seen as a silver bullet for many companies, but recently there has been an increase in critical headlines like: Hadoop Has Failed Us, Tech Experts Say You’re doing Hadoop and Spark wrong, and they will probably fail Has Hadoop Failed? That’s the Wrong Question The problem Dig behind the headlines, and a…
Kognitio have a lot of experience commissioning clusters of new hardware for our MPP software product. As part of that process, we’ve developed a number of steps for validating the performance of new clusters, and these are the topic of this blog entry. There are many Linux based benchmarking tools on the market however…