Kognitio on Apache Hadoop, ultra-fast, high concurrency SQL engine
The Kognitio Analytical Platform is the world’s fastest in-memory data analysis engine and when deployedRead More
For all big data’s promise, the problem has always been this: how do you turn those huge volumes of data into something valuable that humans can use?
Visual analytics tools, such as Tableau, aim to do just that. They make it easy for business analysts to interact with data to get the knowledge that they need. Here’s the problem, though: a smooth and human-friendly visual interface generates masses of complex database queries. So what to do?
Visual analytics tools work well because they hide the activity that lies beneath. As data sets grow in size, and intricacy, some of the magic begins to wear thin. It gets to the point where traditional databases, and most Hadoop query tools, can’t cope with the volume and complexity of SQL queries generated by front-ends such as Tableau. That makes for frustrating waits as the data query engine desperately tries to keep pace or, too often, gives up altogether.
What Tableau users need – even if they’re never aware of it – are predictable SQL response times, even with many concurrent users and huge complex data sets. Kognitio provides just that.
Kognitio’s ultra-fast in-memory SQL query engine sits between Tableau and your data sources. Unlike traditional databases, or most Hadoop query tools, it is specifically designed to deliver answers as fast as possible. And that’s not just when conditions are ideal: Kognitio delivers predictable query response times even when there are hundreds of concurrent Tableau users analyzing billions of data points.
Unlike traditional databases, Kognitio has been designed from the ground-up for massively parallel query processing. Its unique query engine optimizes on the fly and runs everything directly in memory. Working as a cluster of up to thousands of nodes, Kognitio can scale up or down as needs demand. One CPU or thousands. A few gigabytes of RAM or hundreds of terabytes.
Even in the world of big data, SQL is still the de facto data access language. Kognitio provides comprehensive ANSI SQL capabilities along with a sophisticated, mature, optimizer that is designed to cope with complex ad-hoc varying queries. This is underpinned by the scale-out in-memory platform that harnesses all available CPU cores – whether tens, hundreds or thousands – for massively parallel execution of queries (queries utilizing all cores) and/or massively concurrent execution of queries (one query per core utilizing as many cores as required for active sessions).
Kognitio is fully scalable from tens of Gigabytes of RAM and a few cores through to hundreds of Terabytes of RAM and thousands of cores. Pulling data into memory breaks the link with slow disk and allows low-latency high-frequency queries to be handled with no wait.
In-memory processing is about letting the CPUs do unconstrained work, never waiting to find or access data. Kognitio employs ultra-efficient machine code processing that wastes no CPU cycles, supporting queries on billions of rows of data in a few seconds or less – perfect for end-user applications like Tableau that support direct drag-and-drop, self-serve, fluid interactions with data as users build analytical stories.
Data experts need modern tools to engage with, manage, and combine the many varied data sets that are proliferating in businesses today. Modern data platforms such as Apache® Hadoop® provide low cost near-infinite capacity stores but are not designed for low-latency high-frequency direct end-user access – Tableau connecting direct to Hadoop is not a great user experience!
Kognitio connectors into Hadoop dramatically simplify the access to data, allowing in-memory data models to be quickly and intuitively constructed. Tableau workbooks and dashboards can
then be interactively built on full volume data with no slow down, each viz being satisfied by the raw power of Kognitio. Once built, the high-concurrency features
of Kognitio will then meet the demands of the end-user community as they engage and take value hour-by-hour day-by-day.
Tableau (from 9.3.1 onward) has an optimized, supported connector specifically for Kognitio, making Kognitio officially part of the Tableau ecosystem.
Join organizations across the globe who’ve taken control of their big data and turned it into actionable insight, by introducing Kognitio to your Tableau infrastructure. See how to connect Tableau to Kognitio.