Forum

Information and discussion related to the Kognitio on Hadoop product
Contributor
Offline
User avatar
Posts: 14
Joined: Wed Feb 11, 2015 3:57 pm

Kognitio support for Spark

by jagan.kumar » Mon Oct 08, 2018 10:42 am

Hi

Are there any Kognitio connector for Spark?
Basically, the requirement is to use Spark MLib on data residing in Kognitio.

Thanks,
Jagan
Reply with quote Top
Contributor
Offline
User avatar
Posts: 386
Joined: Thu May 23, 2013 4:48 pm

Re: Kognitio support for Spark

by markc » Mon Oct 08, 2018 1:23 pm

There isn't a Spark connector as such.

If you are running on Hadoop, normally you would have the data stored in HDFS, and then allow Spark to process it from there. Kognitio can access the data in HDFS as well, of course, and with 8.2.2 it is now easier to write data back to Hadoop as well after using Kognitio to transform it (see https://kognitio.com/blog/whats-new-in-kognitio-8-2-2 for more details).
Reply with quote Top

Who is online

Users browsing this forum: No registered users and 1 guest

cron