Forum

Information and discussion related to the Kognitio on Hadoop product
Contributor
Offline
User avatar
Posts: 384
Joined: Thu May 23, 2013 4:48 pm

How do I setup a multi-node cluster?

by markc » Mon Dec 05, 2016 9:54 am

I've got a kodoop cluster running with one container.

How do I set up a multi-node cluster - do I need to run the create_cluster command with system_id on each HDFS data node in the cluster?
Reply with quote Top
Contributor
Offline
User avatar
Posts: 384
Joined: Thu May 23, 2013 4:48 pm

Re: How do I setup a multi-node cluster?

by markc » Mon Dec 05, 2016 9:56 am

You don't need to issue the create_cluster command more than once for a cluster. This operation is not starting a kognitio server on the local node. Instead it creates a yarn application which can use as many containers as you like and then creates a gateway process on the local node to provide connectivity. Your Kognitio server will actually be running somewhere inside your Hadoop cluster as a Yarn application.

To set up a multi-node cluster simply use more containers. The getting started guide (available at http://www.kognitio.com/forums/Getting% ... Hadoop.pdf) tells you how to configure a cluster to use multiple containers but briefly you can do...

CONTAINER_COUNT=10 kodoop create_cluster mycluster

... to get a 10 container cluster. Yarn will then create 10 containers in your Hadoop cluster based on your yarn scheduling policy, etc resulting in a multi-node system.
Reply with quote Top

Who is online

Users browsing this forum: No registered users and 1 guest

cron