Forum

General discussion on using the Kognitio Analytical Platform.
Contributor
Offline
User avatar
Posts: 22
Joined: Tue Dec 10, 2013 6:59 am

Partition type or ID hex ’60’

by vishwasjione » Thu Jan 02, 2014 7:08 am

What is Partition type or ID hex ’60’? and why it is required for installation of Kognitio ?
Is it physical partition or logical partition ? Kognitio requires physical or logical partition ?
Once a type 60 partition is used for kognitio, can that partition be used for any other sortware for read and write or that is completely dedicated for Kognitio?

Thanks
Vishwas
Reply with quote Top
Contributor
Offline
User avatar
Posts: 386
Joined: Thu May 23, 2013 4:48 pm

Re: Partition type or ID hex ’60’

by markc » Thu Jan 02, 2014 8:47 am

Kognitio by default will use type 0x60 partitions as disk resources. So if setting up a set of nodes for Kognitio, you can create a number of type 0x60 partitions (possibly doing this on each node individually, or by setting up one node and cloning it), and Kognitio will pick those up as its disk resources by default.

If you don't do this, you need to use the wxadmin command line tool to specify the files/partitions that you want to use as disk resources.

Whatever disk resources (partitions or files) are assigned to Kognitio, they are dedicated for the Kognitio software, so should not be manipulated by any other programs.

Further information on this topic can be found in chapter 2 of the Configuration and Maintenance Manual. This, along with the other documentation, is linked to from this topic: http://www.kognitio.com/forums/viewtopic.php?f=2&t=103

Regards,
Mark.
Reply with quote Top
Contributor
Offline
User avatar
Posts: 22
Joined: Tue Dec 10, 2013 6:59 am

Re: Partition type or ID hex ’60’

by vishwasjione » Thu Jan 02, 2014 9:00 am

Thanks Mark,

We are installing latest_810_sfx, I believe it is 8.10 version.
I read somewhere that if a machine is having Kognitio then it should not have any hadoop node, is that true?

Thanks
Vishwas
Reply with quote Top
Contributor
Offline
User avatar
Posts: 386
Joined: Thu May 23, 2013 4:48 pm

Re: Partition type or ID hex ’60’

by markc » Thu Jan 02, 2014 9:09 am

Vishwas,

You are correct, that SFX file is for the 8.1.0 version.

It is certainly simpler to start off by running Kognitio software on one set of nodes, and Hadoop on other nodes - Kognitio's in-memory database defaults to using all the RAM and cores available on the platform it is using to give best performance, so additional configuration steps are required to allow it to co-exist on nodes which are running Hadoop or any other software which can impose a significant load on the nodes.

So I would recommend you start off using distinct sets of nodes for Kognitio and Hadoop. If in future you want to run them on the same nodes, we can give you some suggestions on how to do that, but at least you will already have some experience with the Kognitio software at that stage.

Regards,
Mark.
Reply with quote Top
Contributor
Offline
User avatar
Posts: 22
Joined: Tue Dec 10, 2013 6:59 am

Re: Partition type or ID hex ’60’

by vishwasjione » Thu Jan 02, 2014 9:28 am

Thanks Mark,

Partitioning doesn't look practical as of now in my case as it will lead to formatting and disturbing existing softwares on that machine, we want to go with file as disk resource.

could you please provide some steps to do that like

a) creation of a file kognitio.txt in a partition which has good amount of free storage.
b) using wxadmin tool and then providing Kognitio.txt as the file to be used as disk resource.
..
..
..

uh?

Thanks
Vishwas
Reply with quote Top
Contributor
Offline
User avatar
Posts: 386
Joined: Thu May 23, 2013 4:48 pm

Re: Partition type or ID hex ’60’

by markc » Thu Jan 02, 2014 10:20 am

Vishwas,

For using a file as disk resource, you should

1) create a directory to hold the file on a file system that has sufficient capacity. So if you want a 200GB disk resource, make sure the volume for this directory has over 200GB free. For this example, the directory will be /vol1/kognitio, so you would do "mkdir /vol1/kognitio"

2) for simplicity make access to this directory open. So in our example, do "chmod 777 /vol1/kognitio"

3) run the SFX installer to install the Kognitio software.

4) Use the wxadmin tool to perform stage 2 of the install, including creating disk resources via option 4 from the first wxadmin menu. Then choose option 4 from the disks menu to create new disk resources.

5) Hit <return> to add disk resources to all nodes

6) Enter the name of a (not already created) file in the directory from step (1). For our example, lets use /vol1/kognitio/storage.dat (note I am not using a .txt extension as that is misleading - this file will contain data in a binary format which cannot be simple parsed by normal Linux command line tools).

7) Hit <return> to default to using a file

8) Enter the size of the file you want to use - in this case "size=200G". The steps from (4)-(8) are shown below:

This menu allows you to add disk resources to the system or examine those
present. If you are using WX2 disk partitions, these should have
been detected, use 'summary' to check and see 'help' for more details.

Choose 'done' when you have created all the disk resources you need.

You can return to this menu by choosing 'disks' from the main menu.

Options:
1: help -- More information about disk resources.
2: summary -- Display a summary of the disks in the system.
3: list -- Display a list of the disk resources configured.
4: create -- Create one or more disk resources.
5: change -- Change settings for one or more disk resources.
6: raid -- Change software RAID cluster size.
7: remove -- Remove one or more disk resources.

Done: Finished in this menu.
Top: go to top level.
Exit: exit this program.

Choice (default Done): 4


-----------------------------------------
Which nodes do you want add disk resources to
(ctrl-c goes back, default: can DS, ? for help)?


-----------------------------------------
Enter the filename for the disk resource to create
(ctrl-c goes back, type ? for help)? /vol1/kognitio/storage.dat


-----------------------------------------
Enter the disk type for the disk resource to create
(ctrl-c goes back, default: file, ? for help)?
Enter any other options you would like to specify (e.g. size)
(ctrl-c goes back, type ? for help)? size=200G
Operation complete for 1 disk resources.
Complete. Hit enter to continue.
:



9) Now hit <return> until you get back to the main menu, and choose option 7 (server) followed by option 10 (newsys), and answer the questions on system password and system id to allow commissioning to begin.

This will result in the disk resource you specified being zeroed, which will take some time - you can monitor this from a separate session on the node by looking in the `wxlogd smd`/output* file (note the backquotes used there), which shows progress of the zeroing in percentage terms like this:

25-11_19:06:54_GMT: Stdout: FORMAT OF /dev/cciss/c0d0p3: 1 complete.
25-11_19:06:55_GMT: Stdout: FORMAT OF /dev/cciss/c0d0p3: 2 complete.
25-11_19:06:57_GMT: Stdout: FORMAT OF /dev/cciss/c0d0p3: 3 complete.
25-11_19:06:58_GMT: Stdout: FORMAT OF /dev/cciss/c0d0p3: 4 complete.


Once it gets to 100, it will then start up the server software processes, and run the SQL commands to complete commissioning.

Regards,
Mark.
Reply with quote Top
Contributor
Offline
User avatar
Posts: 22
Joined: Tue Dec 10, 2013 6:59 am

Re: Partition type or ID hex ’60’

by vishwasjione » Thu Jan 02, 2014 10:48 am

Thank You Mark, that was very helpful.

Mark where can I find the system id if If I had forgotten,for a single node machine?
Reply with quote Top
Contributor
Offline
User avatar
Posts: 386
Joined: Thu May 23, 2013 4:48 pm

Re: Partition type or ID hex ’60’

by markc » Thu Jan 02, 2014 11:05 am

At commissioning time you specify the system_id as a string of up to 11 characters with the -S argument when running the sfx installer file. If this is for a free-to-use system with a 128GB RAM limit, then you can choose any name of up to 11 characters there. If it is for a system which requires a licence to be generated, the licence is tied into the system_id, so you'd need to make sure they were consistent.

So in your case, make up a system_id of up to 11 characters (e.g. mysysid), and specify it when running the sfx file with "-S mysysid"

Regards,
Mark.
Reply with quote Top
Contributor
Offline
User avatar
Posts: 22
Joined: Tue Dec 10, 2013 6:59 am

Re: Partition type or ID hex ’60’

by vishwasjione » Thu Jan 02, 2014 11:08 am

Is this fine ? Please see below


---------------------------------------------------
Please enter a system ID for this system.
The system ID must be at most 12 characters long.
All WX2 nodes in the same system must have the same system ID.

You can specify this with the -S <id> command line argument.

:
System ID too short, must be at least 2 characters!
Please try again.
:
System ID too short, must be at least 2 characters!
Please try again.
: kognitio


---------------------------------------------------

Our system id is Kognitio right ?

Thanks
Vishwas
Reply with quote Top
Contributor
Offline
User avatar
Posts: 386
Joined: Thu May 23, 2013 4:48 pm

Re: Partition type or ID hex ’60’

by markc » Thu Jan 02, 2014 11:15 am

Yes, if you type 'kognitio' at the prompt for the system id, then that will be your system id. You can check this once the software is installed by looking in /opt/kognitio/wx2/etc/config which will have a line showing the system id.

Please note that you must never edit this config file by hand, always use the "wxviconf" tool if you need to make changes.

Regards,
Mark.
Reply with quote Top

Who is online

Users browsing this forum: No registered users and 1 guest

cron