Forum

Topics related to Kognitio on Cloud, including Kognitio's AWS Marketplace product
Contributor
Offline
User avatar
Posts: 386
Joined: Thu May 23, 2013 4:48 pm

What are the default connectors and external scripts available with Kognitio on Cloud?

by markc » Tue Apr 02, 2019 9:03 am

At the time of writing, the Kognitio AWS Marketplace product (https://aws.amazon.com/marketplace/pp/B07P8MQRLG) has a number of connectors and external script environments created by default.

Connectors

To allow you to easily access data stored in Amazon S3:
  • S3_PARQUET for Parquet files
  • S3_ORC for ORC files
  • S3 for other file types (CSV, Binary, AVRO, JSON)
The group GRP_S3 control read access to these connectors, and GRP_S3_WRITE controls write access (note this does not include read access) to allow writing external tables.

There is also an AWS Glue connector loaded by default and called GLUE. You can access tables through it using the 'table' target string attribute.

The group GRP_GLUE controls read access, and GRP_GLUE_WRITE controls write access. These access data using IAM roles for the EC2 nodes in use, and can access anything in glue. Security restrictions can be achieved by making a new glue connector with a different API key pair.

You can read about connectors in more detail at https://kognitio.com/documentation/late ... yntax.html

External Script Environments

Four external script environments are created by default:
  • LOCAL_SHELL runs bash
  • LOCAL_PYTHON runs python 2.7 with numpy and scipy installed
  • LOCAL_PYTHON3 runs python 3.6 with numpy, scipy and boto3 (the AWS API) installed
  • LOCAL_R runs rscript 3.4 with the 'forecast' package from CRAN and all depends built and installed
GRP_LOCAL_ENVS is used to control access to these script environments.

You can read about external script environments, and external scripting, which is basically a way to incorporate Python/R/the language of your choice within your SQL at https://kognitio.com/documentation/late ... t-env.html
Reply with quote Top

Who is online

Users browsing this forum: No registered users and 1 guest

cron