Forum

Information and discussion related to the Kognitio on Hadoop product
Multiple Poster
Offline
User avatar
Posts: 7
Joined: Thu Jan 25, 2018 10:33 pm

HY000: [Kognitio][WX2 Driver][localhost:6551] ET0003: Error calling an external table connector method

by hadoop » Tue Jan 30, 2018 2:12 am

Not able to query parquet files.
Connected to localhost:6551 ODBC Version 8.02.00-rel171101 Server Version 08.02.0000
>SET SCHEMA DEMO_RET;
Query 1 Complete ---- 0:00.0 0:00.0 0:00.0
>CREATE EXTERNAL TABLE people (age BIGINT, name VARCHAR)
+FROM HDFS_PARQUET target 'uri_path "/example/data/people.parquet"';
Query 2 Complete ---- 0:01.1 0:01.1 0:01.1
>select * from people;
AGE|NAME
retcode = -1
HY000: [Kognitio][WX2 Driver][localhost:6551] ET0003: Error calling an external table connector method
Query 3 No Rows. ---- 0:00.4 0:01.4 0:01.4
Reply with quote Top
Contributor
Offline
User avatar
Posts: 13
Joined: Tue Jan 30, 2018 11:20 am

Re: HY000: [Kognitio][WX2 Driver][localhost:6551] ET0003: Error calling an external table connector method

by markm » Tue Jan 30, 2018 11:33 am

Could you please run the query again and then immediately afterwards run the following query and post the results.

select * from sys.ipe_script_debug where tno = (select max(tno) from sys.ipe_script_debug) order by pid, seq;

Thanks,
Mark
Reply with quote Top
Multiple Poster
Offline
User avatar
Posts: 7
Joined: Thu Jan 25, 2018 10:33 pm

Re: HY000: [Kognitio][WX2 Driver][localhost:6551] ET0003: Error calling an external table connector method

by hadoop » Tue Jan 30, 2018 6:21 pm

Thank you, Mark
here it is:
+select * from people;
AGE|NAME
retcode = -1
HY000: [Kognitio][WX2 Driver][localhost:6551] ET0003: Error calling an external table connector method
Query 6 No Rows. ---- 0:00.4 0:01.2 0:01.2
>select * from sys.ipe_script_debug where tno = (select max(tno) from sys.ipe_script_debug) order by pid, seq;
SESSION| TNO| STMT| USER_ID| DDATE| DTIME|HOSTNAME |NODE_NUMBER| MPID| PID| SEQ|MESSAGE
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 0|WARN 2018-01-30 18:17:02,882 [main][NativeCodeLoader.java:62] : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 1|ERROR 2018-01-30 18:17:03,114 [main][Main.java:99] : No FileSystem for scheme: wasb
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 2|com.kognitio.connector.FatalException: No FileSystem for scheme: wasb
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 3| at com.kognitio.connector.URIUtilities.fileList(URIUtilities.java:97)
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 4| at com.kognitio.connector.UriFileConnector.loadCoordinator(UriFileConnector.java:186)
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 5| at com.kognitio.connector.TableConnector.process(TableConnector.java:83)
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 6| at com.kognitio.connector.Main.main(Main.java:79)
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 7|Caused by: java.io.IOException: No FileSystem for scheme: wasb
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 8| at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2660)
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 9| at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2667)
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 10| at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:94)
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 11| at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2703)
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 12| at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2685)
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 13| at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:373)
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 14| at org.apache.hadoop.fs.Path.getFileSystem(Path.java:295)
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 15| at com.kognitio.connector.URIUtilities.fileList(URIUtilities.java:87)
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 16| ... 3 more
10| 663| 4| 0|2018-01-30|18:17:03|wn13-spark6 | 0| 0| 52468| 17|java-ext-table.jar returned [2] from method [LOADCO] connector [0]
Query 7 18 rows ---- 0:01.1 0:01.1 0:01.1


wasb is a blob storage on azure (analog of S3). Looks like jars/hadoop-azure-2.7.0.jar,jars/azure-storage-2.0.0.jar are not accessible. some config changes?
Reply with quote Top
Contributor
Offline
User avatar
Posts: 13
Joined: Tue Jan 30, 2018 11:20 am

Re: HY000: [Kognitio][WX2 Driver][localhost:6551] ET0003: Error calling an external table connector method

by markm » Wed Jan 31, 2018 8:25 pm

hadoop wrote:
Tue Jan 30, 2018 6:21 pm
wasb is a blob storage on azure (analog of S3). Looks like jars/hadoop-azure-2.7.0.jar,jars/azure-storage-2.0.0.jar are not accessible. some config changes?
Thanks for the debug info, I think you're correct about the libraries not being picked up properly - we will look into this.

Regards,
Mark
Reply with quote Top
Contributor
Offline
User avatar
Posts: 13
Joined: Tue Jan 30, 2018 11:20 am

Re: HY000: [Kognitio][WX2 Driver][localhost:6551] ET0003: Error calling an external table connector method

by markm » Thu Feb 15, 2018 3:01 pm

You were correct, it was a classpath issue - we now have a prerelease version of the Parquet / ORC connector available which should fix this problem.

Download https://s3-eu-west-1.amazonaws.com/upda ... ble.plugin and use it to replace the existing java-ext-table.plugin file in the ~/kodoop/add_on directory.

Install with the following SQL (log in as SYS):

alter connector HDFS_PARQUET reload;
alter connector HDFS_ORC reload;

Documentation for the Parquet and ORC connectors is at https://kognitio.com/documentation/late ... rquet.html and https://kognitio.com/documentation/late ... a-orc.html

You can check that the new plugin was picked up correctly by running the following SQL:

drop connector JET_Version cascade;
create connector JET_Version command 'java-ext-table.plugin' target 'connector_mode PLUGIN, max_connectors_per_node 1, connector_type VERSION';
select * from (external table (hostname varchar, version varchar, built varchar) from JET_Version) dt order by hostname;

This should return 0.4.11cp as the version number.

Regards,
Mark
Reply with quote Top
Contributor
Offline
Posts: 38
Joined: Mon Jan 06, 2014 10:36 am

Re: HY000: [Kognitio][WX2 Driver][localhost:6551] ET0003: Error calling an external table connector method

by skkirkham » Mon Apr 16, 2018 2:06 pm

Hi hadoop

There was a blog posted by Kognitio recently about installing on Azure HDInsight. It contains some useful links for getting started:

https://kognitio.com/blog/installing-ko ... hdinsight/
Reply with quote Top

Who is online

Users browsing this forum: No registered users and 1 guest

cron