-
tajones
- Contributor
- Offline
-
- Posts: 16
- Joined: Mon Jun 04, 2018 4:28 pm
-
michaeld
- Contributor
- Offline
-
- Posts: 26
- Joined: Mon Dec 01, 2014 11:38 am
-
tajones
- Contributor
- Offline
-
- Posts: 16
- Joined: Mon Jun 04, 2018 4:28 pm
Information and discussion related to the Kognitio on Hadoop product
Restoring to an older Kognitio Backup Does Not Remove Old Objects
by tajones » Mon Jul 22, 2019 7:42 pm
We have a scenario right now where we would like to restore to a backup taken prior to when certain objects were created in order to remove a circular reference we cannot seem to resolve. When we restore we are still seeing those older objects even though they are not in the backup. What steps do we need to take in order to restore and end up with only those objects within the backup?
Our restore command is the following:
wxrestore -s localhost:**** -u sys -p ******* -d /tmp/prod02_restore/prod02_upto_100M_2019-06-17 -v --noimages > prod02_upto_100M_2019-06-17_RESTORE.log 2>&1 &
One odd thing to note is the last time we ran this restore command, it ran for 2.5 hours with the following error. It's odd because this is one of the views that was part of the circular reference, but we specifically chose this backup because it does not contain the other view that was involved with the circular reference. It was prior to when it was created. And SSE19.PRODUCT exists currently, even though the restore says it errored.
1170 create table/view "SSE19"."PRODUCT" (FAILED)
When executing: create or replace VIEW "PRODUCT" as
select distinct
sq1.*
...
[HY000] [Kognitio][WX2 Driver][localhost:****] CI0011: Insufficient memory
Restore took 2h 31m 36s
2612 jobs executed, of which 2611 succeeded (2 with warnings) and 1 failed.
Our restore command is the following:
wxrestore -s localhost:**** -u sys -p ******* -d /tmp/prod02_restore/prod02_upto_100M_2019-06-17 -v --noimages > prod02_upto_100M_2019-06-17_RESTORE.log 2>&1 &
One odd thing to note is the last time we ran this restore command, it ran for 2.5 hours with the following error. It's odd because this is one of the views that was part of the circular reference, but we specifically chose this backup because it does not contain the other view that was involved with the circular reference. It was prior to when it was created. And SSE19.PRODUCT exists currently, even though the restore says it errored.
1170 create table/view "SSE19"."PRODUCT" (FAILED)
When executing: create or replace VIEW "PRODUCT" as
select distinct
sq1.*
...
[HY000] [Kognitio][WX2 Driver][localhost:****] CI0011: Insufficient memory
Restore took 2h 31m 36s
2612 jobs executed, of which 2611 succeeded (2 with warnings) and 1 failed.
Re: Restoring to an older Kognitio Backup Does Not Remove Old Objects
by michaeld » Wed Jul 24, 2019 3:08 pm
Hi,
Restoring a backup doesn't remove pre-existing objects, it only creates objects and inserts data as specified in the backup directory and the restore command. To remove preexisting objects and restore from a clean slate, you would need to take a full backup, then drop the cluster, create a new cluster, and restore to the new cluster.
However in this case your mutual view dependency problem can be solved without restoring a backup. Assuming the mutually dependent views are LUOY.PRODUCT and SSE19.PRODUCT, you can:
1. run 'explain LUOY.PRODUCT' to see the current column names and types
2. Create an empty table with 'create ram only table rot1(< list of columns matching the above>)'
3. run 'create or replace view LUOY.PRODUCT as select * from rot1'
4. now you can drop both views
The above steps could alternatively be run on SSE19.PRODUCT.
Regards,
Mike
Restoring a backup doesn't remove pre-existing objects, it only creates objects and inserts data as specified in the backup directory and the restore command. To remove preexisting objects and restore from a clean slate, you would need to take a full backup, then drop the cluster, create a new cluster, and restore to the new cluster.
However in this case your mutual view dependency problem can be solved without restoring a backup. Assuming the mutually dependent views are LUOY.PRODUCT and SSE19.PRODUCT, you can:
1. run 'explain LUOY.PRODUCT' to see the current column names and types
2. Create an empty table with 'create ram only table rot1(< list of columns matching the above>)'
3. run 'create or replace view LUOY.PRODUCT as select * from rot1'
4. now you can drop both views
The above steps could alternatively be run on SSE19.PRODUCT.
Regards,
Mike
Re: Restoring to an older Kognitio Backup Does Not Remove Old Objects
by tajones » Thu Aug 29, 2019 8:27 pm
I'm late to reply, but these steps did resolve the main issue. But thank you for the overview of how the backup works as well.
3 posts
• Page 1 of 1
Who is online
Users browsing this forum: No registered users and 1 guest