Forum

General discussion on using the Kognitio Analytical Platform.
Contributor
Offline
User avatar
Posts: 14
Joined: Wed Feb 11, 2015 3:57 pm

newsys option to cleanup existing data

by jagan.kumar » Fri Jul 03, 2015 5:41 pm

Hi

In the existing v8 environment,
as part of cleanup->reclaim->restore DB steps,
we are comparing the time taken for manual user schema cleanup steps with the Kognitio Newsys option.

Are there any best practices in using Newsys option based on your experience please?

thanks,
Jagan
Reply with quote Top
Contributor
Offline
User avatar
Posts: 386
Joined: Thu May 23, 2013 4:48 pm

Re: newsys option to cleanup existing data

by markc » Fri Jul 03, 2015 9:26 pm

Jagan,

I'm not quite sure what you are asking about here.

cleanup->reclaim->restore DB steps sounds like dropping tables and/or deleting rows as the "cleanup" step, then running reclaim to free up disk space, followed by restore to load data from another systems.

On the other hand, Newsys wipes a system, so presumably you'd followthat with a restore to get the same effect as your cleanup->reclaim->restore steps.

Assunming you are really comparing
1) deletes/drops which leave no active used data, followed be a reclaim
v.
2) newsys

I would recommend the latter as
a) there is no risk you will miss some deletes/drops
b) the time is completely predictable for a system - look at the time the previous Newsys took, and that is how long this one will take

The only caveat is that the next 8.1 patch (after 8.1.0rel150622, which is the current patch) will have a performance improvement for Newsys which internal testing shows will reduce the time to 30-40% of the times taken with previous patches.
Reply with quote Top
Contributor
Offline
User avatar
Posts: 14
Joined: Wed Feb 11, 2015 3:57 pm

Re: newsys option to cleanup existing data

by jagan.kumar » Tue Jul 07, 2015 4:16 pm

Thank you Mark.

As per our testing, for a 5 TB database,
>manual clean-up + reclaim took around 8 hours.
>newSys took around 2 hours

regards,
Jagan
Reply with quote Top

Who is online

Users browsing this forum: No registered users and 1 guest

cron