when should i prune?
-
- Census Taker
- Posts: 76
- Joined: Tue Nov 18, 2008 10:14 am
- Location: Hawaii
when should i prune?
Dont think I can wait 30 days, files sizes are getting huge...
- bringoutyourdead
- Forums Admin & general flunky
- Posts: 1432
- Joined: Fri Nov 07, 2008 1:11 pm
- Location: Texas, USA
Pruning depends on your needs.
If you want to keep data for your local use.. you want to delay as long as possible and only prune by time.
If you are running CensusPlus mostly to upload to the site, then the more often you prune the faster the website can process your files. (Once you get a Y on your upload line, all the data the upload covered is just redundant info the processor has to plow through to get to new data.)
If you do a raw Http upload, the limit the site can handle is about 10MB so you need to keep watch on the file size and start thinking about time pruning around 8MB or so.
If you use the UniUploader program then it compresses close to 90% and you can get large data sets uploaded. But by definition if your data sets are that large.. they are full of redundant info.
Personally I tend to do a serverprune every few days when my character count for the account gets up into the 50k characters. (rough guess by checking my upload record) [using the UniUploader debug view I start thinking about pruning when the transmitted size gets over 500kBytes]
I hate waiting for my uploads to process.. I want near instant processing and updating of most wanted and server submissions.. too bad that doesnt happen.
If you want to keep data for your local use.. you want to delay as long as possible and only prune by time.
If you are running CensusPlus mostly to upload to the site, then the more often you prune the faster the website can process your files. (Once you get a Y on your upload line, all the data the upload covered is just redundant info the processor has to plow through to get to new data.)
If you do a raw Http upload, the limit the site can handle is about 10MB so you need to keep watch on the file size and start thinking about time pruning around 8MB or so.
If you use the UniUploader program then it compresses close to 90% and you can get large data sets uploaded. But by definition if your data sets are that large.. they are full of redundant info.
Personally I tend to do a serverprune every few days when my character count for the account gets up into the 50k characters. (rough guess by checking my upload record) [using the UniUploader debug view I start thinking about pruning when the transmitted size gets over 500kBytes]
I hate waiting for my uploads to process.. I want near instant processing and updating of most wanted and server submissions.. too bad that doesnt happen.

-
- Census Taker
- Posts: 76
- Joined: Tue Nov 18, 2008 10:14 am
- Location: Hawaii
Yes, especially on older machines on logout of a realm when CP writes to the CensusPlus.lua.
Before metalbeast migrated the server I had started pruning any over 3 days because it was unsure that the file would process successfully and having the 'backup' of toons submitted each time after census seemed necessary. Since migration I've gone back to purging after each submission so I don't have local long term history of toons but files are rarely over 1 meg and uploads via the submit data page are quick. Even though processing of files is soon after submission now, I still keep the files so if a submission fails I can upload it again before the next days census. Knock on wood (hammers himself in the head) there have been no failures for me since the server change.
Before metalbeast migrated the server I had started pruning any over 3 days because it was unsure that the file would process successfully and having the 'backup' of toons submitted each time after census seemed necessary. Since migration I've gone back to purging after each submission so I don't have local long term history of toons but files are rarely over 1 meg and uploads via the submit data page are quick. Even though processing of files is soon after submission now, I still keep the files so if a submission fails I can upload it again before the next days census. Knock on wood (hammers himself in the head) there have been no failures for me since the server change.
-
- Census Taker
- Posts: 76
- Joined: Tue Nov 18, 2008 10:14 am
- Location: Hawaii