WR Updates, Not Updating (4.0.3a patch)

Found a bug with the site? Let me know!
User avatar
FuxieDK
Census Taker
Posts: 659
Joined: Thu May 22, 2008 11:36 am
Location: Copenhagen, DK

Post by FuxieDK »

As I see it's our primary "enemy" right now, is the pauses in the processing..

When files are being processed, it's done at a decent speed.
Processing for 2 hours and then make an 6-8 hour pause, works OK(ish), when data is up to date..
However, when data is so far behind as it is now, we loose all progress in those pauses.

If Rollie can/will disable that pause (even if only temporary), I reckon that we can catch in less than 24 hours..
Then Rollie can re-enable the pause, if he thinks it's best for the system..
Doing census mainly on Draenor; Raluf - Nimsay - Lusmo - Quixx - Sosyan - Garthog - Trubin - Zalistra - Zesmi and Djaang

User avatar
bringoutyourdead
Forums Admin & general flunky
Posts: 1432
Joined: Fri Nov 07, 2008 1:11 pm
Location: Texas, USA

Post by bringoutyourdead »

FuxieDK wrote:As I see it's our primary "enemy" right now, is the pauses in the processing..


If Rollie can/will disable that pause (even if only temporary), I reckon that we can catch in less than 24 hours..
Then Rollie can re-enable the pause, if he thinks it's best for the system..
I don't think that Rollie has enabled a 'Pause'. I expect that what you think are pauses are nothing more than the database engine working on data you aren't aware of. We don't know how Rollie has his database environment setup (what engine, what tables, indices and other structures)

User avatar
FuxieDK
Census Taker
Posts: 659
Joined: Thu May 22, 2008 11:36 am
Location: Copenhagen, DK

Post by FuxieDK »

bringoutyourdead wrote:
FuxieDK wrote:As I see it's our primary "enemy" right now, is the pauses in the processing..


If Rollie can/will disable that pause (even if only temporary), I reckon that we can catch in less than 24 hours..
Then Rollie can re-enable the pause, if he thinks it's best for the system..
I don't think that Rollie has enabled a 'Pause'. I expect that what you think are pauses are nothing more than the database engine working on data you aren't aware of. We don't know how Rollie has his database environment setup (what engine, what tables, indices and other structures)
Which is exactly why I wrote "If Rollie can/will disable...." ;)
Doing census mainly on Draenor; Raluf - Nimsay - Lusmo - Quixx - Sosyan - Garthog - Trubin - Zalistra - Zesmi and Djaang

User avatar
Rollie
Site Admin
Posts: 4783
Joined: Sun Nov 28, 2004 11:52 am
Location: Austin, TX
Contact:

Post by Rollie »

Yeah, that pause isn't so much of a pause in processing, but a pause in active file processing while it compiles total stats. There is a long post-processing routine that is run that basically gets all this raw data into a form that allows me to display it quickly on the site.
phpbb:phpinfo()

User avatar
FuxieDK
Census Taker
Posts: 659
Joined: Thu May 22, 2008 11:36 am
Location: Copenhagen, DK

Post by FuxieDK »

Rollie wrote:Yeah, that pause isn't so much of a pause in processing, but a pause in active file processing while it compiles total stats. There is a long post-processing routine that is run that basically gets all this raw data into a form that allows me to display it quickly on the site.
Can't that compile of total stats be skipped, until we have catched up?

Right now, you've disabled upload, which means we loose critical data for people that level... However, there is no improvement in process speed, which, overall, is aworse situation now, than before..
Doing census mainly on Draenor; Raluf - Nimsay - Lusmo - Quixx - Sosyan - Garthog - Trubin - Zalistra - Zesmi and Djaang

1974ER
Epic Censi
Posts: 762
Joined: Fri Nov 07, 2008 3:30 am

Post by 1974ER »

I'll leave your question to Rollie...

But as to losing data... I have started to cut out the .lua and put it into folders called Lua Unsent 1, Lua Unsent 2, etc, because I now no longer can prune/purge submitted data since I can't submit. That way, when Rollie is able to restore uploading function, I'll have at least something to submit. But, admittably and truth be told, it's a stopgap method at best.

And we face another storm... We are seeing an unprecedented scale of new data... and most of it passes us by. Rollie, any chance of getting a temporary upgrade of the addon out quickly, even if it's English only, lacks bars, new faces, WIM / wholib support, etc... but just had the basic coding necessary to catch goblins, worgen and 81+ to at least some degree?

Balgair has most graciously shared some of her work with me, so I am slightly better off than the general public. But basically... I believe we, the submission makers, would appreciate even limited tools to work with while you go through (undoubtably huge effort of) tinkering the site to Cataclysm compatible form and refine the code to higher level of "play togehter" with other addons.

As usual, thank you for everyone who managed to finish reading my musings. :D Comments most welcome, also. :)

User avatar
FuxieDK
Census Taker
Posts: 659
Joined: Thu May 22, 2008 11:36 am
Location: Copenhagen, DK

Post by FuxieDK »

1974ER wrote:But as to losing data... I have started to cut out the .lua and put it into folders called Lua Unsent 1, Lua Unsent 2, etc,
So am I, but sadly, that isn't what everyone is doing :(



I've also tried to change

Code: Select all

local MAX_CHARACTER_LEVEL = 80;
from 80 to 85, but the scanner doesn't scan above 80 anyway :(
Doing census mainly on Draenor; Raluf - Nimsay - Lusmo - Quixx - Sosyan - Garthog - Trubin - Zalistra - Zesmi and Djaang

Balgair
Araiceil
Posts: 1716
Joined: Fri Sep 30, 2005 11:47 am
Location: UK

Post by Balgair »

You need to edit the actual scan process bit, that tells it what to search for - a fair way down in the lua, under the section labelled "Take a CensusPlus" is a segment of code like this:

Code: Select all

   
        local job = CensusPlus_CreateJob( 71, 84, nil, nil, nil );
        InsertJobIntoQueue(job);
        
		job = CensusPlus_CreateJob( 85, 85, nil, nil, nil );
		InsertJobIntoQueue(job);
That's how I've edited it, originally the numbers were 71, 79, and 80, 80. Yes it looks more logical to tell it to do 81-84 but I broke it when I tried that and it didn't search 71-80, so just using a clunky search band to get results at all ;)

I'm actually not censusing that much atm, probably should be but since I'm not going to get goblins or worgens (totally broke the addon when I tried adding them so gave up, that's evidently beyond me!), it feels less effective than if I could see everything. Plus I overdid it last month and want to just enjoy playing atm (even if my copy STILL hasn't arrived so I'm actually only playing my troll druid /sigh :()

User avatar
FuxieDK
Census Taker
Posts: 659
Joined: Thu May 22, 2008 11:36 am
Location: Copenhagen, DK

Post by FuxieDK »

It works :)

But it now takes 71-84 in one go (or attempts to).. Not ideal for release, but OK(ish) for waiting time ;)
Doing census mainly on Draenor; Raluf - Nimsay - Lusmo - Quixx - Sosyan - Garthog - Trubin - Zalistra - Zesmi and Djaang

Balgair
Araiceil
Posts: 1716
Joined: Fri Sep 30, 2005 11:47 am
Location: UK

Post by Balgair »

I said it was clunky ;) Obviously can't release it like that but it does as a stopgap anyway lol - I know absolutely zero about coding so getting it working that far was a miracle ;)

Post Reply