Fuxie are your E submissions also of the same approximate size of characters updated?
and are you pruning your files?
I'm wondering if your files have a lot of older data vs. new update data?

If your files are purged/deleted and you have only or mostly new update data.. all I can say is "hmmn.. I haven't a clue what could be the processing issue."
And that bugs me.. I tend to spend much of my professional time, diagnosing IT problems and getting them fixed.

The one thing I do know is that so far as of the 12/15 data.. I'm batting .000% with 6 failures. Each submission I'm doing is with /census serverprune processed before I start doing my census runs on 40 to 50 factions each submission.

The fact that I'm not showing nearly 100,000 update isn't what bothers me.. as much as the fact that with all these E submissions from all of us, the most wanted and server submission pages here on the site are of no value.. no one can know which realm/factions need census runs more then others. sigh

oh well it is better then my other project (I run Wow in background, switching to it when I here the Census finished bell), that project has a program that randomly crashes on memory clean up when the program tells windows(win7 & win8) it no longer needs blocks of allocated memory... the problem seems to be a complied dll file which no one seems to have the source to any more.. it was lost during a hardware crash.. who needs backups .. sigh
So I get to try to figure out everything that dll was suppose to do and recreate it again from scratch.
Sort of like putting a picture puzzle together.. where there isn't a picture... and you haven't a clue if you have all the pieces.

Honestly, I can't remember, what I did, prune-wise, 3 weeks ago, but most likely, I used standard 30 days prune.
My files are NEVER over 4MB in size.. 3,5ish is the biggest files I have uploaded in MoP.

After the first failed file, a few days ago, I have started a prune-7 routine.._________________Doing census on various servers

Yep, I've been doing prune 5 the last few weeks with all the problems (only even played on 2 servers so won't be that high anyway), hasn't helped me much.

I suppose on the plus side, the backlog is progressing a lot faster than it was... I just think it's doing that by not processing many of the files _________________EU-Draenor:
-- Sagart - Tairbh - Buinne - Balgair - Naomh - Eilnich - Ruire - Dubh - Laidir --

It's starting to look like that there will not be a rollback to reprocess failed files and lost data will remain that way forever. No obvious news from Rollie and DB queue remains roughly 22 days behind schedule.

If there's not already a song about how lost data is gone forever, there ought to be.

I had two fails in a row from late on December 19. If our observed pattern of fails coming in bunches holds true, the rest of you should be seeing fails around the same time as well. How about it? Is the pattern holding true?

BTW five of the failures on the 19th were taken on a second computer with a
fresh install of WoW, the only addon installed and updated is CensusPlus via
curse client and a purge after each upload on both computers. I'm getting
the feeling the database just hates me.

BTW five of the failures on the 19th were taken on a second computer with a fresh install of WoW, the only addon installed and updated is CensusPlus via curse client and a purge after each upload on both computers. I'm getting the feeling the database just hates me.

Judging by the number of errors from pretty much everyone, I'm beginning to think it's not a problem with the uploads, but with the database itself.

I'm not into coding, but would it be possible that the database can't cope with the number of entries? After all, "Total character count: 98,373,879" and "Total guild count 6,580,801" does mean a really big lot of datasets...

Not that I know anything for sure, and also not to be a total naysayer, but those dates were when the db was already known by the userbase to be having issues, plus it's the Christmas timeframe, so my first thought was that fewer files were getting submitted on those days, thus the DB might still be processing at its same slow speed, and only has less to chew through.

Although I'd much prefer to subscribe to the theory of 'the problems are fixed' X D.

This thread has inspired me to do a complete purge of data after every upload, because even when things are fine serverside, why make it chew through the same data twice?_________________Censusing: Mostly Bronzebeard, Aggramar, Elune; sometimes Alleria, Icecrown, Scilla, Kel'Thuzad, Mal'Ganis, Draka, Staghelm, Nathrezim, Stonemaul.

I purged after every submission for most of December and in hindsight I
wish I hadn't. Each file that errors is just gone, poof, recycled electrons
before they were counted. Pruning to, say, two days or maybe three would
have contributed something of those soon to be recycled electrons when
that one file out of five or ten was a success.

... we'll see if the bugs are gone. I'm afraid I don't subscribe to the "purge of data after every upload" method. I'd suggest a /prune to the date that the person uploading had the last confirmed successful upload...

Certainly improving for me, not perfect but definitely doing better than it was. I mailed Rollie a few days back asking if he'd done anything to cause the recent improvements, but no response as yet so I guess he's not available right now, it may just be lesser load with fewer uploads over the holiday period, we'll see._________________EU-Draenor:
-- Sagart - Tairbh - Buinne - Balgair - Naomh - Eilnich - Ruire - Dubh - Laidir --