Right now there are roughly 600,000 files left for the file deleter to deal with. Current estimates say the file deleters should be finished by tomorrow morning.

The reason that the validators are down is because both the validators and file deleters were getting in each others way in the upload directory. So the current line of thinking is let the file deleter queue drain quickly and then attempt to bring the project up and see if the validator queue can hold it’s own after a day or two of the project being up and people have reported in and have new work to crunch. If the validator cannot keep up then the project will be brought back down and the validator queue will be drained and the project will be brought back up.

While it hasn’t been stated, I believe that if S@H is still having problems after all of that then the upload directory is going to be moved to a different device and file system which should be better able to deal with a lot of small files better.

However, I think there will be a heavy surge that will surprize everyone.
With the project offline for several days, a number of us have multuiple work-units ready for upload (I can account for about 15 WUs)
-- that will be a big huge surge.

From my past experience with systems -- i suspect it will take a few days (or a week) for the "steady-state" to come into come back into play.

Hmmm -- Have an idea about how to handle the Antique work unit bug that the project ran into, possible to have the client do a little handshaking with the Scheduler first (say send the WU id etc) .. If within valid date widow, then you can ack the request to send the WU. Sure, its a little more work on the front end (Hits the database some more) but would eliminate the antiques thus reducing the effects on the array. (can't imagine what the inodes look like lol )

I find it interesting that while the validators are off, and the deleters are chugging away, the "Ready to Send" queue is growing. Perhaps the deleters are finding some work units that need more crunching, and don't need to be deleted yet.

I think there will be a heavy surge that will surprize everyone.
With the project offline for several days, a number of us have multuiple work-units ready for upload (I can account for about 15 WUs)
-- that will be a big huge surge.

I only wish I had fifteen...my current counts:

Sitting in Berkeley waiting for validation - 206
Sitting on my network waiting to upload as of 0230 UTC - 180 (this increases by about 70/day)

Even if the average client crunches 4 WU/day and the active client counts are in the 300K range, that's 1.2 million WUs at an average size of 15K apiece or 18 gigs of data to contend with, an interesting backlog to say the least!
Stewie: So, is there any tread left on the tires? Or at this point would it be like throwing a hot dog down a hallway?
Fox Sunday (US) at 9PM ET/PT

Right now there are roughly 600,000 files left for the file deleter to deal with. Current estimates say the file deleters should be finished by tomorrow morning.

Will anybody be around to fire up the validators and/or scheduler before Monday (once the deleters are done)?

If not, it seems that 1-2 days of draining the WFV queue might be lost.

More than likely Matt will. It seems they tend to take turns working weekends.

Actually, it seems that no one regularly works weekends at UCB! That seems to be the mode over the last year! That's why I ask if the validators might be fired up before monday! (10am PDT - it gives the syops time to have a coffee after getting to work!)

However, I think there will be a heavy surge that will surprize everyone.
With the project offline for several days, a number of us have multuiple work-units ready for upload (I can account for about 15 WUs)
-- that will be a big huge surge.

I am sitting on about 50 WU and have nothing left. So I switched over to seti classic and am receiving all the work I can process.<img src="http://boinc.mundayweb.com/seti2/stats.php?userID=1899" border="0"> <img src="http://seti.mundayweb.com/stats.php?userID=567" border="0">
<img src="http://sero.cwsurf.de/dc.php/user/chrissard/project/ud.png">

Actually it is the various results which have passed their deadline which are timed out and rescheduled.

Yep I have 6 or 7 that for one reason or another have not been able to either upload or report due to this extended outage...damn, double damn and bugger! But that only accounts for about 5hrs of crunching, so not so bad....

Actually, it seems that no one regularly works weekends at UCB! That seems to be the mode over the last year! That's why I ask if the validators might be fired up before monday! (10am PDT - it gives the syops time to have a coffee after getting to work!)

You mean people actually work on weekends?? (He says as he stares at his smurf-like blue fingers made that way by getting beeped out at 00:30 Saturday morning to replace a ribbon drive on a ((get this)) mission critical Printronix P600 line printer.) 02:30am CDT - gives the field grunt time for a beer before it's time for breakfast. :)